Synthetic lines from historical manuscripts: an experiment using GAN and style transfer - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Synthetic lines from historical manuscripts: an experiment using GAN and style transfer

Résumé

Given enough data of sufficient quality, HTR systems can achieve high accuracy, regardless of language, script or medium. Despite growing pooling of datasets, the question of the required quantity of training material still remains crucial for the transfer of models to out-of-domain documents, or the recognition of new scripts and under-resourced character classes. We propose a new data augmentation strategy, using generative adversarial networks (GAN). Inspired by synthetic lines generation for printed documents, our objective is to generate handwritten lines in order to massively produce data for a given style or under-resourced character class. Our approach, based on a variant of ScrabbleGAN, demonstrates the feasibility for various scripts, either in the presence of a high number and variety of abbreviations (Latin) and spellings or letter forms (Old French), in a situation of data scarcity (Armenian), or in the instance of a very cursive script (Arabic Maghribi). We then study the impact of synthetic line generation on HTR, by evaluating the gain for out-of-domain documents and under-resourced classes.
Fichier principal
Vignette du fichier
ViDiScript___GAN_Line_HTR.pdf (3.17 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Licence : CC BY - Paternité

Dates et versions

hal-04178550 , version 1 (08-08-2023)
hal-04178550 , version 2 (23-08-2023)

Licence

Paternité

Identifiants

  • HAL Id : hal-04178550 , version 2

Citer

Chahan Vidal-Gorène, Jean-Baptiste Camps, Thibault Clérice. Synthetic lines from historical manuscripts: an experiment using GAN and style transfer. Visual Processing of Digital Manuscripts: Workflows, Pipelines, Best Practices. ICIAP 2023 Workshops. ICIAP 2023., Sep 2023, Udine, Italy. ⟨hal-04178550v2⟩
120 Consultations
76 Téléchargements

Partager

Gmail Facebook X LinkedIn More