Synthetic lines from historical manuscripts: an experiment using GAN and style transfer - Inria - Institut national de recherche en sciences et technologies du numérique
Conference Papers Year : 2023

Synthetic lines from historical manuscripts: an experiment using GAN and style transfer

Abstract

Given enough data of sufficient quality, HTR systems can achieve high accuracy, regardless of language, script or medium. Despite growing pooling of datasets, the question of the required quantity of training material still remains crucial for the transfer of models to out-of-domain documents, or the recognition of new scripts and under-resourced character classes. We propose a new data augmentation strategy, using generative adversarial networks (GAN). Inspired by synthetic lines generation for printed documents, our objective is to generate handwritten lines in order to massively produce data for a given style or under-resourced character class. Our approach, based on a variant of ScrabbleGAN, demonstrates the feasibility for various scripts, either in the presence of a high number and variety of abbreviations (Latin) and spellings or letter forms (Old French), in a situation of data scarcity (Armenian), or in the instance of a very cursive script (Arabic Maghribi). We then study the impact of synthetic line generation on HTR, by evaluating the gain for out-of-domain documents and under-resourced classes.
Fichier principal
Vignette du fichier
ViDiScript___GAN_Line_HTR-1.pdf (3.72 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04178550 , version 1 (08-08-2023)
hal-04178550 , version 2 (23-08-2023)

Licence

Identifiers

  • HAL Id : hal-04178550 , version 1

Cite

Chahan Vidal-Gorène, Jean-Baptiste Camps, Thibault Clérice. Synthetic lines from historical manuscripts: an experiment using GAN and style transfer. ViDiScript - Visual Processing of Digital Manuscripts: Workflows, Pipelines, Best Practices at ICIAP 2023, Sep 2023, Udine, Italy. ⟨hal-04178550v1⟩
180 View
119 Download

Share

More