Online Handwriting Trajectory Reconstruction from Kinematic Sensors using Temporal Convolutional Network - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue International Journal on Document Analysis and Recognition Année : 2023

Online Handwriting Trajectory Reconstruction from Kinematic Sensors using Temporal Convolutional Network

Résumé

Handwriting with digital pens is a common way to facilitate human-computer interaction through the use of Online Handwriting (OH) trajectory reconstruction. In this work, we focus on a digital pen equipped with sensors from which one wants to reconstruct the OH trajectory. Such a pen allows to write on any surface and to get the digital trace, which can help learning to write, by writing on paper, and can be useful for many other applications such as collaborative meetings, etc. In this paper, we introduce a novel processing pipeline that maps the sensor signals of the pen to the corresponding OH trajectory. Notably, in order to tackle the difference of sampling rates between the pen and the tablet (which provides ground truth information), our preprocessing pipeline relies on Dynamic Time Warping to align the signals. We introduce a dedicated neural network architecture, inspired by a Temporal Convolutional Network, to reconstruct the online trajectory from the pen sensor signals. Finally, we also present a new benchmark dataset on which our method is evaluated both qualitatively and quantitatively, showing a notable improvement over its most notable competitor.
Fichier principal
Vignette du fichier
IJDAR_ICDAR_2023 (6).pdf (19.08 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04076399 , version 1 (20-04-2023)
hal-04076399 , version 2 (21-04-2023)

Licence

Paternité

Identifiants

Citer

Wassim Swaileh, Florent Imbert, Yann Soullard, Romain Tavenard, Eric Anquetil. Online Handwriting Trajectory Reconstruction from Kinematic Sensors using Temporal Convolutional Network. International Journal on Document Analysis and Recognition, 2023, ⟨10.1007/s10032-023-00430-1⟩. ⟨hal-04076399v2⟩
218 Consultations
102 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More