Online Handwriting Trajectory Reconstruction from Kinematic Sensors using Temporal Convolutional Network - Inria - Institut national de recherche en sciences et technologies du numérique
Journal Articles International Journal on Document Analysis and Recognition Year : 2023

Online Handwriting Trajectory Reconstruction from Kinematic Sensors using Temporal Convolutional Network

Abstract

Handwriting with digital pens is a common way to facilitate human-computer interaction through the use of Online Handwriting (OH) trajectory reconstruction. In this work, we focus on a digital pen equipped with sensors from which one wants to reconstruct the OH trajectory. Such a pen allows to write on any surface and to get the digital trace, which can help learning to write, by writing on paper, and can be useful for many other applications such as collaborative meetings, etc. In this paper, we introduce a novel processing pipeline that maps the sensor signals of the pen to the corresponding OH trajectory. Notably, in order to tackle the difference of sampling rates between the pen and the tablet (which provides ground truth information), our preprocessing pipeline relies on Dynamic Time Warping to align the signals. We introduce a dedicated neural network architecture, inspired by a Temporal Convolutional Network, to reconstruct the online trajectory from the pen sensor signals. Finally, we also present a new benchmark dataset on which our method is evaluated both qualitatively and quantitatively, showing a notable improvement over its most notable competitor.
Fichier principal
Vignette du fichier
IJDAR_ICDAR_2023 (6).pdf (19.08 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04076399 , version 1 (20-04-2023)
hal-04076399 , version 2 (21-04-2023)

Licence

Identifiers

Cite

Wassim Swaileh, Florent Imbert, Yann Soullard, Romain Tavenard, Eric Anquetil. Online Handwriting Trajectory Reconstruction from Kinematic Sensors using Temporal Convolutional Network. International Journal on Document Analysis and Recognition, 2023, ⟨10.1007/s10032-023-00430-1⟩. ⟨hal-04076399v2⟩
301 View
274 Download

Altmetric

Share

More