Early Recognition of Untrimmed Handwritten Gestures with Spatio-Temporal 3D CNN - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2022

Early Recognition of Untrimmed Handwritten Gestures with Spatio-Temporal 3D CNN

Résumé

Early recognition of untrimmed handwritten gestures is the task of recognizing as soon as possible gestures drawn in a continuous stream, one after another. This is particularly challenging for multi-touch gestures because it is impossible to know when the gesture has started and finished. For mono-stroke gestures, in an application context where the finger is never removed from the device between gestures, the recognition is even more complex. In this work we present an extension of the Online Long-Term Convolutional 3D (OLT-C3D) network to address the task of early recognition of untrimmed gestures which have been addressed by very few works. To evaluate our approach, we created two synthetic datasets using freely available benchmarks, MTGSetB and ILGDB, simulating the streaming data in two different application scenarios. Furthermore, we propose a new evaluation metric for this specific task. Our approach achieves good performances on the two new datasets and will be a baseline for future works on this challenging task.
Fichier principal
Vignette du fichier
ICPR22_Untrimmed_Early_Recognition_of_2D_Gestures_VCamReady.pdf (6.23 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03683441 , version 1 (31-05-2022)

Licence

Identifiants

  • HAL Id : hal-03683441 , version 1

Citer

William Mocaër, Eric Anquetil, Richard Kulpa. Early Recognition of Untrimmed Handwritten Gestures with Spatio-Temporal 3D CNN. ICPR 2022 - International Conference on Pattern Recognition, Aug 2022, Montréal, Canada. pp.1636-1642. ⟨hal-03683441⟩
111 Consultations
100 Téléchargements

Partager

More