An integrative platform to capture the orchestration of gesture and speech - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2019

An integrative platform to capture the orchestration of gesture and speech

Résumé

A number of studies have highlighted the coordination of gesture and intonation (Bolinger, 1983; Darwin, 1872; Kendon, 1980) but the technological setups have been insufficient to couple the acoustic and gestural data with sufficient detail. In this paper, we present the MODALISA platform which enables language specialists to integrate gesture, intonation, speech production and content. The methods of data acquisition, annotation and analysis are detailed. The preliminary results of our pilot study illustrate strong correlations between gestures and intonation when they are simultaneously performed by the speaker. The correlations are particularly strong for proximal segments. Our aim is to expand those results and analyse typical and atypical populations across the lifespan.
Fichier principal
Vignette du fichier
GeSpIn2019_paper_10.pdf (2.07 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02278345 , version 1 (04-09-2019)

Identifiants

  • HAL Id : hal-02278345 , version 1

Citer

Christelle Dodane, Dominique Boutet, Ivana Didirkova, Fabrice Hirsch, Slim Ouni, et al.. An integrative platform to capture the orchestration of gesture and speech. GeSpIn 2019 - Gesture and Speech in Interaction, Sep 2019, Paderborn, Germany. ⟨hal-02278345⟩
213 Consultations
385 Téléchargements

Partager

More