Audiovisual Generation of Social Attitudes from Neutral Stimuli - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2015

Audiovisual Generation of Social Attitudes from Neutral Stimuli


The focus of this study is the generation of expressive audiovisual speech from neutral utterances for 3D virtual actors. Taking into account the segmental and suprasegmental aspects of audiovisual speech, we propose and compare several computational frameworks for the generation of expressive speech and face animation. We notably evaluate a standard frame-based conversion approach with two other methods that postulate the existence of global prosodic audiovisual patterns that are characteristic of social attitudes. The proposed approaches are tested on a database of " Exercises in Style " [1] performed by two semi-professional actors and results are evaluated using crowdsourced perceptual tests. The first test performs a qualitative validation of the animation platform while the second is a comparative study between several expressive speech generation methods. We evaluate how the expressiveness of our audiovisual performances is perceived in comparison to resynthesized original utterances and the outputs of a purely frame-based conversion system.
Fichier principal
Vignette du fichier
audiovisual-generation-avsp-2015.pdf (421.27 Ko) Télécharger le fichier
Vignette du fichier
audiovisual_generation_of_social_attitudes_from_neural_stimuli.jpeg (33.2 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Format : Figure, Image
Origin : Files produced by the author(s)

Dates and versions

hal-01178056 , version 1 (22-12-2015)


  • HAL Id : hal-01178056 , version 1


Adela Barbulescu, Gérard Bailly, Rémi Ronfard, Maël Pouget. Audiovisual Generation of Social Attitudes from Neutral Stimuli. FAAVSP 2015 - 1st Joint Conference on Facial Analysis, Animation and Auditory-Visual Speech Processing, Sep 2015, Vienne, Austria. pp.34-39. ⟨hal-01178056⟩
555 View
252 Download


Gmail Facebook X LinkedIn More