MOTHER: A new generation of talking heads providing a flexible articulatory control for video-realistic speech animation - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2000

MOTHER: A new generation of talking heads providing a flexible articulatory control for video-realistic speech animation

Lionel Reveret
Gérard Bailly
Pierre Badin

Résumé

This article presents the first version of a talking head, called MOTHER (MOrphable Talking Head for Enhanced Reality), based on an articulatory model describing the degrees-offreedom of visible (lips, cheeks...) but also partially or indirectly visible (jaw, tongue...) speech articulators. Skin details are rendered using texture mapping/blending techniques. We illustrate here the flexibility of such an articulatory control of video-realistic speaking faces by first demonstrating its ability in tracking facial movements by an optical-to-articulatory inversion using an analysis-by-synthesis technique. The stability and reliability of the results allow the automatic inversion of large video sequences. Inversion results are here used to build automatically a coarticulation model for the generation of facial movements from text. It improves the previous Text-To- AudioVisual-Speech (TTAVS) synthesizer developed at the ICP both in terms of the accuracy and realism.
Fichier principal
Vignette du fichier
icslp00.pdf (2.6 Mo) Télécharger le fichier
Vignette du fichier
ttvs_syn.jpg (12.89 Ko) Télécharger le fichier
ttvs_syn.avi (2.4 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Format Figure, Image
Format Autre
Loading...

Dates et versions

inria-00389362 , version 1 (28-05-2009)

Identifiants

  • HAL Id : inria-00389362 , version 1

Citer

Lionel Reveret, Gérard Bailly, Pierre Badin. MOTHER: A new generation of talking heads providing a flexible articulatory control for video-realistic speech animation. Int. Conference of Spoken Language Processing, ICSLP'2000, Oct 2000, Pekin, China. ⟨inria-00389362⟩
630 Consultations
507 Téléchargements

Partager

More