A study on auditory feature spaces for speech-driven lip animation - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2011

A study on auditory feature spaces for speech-driven lip animation

Abstract

We present in this paper a study on auditory feature spaces for speech-driven face animation. The goal is to provide solid analytic ground to underscore the description capability of some well-known features with relation to lipsync. A set of various audio features describing the temporal and spectral shape of speech signal has been computed on annotated audio extracts. The dimension of the input feature space has been reduced with PCA and the contribution of each input feature is investigated to determine the more descriptive. The resulting feature space is quantitatively and qualitatively analyzed for the description of acoustic units (phonemes, visemes, etc.) and we demonstrate that the use of some low-level features in addition to MFCC increases the relevance of the feature space. Finally, we evaluate the stability of these features w.r.t. the gender of the speaker.
Fichier principal
Vignette du fichier
interspeech_2011.pdf (177.61 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

inria-00598314 , version 1 (16-10-2012)

Identifiers

  • HAL Id : inria-00598314 , version 1

Cite

Guylaine Le-Jan, Yannick Benezeth, Guillaume Gravier, Frédéric Bimbot. A study on auditory feature spaces for speech-driven lip animation. Interspeech, Aug 2011, Florence, Italy. ⟨inria-00598314⟩
189 View
178 Download

Share

Gmail Facebook X LinkedIn More