From Raw Images of the Lips to Articulatory Parameters : A Viseme-based Prediction - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 1997

From Raw Images of the Lips to Articulatory Parameters : A Viseme-based Prediction

Lionel Reveret

Abstract

This paper presents a method for the extraction of articulatory parameters from direct processing of raw images of the lips. The system architecture is made of three independent parts. First, a new greyscale mouth image is centred and downsampled. Second, the image is aligned and projected onto a basis of artificial images. These images are the eigenvectors computed from a PCA applied on a set of 23 reference lip shapes. Then, a multilinear interpolation predicts articulatory parameters from the image projection coefficients onto the eigenvectors. In addition, the projection coefficients and the predicted parameters were evaluated by an HMMbased visual speech recogniser. Recognition scores obtained with our method are compared to reference scores and discussed.
Fichier principal
Vignette du fichier
euro97.pdf (164.03 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

inria-00389372 , version 1 (28-05-2009)

Identifiers

  • HAL Id : inria-00389372 , version 1

Cite

Lionel Reveret. From Raw Images of the Lips to Articulatory Parameters : A Viseme-based Prediction. EUROSPEECH Conference, Sep 1997, Rhodes, Greece. ⟨inria-00389372⟩
118 View
91 Download

Share

Gmail Facebook X LinkedIn More