An Extraction Method of Lip Movement Images from Successive Image Frames in the Speech Activity Extraction Process - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2010

An Extraction Method of Lip Movement Images from Successive Image Frames in the Speech Activity Extraction Process

Résumé

In this paper, we propose an extraction method of lip movement images from successive image frames and present the possibility to utilize lip movement images in the speech activity extraction process of speech recognition phase. The image frames are acquired from the PC image camera with the assumption that facial movement is limited during talking. First of all, one new lip movement image frame is generated with comparing two successive image frames each other. Second, the fine image noises are removed. Each fitness rate is calculated by comparing the lip feature data as objectly separated images. It is analyzed whether or not there is the lip movement image through verification to the objects and three images which have higher rates in their fitnesses. As a result of linking the speech & image processing system, the interworking rate shows 99.3% even in the various illumination environments. It was visually confirmed that lip movement images are tracked and can be utilized in speech activity extraction process.
Fichier principal
Vignette du fichier
icec2010_submission_11.pdf (450.16 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01055628 , version 1 (13-08-2014)

Licence

Paternité

Identifiants

Citer

Eung-Kyeu Kim, Soo-Jong Lee, Nohpill Park. An Extraction Method of Lip Movement Images from Successive Image Frames in the Speech Activity Extraction Process. 9th International Conference on Entertainment Computing (ICEC), Sep 2010, Seoul, South Korea. pp.317-325, ⟨10.1007/978-3-642-15399-0_33⟩. ⟨hal-01055628⟩
79 Consultations
331 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More