3D dynamic spatiotemporal atlas of the vocal tract during consonant-vowel production from 2D real time MRI - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue Journal of Imaging Année : 2022

3D dynamic spatiotemporal atlas of the vocal tract during consonant-vowel production from 2D real time MRI

Résumé

In this work we address the problem of creating a 3D dynamic atlas of the vocal tract that captures the dynamics of the articulators in all three dimensions in order to create a global speaker model independent from speaker specific characteristics. The core steps of the proposed method are temporal alignment of the real-time MR images acquired in several sagittal planes and their combination with adaptive kernel regression. As a preprocessing step, a reference space was created to be used in order to remove anatomical information of the speakers and keep only the variability in speech production for the construction of the atlas. The adaptive kernel regression makes the choice of atlas time points independently of the time points of the frames that are used as an input for the construction. The evaluation of this atlas construction method was made by mapping two new speakers to the atlas and by checking how similar the resulting mapped images are. The use of the atlas helps in reducing subject variability. Results show that the use of the proposed atlas can capture the dynamic behavior of the articulators and is able to generalize the speech production process by creating a universal-speaker reference space.
Fichier principal
Vignette du fichier
Manuscript_Spatiotemporal atlas of the vocal tract.pdf (877.15 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03808325 , version 1 (10-10-2022)

Identifiants

Citer

Ioannis K Douros, Yu Xie, Chrysanthi Dourou, Karyna Isaieva, Pierre-Andre Vussoz, et al.. 3D dynamic spatiotemporal atlas of the vocal tract during consonant-vowel production from 2D real time MRI. Journal of Imaging, 2022, Special Issue Spatio-Temporal Biomedical Image Analysis, 8 (9), pp.227. ⟨10.3390/jimaging8090227⟩. ⟨hal-03808325⟩
42 Consultations
38 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More