Super-Resolved Dynamic 3D Reconstruction of the Vocal Tract during Natural Speech - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles Journal of Imaging Year : 2023

Super-Resolved Dynamic 3D Reconstruction of the Vocal Tract during Natural Speech

Abstract

MRI is the gold standard modality for speech imaging. However, it remains relatively slow, which complicates imaging of fast movements. Thus, an MRI of the vocal tract is often performed in 2D. While 3D MRI provides more information, the quality of such images is often insufficient. The goal of this study was to test the applicability of super-resolution algorithms for dynamic vocal tract MRI. In total, 25 sagittal slices of 8 mm with an in-plane resolution of 1.6 × 1.6 mm2 were acquired consecutively using a highly-undersampled radial 2D FLASH sequence. The volunteers were reading a text in French with two different protocols. The slices were aligned using the simultaneously recorded sound. The super-resolution strategy was used to reconstruct 1.6 × 1.6 × 1.6 mm3 isotropic volumes. The resulting images were less sharp than the native 2D images but demonstrated a higher signal-to-noise ratio. It was also shown that the super-resolution allows for eliminating inconsistencies leading to regular transitions between the slices. Additionally, it was demonstrated that using visual stimuli and shorter text fragments improves the inter-slice consistency and the super-resolved image sharpness. Therefore, with a correct speech task choice, the proposed method allows for the reconstruction of high-quality dynamic 3D volumes of the vocal tract during natural speech.
Fichier principal
Vignette du fichier
jimaging-09-00233-v4.pdf (6.36 Mo) Télécharger le fichier
Origin Publisher files allowed on an open archive

Dates and versions

hal-04373276 , version 1 (04-01-2024)

Identifiers

Cite

Karyna Isaieva, Freddy Odille, Yves Laprie, Guillaume Drouot, Jacques Felblinger, et al.. Super-Resolved Dynamic 3D Reconstruction of the Vocal Tract during Natural Speech. Journal of Imaging, 2023, 9 (10), pp.233. ⟨10.3390/jimaging9100233⟩. ⟨hal-04373276⟩
26 View
14 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More