Phone Merging for Code-switched Speech Recognition - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2018

Phone Merging for Code-switched Speech Recognition


Speakers in multilingual communities often switch between or mix multiple languages in the same conversation. Automatic Speech Recognition (ASR) of code-switched speech faces many challenges including the influence of phones of different languages on each other. This paper shows evidence that phone sharing between languages improves the Acoustic Model performance for Hindi-English code-switched speech. We compare base-line system built with separate phones for Hindi and English with systems where the phones were manually merged based on linguistic knowledge. Encouraged by the improved ASR performance after manually merging the phones, we further investigate multiple data-driven methods to identify phones to be merged across the languages. We show detailed analysis of automatic phone merging in this language pair and the impact it has on individual phone accuracies and WER. Though the best performance gain of 1.2% WER was observed with manually merged phones, we show experimentally that the manual phone merge is not optimal.
Fichier principal
Vignette du fichier
phone-merging-acl.pdf (300.13 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01800466 , version 1 (26-05-2018)


  • HAL Id : hal-01800466 , version 1


Sunit Sivasankaran, Brij Mohan Lal Srivastava, Sunayana Sitaram, Kalika Bali, Monojit Choudhury. Phone Merging for Code-switched Speech Recognition. Third Workshop on Computational Approaches to Linguistic Code-switching, collocated with ACL 2018 Jul 2018, Melbourne, Australia. ⟨hal-01800466⟩
281 View
300 Download


Gmail Facebook X LinkedIn More