Variable-Length Sequence Language Model for Large Vocabulary Continuous Dictation Machine - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 1999

Variable-Length Sequence Language Model for Large Vocabulary Continuous Dictation Machine

Résumé

In natural language, some sequences of words are very frequent. A classical language model, like n-gram, does not adequately take into account such sequences, because it underestimates their probabilities. A better approach consists in modeling word sequences as if they were individual dictionary elements. Sequences are considered as additional entries of the word lexicon, on which language models are computed. In this paper, we present two methods for automatically determining frequent phrases in unlabeled corpora of written sentences. These methods are based on information theoretic criteria which insure a high statistical consistency. Our models reach their local optimum since they minimize the perplexity. One procedure is based only on the n-gram language model to extract word sequences. The second one is based on a class n-gram model trained on 233 classes extracted from the eight grammatical classes of French. Experimental tests, in terms of perplexity and recognition rate, are carried out on a vocabulary of 20000 words and a corpus of 43 million words extracted from the ?Le Monde? newspaper. Our models reduce perplexity by more than 20% compared with n-gram (nR3) and multigram models. In terms of recognition rate, our models outperform n-gram and multigram models.
Fichier principal
Vignette du fichier
99-R-102.pdf (57.25 Ko) Télécharger le fichier
Loading...

Dates et versions

inria-00107585 , version 1 (19-10-2006)

Identifiants

  • HAL Id : inria-00107585 , version 1

Citer

Imed Zitouni, Jean-François Mari, Kamel Smaïli, Jean-Paul Haton. Variable-Length Sequence Language Model for Large Vocabulary Continuous Dictation Machine. 6th European Conference on Speech Communication and Technology - EUROSPEECH'99, 1999, Budapest, Hungary. ⟨inria-00107585⟩
246 Consultations
306 Téléchargements

Partager

Gmail Facebook X LinkedIn More