Language modeling using dynamic Bayesian networks - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2004

Language modeling using dynamic Bayesian networks


In this paper we propose a new approach to language modeling based on dynamic Bayesian networks. The principle idea of our approach is to find the dependence relations between variables that represent different linguistic units (word, class, concept, ...) that constitutes a language model. In the context of this paper the linguistic units that we consider are syntactic classes and words. Our approach should not be considered as a model combination technique. Rather, it is an original and coherent methodology that processes words and classes in the same model. We attempt to identify and model the dependence of words and classes on their linguistic context. Our ultimate goal is to devise an automatic mechanism that extracts the best dependence relations between a word and its context, i.e., lexical and syntactic. Preliminary results are very encouraging, in particular the model in which a word depends not only on previous word but also on syntactic classes of two previous words. This model outperforms the bi-gram model.
Fichier principal
Vignette du fichier
A04-R-099.pdf (57.97 Ko) Télécharger le fichier

Dates and versions

inria-00107786 , version 1 (19-10-2006)


  • HAL Id : inria-00107786 , version 1


Murat Deviren, Khalid Daoudi, Kamel Smaïli. Language modeling using dynamic Bayesian networks. 4th International Conference on Language Resources and Evaluation - LREC 2004, 2004, Lisbonne, Portugal. ⟨inria-00107786⟩
131 View
279 Download


Gmail Facebook X LinkedIn More