Phrase-Based Language Model in Statistical Machine Translation - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles International Journal of Computational Linguistics and Applications Year : 2016

Phrase-Based Language Model in Statistical Machine Translation

Abstract

As one of the most important modules in statistical machine translation (SMT), language model measures whether one translation hypothesis is more grammatically correct than other hypotheses. Currently the state-of-the-art SMT systems use standard word n-gram models, whereas the translation model is phrase-based. In this paper, the idea is to use a phrase-based language model. For that, target portion of the translation table are retrieved and used to rewrite the training corpus and to calculate a phrase n-gram language model. In this work, we perform experiments with two language models word-based (WBLM) and phrase-based (PBLM). The different SMT are trained with three optimization algorithms MERT, MIRA and PRO. Thus, the PBLM systems are compared to the baseline system in terms of BLUE and TER. The experimental results show that the use of a phrase-based language model in SMT can improve results and is especially able to reduce the error rate.
Fichier principal
Vignette du fichier
CICLING2016.pdf (206.82 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01336485 , version 1 (23-06-2016)

Identifiers

  • HAL Id : hal-01336485 , version 1

Cite

Achraf Ben Romdhane, Salma Jamoussi, Abdelmajid Ben Hamadou, Kamel Smaïli. Phrase-Based Language Model in Statistical Machine Translation. International Journal of Computational Linguistics and Applications, 2016. ⟨hal-01336485⟩
219 View
102 Download

Share

Gmail Facebook X LinkedIn More