Word segmentation of Vietnamese texts: a comparison of approaches - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2008

Word segmentation of Vietnamese texts: a comparison of approaches


We present in this paper a comparison between three segmentation systems for the Vietnamese language. Indeed, the majority of Vietnamese words is built by semantic composition from about 7,000 syllables, that also have a meaning as isolated words. So the identification of word boundaries in a text is not a simple task, and ambiguities often appear. Beyond the presentation of the tested systems, we also propose a standard definition for word segmentation in Vietnamese, and introduce a reference corpus developed for the purpose of evaluating such a task. The results observed confirm that it can be relatively well treated by automatic means, although a solution needs to be found to take into account out-of-vocabulary words.
Fichier principal
Vignette du fichier
lrec2008final.pdf (85 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

inria-00334760 , version 1 (28-10-2008)


  • HAL Id : inria-00334760 , version 1


Quang Thang Dinh, Hong Phuong Le, Thi Minh Huyen Nguyen, Cam Tu Nguyen, Mathias Rossignol, et al.. Word segmentation of Vietnamese texts: a comparison of approaches. 6th international conference on Language Resources and Evaluation - LREC 2008, ELRA - European Language Resources Association, May 2008, Marrakech, Morocco. ⟨inria-00334760⟩
524 View
662 Download


Gmail Facebook Twitter LinkedIn More