An End-to-End Evaluation of Two Situated Dialog Systems. - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2012

An End-to-End Evaluation of Two Situated Dialog Systems.


We present and evaluate two state-of-the art dialogue systems developed to support dialog with French speaking virtual characters in the context of a serious game: one hybrid statistical/symbolic and one purely statistical. We conducted a quantitative evaluation where we compare the accuracy of the interpreter and of the dialog manager used by each system; a user based evaluation based on 22 subjects using both the statistical and the hybrid system; and a corpus based evaluation where we examine such criteria as dialog coherence, dialog success, interpretation and generation errors in the corpus of Human-System interactions collected during the user-based evaluation. We show that although the statistical approach is slightly more robust, the hybrid strategy seems to be better at guiding the player through the game.
Fichier principal
Vignette du fichier
emospeech_sigdial.pdf (139.25 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-00726723 , version 1 (31-08-2012)


  • HAL Id : hal-00726723 , version 1


Lina Maria Rojas Barahona, Alejandra Lorenzo, Claire Gardent. An End-to-End Evaluation of Two Situated Dialog Systems.. Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Association for Computational Linguistics, Jul 2012, Seoul, North Korea. pp.10-19. ⟨hal-00726723⟩
464 View
218 Download


Gmail Mastodon Facebook X LinkedIn More