An End-to-End Evaluation of Two Situated Dialog Systems. - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2012

An End-to-End Evaluation of Two Situated Dialog Systems.

Résumé

We present and evaluate two state-of-the art dialogue systems developed to support dialog with French speaking virtual characters in the context of a serious game: one hybrid statistical/symbolic and one purely statistical. We conducted a quantitative evaluation where we compare the accuracy of the interpreter and of the dialog manager used by each system; a user based evaluation based on 22 subjects using both the statistical and the hybrid system; and a corpus based evaluation where we examine such criteria as dialog coherence, dialog success, interpretation and generation errors in the corpus of Human-System interactions collected during the user-based evaluation. We show that although the statistical approach is slightly more robust, the hybrid strategy seems to be better at guiding the player through the game.
Fichier principal
Vignette du fichier
emospeech_sigdial.pdf (139.25 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00726723 , version 1 (31-08-2012)

Identifiants

  • HAL Id : hal-00726723 , version 1

Citer

Lina Maria Rojas Barahona, Alejandra Lorenzo, Claire Gardent. An End-to-End Evaluation of Two Situated Dialog Systems.. Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Association for Computational Linguistics, Jul 2012, Seoul, North Korea. pp.10-19. ⟨hal-00726723⟩
480 Consultations
228 Téléchargements

Partager

More