Benchmarking for syntax-based sentential inference - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2010

Benchmarking for syntax-based sentential inference

Résumé

We propose a methodology for investigat- ing how well NLP systems handle mean- ing preserving syntactic variations. We start by presenting a method for the semi automated creation of a benchmark where entailment is mediated solely by meaning preserving syntactic variations. We then use this benchmark to compare a seman- tic role labeller and two grammar based RTE systems. We argue that the proposed methodology (i) supports a modular eval- uation of the ability of NLP systems to handle the syntax/semantic interface and (ii) permits focused error mining and er- ror analysis.
Fichier principal
Vignette du fichier
bedgar-acl10-coling10.pdf (84.86 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

inria-00536022 , version 1 (15-11-2010)

Identifiants

  • HAL Id : inria-00536022 , version 1

Citer

Paul Bedaride, Claire Gardent. Benchmarking for syntax-based sentential inference. The 23rd International Conference on Computational Linguistics - COLING 2010, Aug 2010, Beijing, China. ⟨inria-00536022⟩
111 Consultations
89 Téléchargements

Partager

Gmail Facebook X LinkedIn More