Evaluating Relevant in Context: Document Retrieval with a Twist - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2007

Evaluating Relevant in Context: Document Retrieval with a Twist

Résumé

The Relevant in Context retrieval task is document or article retrieval with a twist, where not only the relevant articles should be retrieved but also the relevant information within each article (captured by a set of XML elements) should be correctly identified. Our main research question is: how to evaluate the Relevant in Context task? We propose a generalized average precision measure that meets two main requirements: i) the score reflects the ranked list of articles inherent in the result list, and at the same time ii) the score also reflects how well the retrieved information per article (i.e., the set of elements) corresponds to the relevant information. The resulting measure was used at INEX 2006.
Fichier principal
Vignette du fichier
sigir07aic.pdf (67.32 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

inria-00174140 , version 1 (21-09-2007)

Identifiants

  • HAL Id : inria-00174140 , version 1

Citer

Jaap Kamps, Mounia Lalmas, Jovan Pehcevski. Evaluating Relevant in Context: Document Retrieval with a Twist. 30th annual international ACM SIGIR conference on Research and development in information retrieval, Jul 2007, Amsterdam, Netherlands. ⟨inria-00174140⟩
78 Consultations
300 Téléchargements

Partager

Gmail Facebook X LinkedIn More