Evaluating Relevant in Context: Document Retrieval with a Twist - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2007

Evaluating Relevant in Context: Document Retrieval with a Twist

Abstract

The Relevant in Context retrieval task is document or article retrieval with a twist, where not only the relevant articles should be retrieved but also the relevant information within each article (captured by a set of XML elements) should be correctly identified. Our main research question is: how to evaluate the Relevant in Context task? We propose a generalized average precision measure that meets two main requirements: i) the score reflects the ranked list of articles inherent in the result list, and at the same time ii) the score also reflects how well the retrieved information per article (i.e., the set of elements) corresponds to the relevant information. The resulting measure was used at INEX 2006.
Fichier principal
Vignette du fichier
sigir07aic.pdf (67.32 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

inria-00174140 , version 1 (21-09-2007)

Identifiers

  • HAL Id : inria-00174140 , version 1

Cite

Jaap Kamps, Mounia Lalmas, Jovan Pehcevski. Evaluating Relevant in Context: Document Retrieval with a Twist. 30th annual international ACM SIGIR conference on Research and development in information retrieval, Jul 2007, Amsterdam, Netherlands. ⟨inria-00174140⟩
78 View
301 Download

Share

Gmail Facebook X LinkedIn More