Statistical Performance Metrics for Use with Imprecise Ground-Truth - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2017

Statistical Performance Metrics for Use with Imprecise Ground-Truth

Résumé

This paper addresses performance evaluation in the presence of imprecise ground-truth. Indeed, the most common assumption when performing benchmarking measures is that the reference data is awless. In previous work, we have shown that this assumption cannot be taken for granted, and that, in the case of perceptual interpretation problems it is most certainly always wrong but for the most trivial cases. We are presenting a statistical test that will allow measuring the con-dence one can have in the results of a benchmarking test ranking multiple algorithms. More specically, we can express the probability of the ranking not being respected in the presence of a given level of errors in the ground truth data.
Fichier principal
Vignette du fichier
9657_35.pdf (293.71 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01401034 , version 1 (22-11-2016)

Licence

Identifiants

Citer

Bart Lamiroy, Pascal Pierrot. Statistical Performance Metrics for Use with Imprecise Ground-Truth. Graphics Recognition. Current Trends and Challenges: 11th International Workshop on Graphics Recognition, GREC 2015, Aug 2015, Nancy, France. ⟨10.1007/978-3-319-52159-6_3⟩. ⟨hal-01401034⟩
259 Consultations
198 Téléchargements

Altmetric

Partager

More