Tree-structured CRF Models for Interactive Image Labeling - Inria - Institut national de recherche en sciences et technologies du numérique
Journal Articles IEEE Transactions on Pattern Analysis and Machine Intelligence Year : 2013

Tree-structured CRF Models for Interactive Image Labeling

Abstract

We propose structured prediction models for image labeling that explicitly take into account dependencies among image labels. In our tree structured models, image labels are nodes, and edges encode dependency relations. To allow for more complex dependencies, we combine labels in a single node, and use mixtures of trees. Our models are more expressive than independent predictors, and lead to more accurate label predictions. The gain becomes more significant in an interactive scenario where a user provides the value of some of the image labels at test time. Such an interactive scenario offers an interesting trade-off between label accuracy and manual labeling effort. The structured models are used to decide which labels should be set by the user, and transfer the user input to more accurate predictions on other image labels. We also apply our models to attribute-based image classification, where attribute predictions of a test image are mapped to class probabilities by means of a given attribute-class mapping. Experimental results on three publicly available benchmark data sets show that in all scenarios our structured models lead to more accurate predictions, and leverage user input much more effectively than state-of-the-art independent models.
Fichier principal
Vignette du fichier
MVC2012pami.pdf (473.63 Ko) Télécharger le fichier
Vignette du fichier
pami.teaser.png (80.46 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Format Figure, Image
Loading...

Dates and versions

hal-00688143 , version 1 (16-04-2012)

Identifiers

Cite

Thomas Mensink, Jakob Verbeek, Gabriela Csurka. Tree-structured CRF Models for Interactive Image Labeling. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35 (2), pp.476-489. ⟨10.1109/TPAMI.2012.100⟩. ⟨hal-00688143⟩
421 View
870 Download

Altmetric

Share

More