Scene Segmentation with CRFs Learned from Partially Labeled Images - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2008

Scene Segmentation with CRFs Learned from Partially Labeled Images

Jakob Verbeek
William Triggs


Conditional Random Fields (CRFs) are an effective tool for a variety of different data segmentation and labeling tasks including visual scene interpretation, which seeks to partition images into their constituent semantic-level regions and assign appropriate class labels to each region. For accurate labeling it is important to capture the global context of the image as well as local information. We introduce a CRF based scene labeling model that incorporates both local features and features aggregated over the whole image or large sections of it. Secondly, traditional CRF learning requires fully labeled datasets which can be costly and troublesome to produce. We introduce a method for learning CRFs from datasets with many unlabeled nodes by marginalizing out the unknown labels so that the log-likelihood of the known ones can be maximized by gradient ascent. Loopy Belief Propagation is used to approximate the marginals needed for the gradient and log-likelihood calculations and the Bethe free-energy approximation to the log-likelihood is monitored to control the step size. Our experimental results show that effective models can be learned from fragmentary labelings and that incorporating top-down aggregate features significantly improves the segmentations. The resulting segmentations are compared to the state-of-the-art on three different image datasets.
Fichier principal
Vignette du fichier
verbeek08nips.pdf (1.25 Mo) Télécharger le fichier
Vignette du fichier
VT08.png (62.82 Ko) Télécharger le fichier
VT08.poster.pdf (1.3 Mo) Télécharger le fichier
VT08.slides.pdf (1.01 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
Format : Figure, Image
Format : Other
Format : Other

Dates and versions

inria-00321051 , version 1 (25-01-2011)
inria-00321051 , version 2 (11-04-2011)


  • HAL Id : inria-00321051 , version 2


Jakob Verbeek, William Triggs. Scene Segmentation with CRFs Learned from Partially Labeled Images. NIPS 2007 - Advances in Neural Information Processing Systems, Dec 2007, Vancouver, Canada. pp.1553-1560. ⟨inria-00321051v2⟩
666 View
713 Download


Gmail Facebook X LinkedIn More