Creating Efficient Codebooks for Visual Recognition - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2005

Creating Efficient Codebooks for Visual Recognition

Frédéric Jurie
Bill Triggs


Visual codebook based quantization of robust appearance descriptors extracted from local image patches is an effective means of capturing image statistics for texture analysis and scene classification. Codebooks are usually constructed by using a method such as k-means to cluster the descriptor vectors of patches sampled either densely ('textons') or sparsely ('bags of features' based on key-points or salience measures) from a set of training images. This works well for texture analysis in homogeneous images, but the images that arise in natural object recognition tasks have far less uniform statistics. We show that for dense sampling, k-means over-adapts to this, clustering centres almost exclusively around the densest few regions in descriptor space and thus failing to code other informative regions. This gives suboptimal codes that are no better than using randomly selected centres. We describe a scalable acceptance-radius based clusterer that generates better codebooks and study its performance on several image classification tasks. We also show that dense representations outperform equivalent keypoint based ones on these tasks and that SVM or mutual information based feature selection starting from a dense codebook further improves the performance.
Fichier principal
Vignette du fichier
05-jurie-triggs-iccv.pdf (678.03 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

inria-00548511 , version 1 (20-12-2010)



Frédéric Jurie, Bill Triggs. Creating Efficient Codebooks for Visual Recognition. 10th International Conference on Computer Vision (ICCV '05), Oct 2005, Beijing, China. pp.604 -- 610, ⟨10.1109/ICCV.2005.66⟩. ⟨inria-00548511⟩
341 View
785 Download



Gmail Facebook X LinkedIn More