Towards Good Practice in Large-Scale Learning for Image Classification - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2012

Towards Good Practice in Large-Scale Learning for Image Classification

Abstract

We propose a benchmark of several objective functions for large-scale image classification: we compare the one- vs-rest, multiclass, ranking and weighted average ranking SVMs. Using stochastic gradient descent optimization, we can scale the learning to millions of images and thousands of classes. Our experimental evaluation shows that ranking based algorithms do not outperform a one-vs-rest strategy and that the gap between the different algorithms reduces in case of high-dimensional data. We also show that for one-vs-rest, learning through cross-validation the optimal degree of imbalance between the positive and the negative samples can have a significant impact. Furthermore, early stopping can be used as an effective regularization strategy when training with stochastic gradient algorithms. Follow- ing these "good practices", we were able to improve the state-of-the-art on a large subset of 10K classes and 9M of images of ImageNet from 16.7% accuracy to 19.1%.
Fichier principal
Vignette du fichier
cvpr2012.pdf (362.03 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-00690014 , version 1 (20-04-2012)

Identifiers

Cite

Florent Perronnin, Zeynep Akata, Zaid Harchaoui, Cordelia Schmid. Towards Good Practice in Large-Scale Learning for Image Classification. CVPR 2012 - IEEE Computer Vision and Pattern Recognition, Jun 2012, Providence (RI), United States. pp.3482-3489, ⟨10.1109/CVPR.2012.6248090⟩. ⟨hal-00690014⟩
1961 View
3269 Download

Altmetric

Share

Gmail Facebook X LinkedIn More