Large Margin Multi-category Discriminant Models and Scale-sensitive Psi-dimensions - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Reports (Research Report) Year : 2004

Large Margin Multi-category Discriminant Models and Scale-sensitive Psi-dimensions

Yann Guermeur
  • Function : Author
  • PersonId : 830806


In the context of discriminant analysis, Vapnik's statistical learning theory has mainly been developed in three directions: the computation of dichotomies with binary-valued functions, the computation of dichotomies with real-valued functions, and the computation of polychotomies with functions taking their values in finite sets. The case of classes of vector-valued functions used to compute polychotomies has seldom been considered independently, which is unsatisfactory, for three main reasons. First, this case encompasses the other ones, second, it cannot be treated appropriately through a naïve extension of the results devoted to the computation of dichotomies, third, it represents the situation most commonly met in practice. In this report, a new uniform convergence bound for large margin multi-class discriminant models is derived, which extends in a straightforward way a famous theorem by Bartlett. The capacity measure involved in this bound is a covering number. To bound from above this measure, original scale-sensitive extensions of the psi-dimensions are introduced. The covering numbers of interest can be bounded in terms of these dimensions thanks to generalizations of Sauer's lemma, as is illustrated in the specific case of the scale-sensitive Natarajan dimension. A bound on this latter dimension is then computed for the architecture of the multi-class SVMs.
Fichier principal
Vignette du fichier
RR-5314.pdf (463.42 Ko) Télécharger le fichier

Dates and versions

inria-00070686 , version 1 (19-05-2006)
inria-00070686 , version 2 (20-09-2006)


  • HAL Id : inria-00070686 , version 2


Yann Guermeur. Large Margin Multi-category Discriminant Models and Scale-sensitive Psi-dimensions. [Research Report] RR-5314, INRIA. 2004, pp.49. ⟨inria-00070686v2⟩
217 View
7708 Download


Gmail Facebook Twitter LinkedIn More