Fast Rates for Structured Prediction - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2021

Fast Rates for Structured Prediction

Vivien Cabannes
  • Function : Author
  • PersonId : 1089863
Francis Bach

Abstract

Discrete supervised learning problems such as classification are often tackled by introducing a continuous surrogate problem akin to regression. Bounding the original error, between estimate and solution, by the surrogate error endows discrete problems with convergence rates already shown for continuous instances. Yet, current approaches do not leverage the fact that discrete problems are essentially predicting a discrete output when continuous problems are predicting a continuous value. In this paper, we tackle this issue for general structured prediction problems, opening the way to "super fast" rates, that is, convergence rates for the excess risk faster than n −1 , where n is the number of observations, with even exponential rates with the strongest assumptions. We first illustrate it for predictors based on nearest neighbors, generalizing rates known for binary classification to any discrete problem within the framework of structured prediction. We then consider kernel ridge regression where we improve known rates in n −1/4 to arbitrarily fast rates, depending on a parameter characterizing the hardness of the problem, thus allowing, under smoothness assumptions, to bypass the curse of dimensionality.
Fichier principal
Vignette du fichier
2102.00760.pdf (505.96 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03384304 , version 1 (23-10-2021)

Identifiers

  • HAL Id : hal-03384304 , version 1

Cite

Vivien Cabannes, Francis Bach, Alessandro Rudi. Fast Rates for Structured Prediction. COLT 2021 - 34th Annual Conference on Learning Theory, Aug 2021, Boulder, Colorado, United States. ⟨hal-03384304⟩
24 View
32 Download

Share

Gmail Mastodon Facebook X LinkedIn More