Mixability made efficient: Fast online multiclass logistic regression - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2021

Mixability made efficient: Fast online multiclass logistic regression

Abstract

Mixability has been shown to be a powerful tool to obtain algorithms with optimal regret. However, the resulting methods often suffer from high computational complexity which has reduced their practical applicability. For example, in the case of multiclass logistic regression, the aggregating forecaster (Foster et al. (2018)) achieves a regret of $O(\log(Bn))$ whereas Online Newton Step achieves $O(e^B\log(n))$ obtaining a double exponential gain in $B$ (a bound on the norm of comparative functions). However, this high statistical performance is at the price of a prohibitive computational complexity $O(n^{37})$.
Fichier principal
Vignette du fichier
MulticlassLogistic.pdf (2.45 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03370530 , version 1 (08-10-2021)

Identifiers

Cite

Rémi Jézéquel, Pierre Gaillard, Alessandro Rudi. Mixability made efficient: Fast online multiclass logistic regression. NeurIPS 2021. Thirty-fifth Conference on Neural Information Processing Systems, Dec 2021, Online, France. ⟨hal-03370530⟩
156 View
107 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More