Still no free lunches: the price to pay for tighter PAC-Bayes bounds - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles Entropy Year : 2021

Still no free lunches: the price to pay for tighter PAC-Bayes bounds

Abstract

"No free lunch" results state the impossibility of obtaining meaningful bounds on the error of a learning algorithm without prior assumptions and modelling. Some models are expensive (strong assumptions, such as as subgaussian tails), others are cheap (simply finite variance). As it is well known, the more you pay, the more you get: in other words, the most expensive models yield the more interesting bounds. Recent advances in robust statistics have investigated procedures to obtain tight bounds while keeping the cost minimal. The present paper explores and exhibits what the limits are for obtaining tight PAC-Bayes bounds in a robust setting for cheap models, addressing the question: is PAC-Bayes good value for money?
Fichier principal
Vignette du fichier
1910.04460.pdf (319.76 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-02401286 , version 1 (09-12-2019)

Identifiers

Cite

Benjamin Guedj, Louis Pujol. Still no free lunches: the price to pay for tighter PAC-Bayes bounds. Entropy, 2021, ⟨10.3390/e23111529⟩. ⟨hal-02401286⟩
60 View
106 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More