PAC-Bayesian aggregation of linear estimators - Inria - Institut national de recherche en sciences et technologies du numérique
Pré-Publication, Document De Travail Année : 2014

PAC-Bayesian aggregation of linear estimators

Résumé

We consider the aggregation of linear estimator in regresison with a sub-Gaussian noise assumption. Aggregating estimators using exponential weights depending on their risk performs well in expectation, but sadly not in probability. A way to overcome this issue is considering exponential weights of a penalized risk. In this case, an oracle inequality can be obtained in probability, but is not sharp. Taking into account the estimated function's norm in the penalty offers a sharp inequality.
Fichier principal
Vignette du fichier
pacewa.pdf (235.43 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-01070805 , version 1 (02-10-2014)
hal-01070805 , version 2 (24-10-2016)
hal-01070805 , version 3 (30-01-2018)

Identifiants

Citer

Lucie Montuelle, Erwan Le Pennec. PAC-Bayesian aggregation of linear estimators. 2014. ⟨hal-01070805v1⟩

Collections

LM-ORSAY
649 Consultations
524 Téléchargements

Altmetric

Partager

More