Best-Arm Identification in Linear Bandits - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2014

Best-Arm Identification in Linear Bandits

Résumé

We study the best-arm identification problem in linear bandit, where the rewards of the arms depend linearly on an unknown parameter $\theta^*$ and the objective is to return the arm with the largest reward. We characterize the complexity of the problem and introduce sample allocation strategies that pull arms to identify the best arm with a fixed confidence, while minimizing the sample budget. In particular, we show the importance of exploiting the global linear structure to improve the estimate of the reward of near-optimal arms. We analyze the proposed strategies and compare their empirical performance. Finally, we point out the connection to the $G$-optimality criterion used in optimal experimental design.
Fichier principal
Vignette du fichier
best_linear_arm.pdf (269.24 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01075701 , version 1 (04-11-2014)

Identifiants

  • HAL Id : hal-01075701 , version 1

Citer

Marta Soare, Alessandro Lazaric, Rémi Munos. Best-Arm Identification in Linear Bandits. NIPS - Advances in Neural Information Processing Systems 27, Dec 2014, Montreal, Canada. ⟨hal-01075701⟩
299 Consultations
288 Téléchargements

Partager

More