SAMBA: A Generic Framework for Secure Federated Multi-Armed Bandits - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue Journal of Artificial Intelligence Research Année : 2022

SAMBA: A Generic Framework for Secure Federated Multi-Armed Bandits

Résumé

The multi-armed bandit is a reinforcement learning model where a learning agent repeatedly chooses an action (pull a bandit arm) and the environment responds with a stochastic outcome (reward) coming from an unknown distribution associated with the chosen arm. Bandits have a wide-range of application such as Web recommendation systems. We address the cumulative reward maximization problem in a secure federated learning setting, where multiple data owners keep their data stored locally and collaborate under the coordination of a central orchestration server. We rely on cryptographic schemes and propose SAMBA, a generic framework for Secure federAted Multi-armed BAndits. Each data owner has data associated to a bandit arm and the bandit algorithm has to sequentially select which data owner is solicited at each time step. We instantiate SAMBA for five bandit algorithms. We show that SAMBA returns the same cumulative reward as the non-secure versions of bandit algorithms, while satisfying formally proven security properties. We also show that the overhead due to cryptographic primitives is linear in the size of the input, which is confirmed by our proof-of-concept implementation.https://www.jair.org/index.php/jair/article/view/13163

Dates et versions

hal-03553894 , version 1 (03-02-2022)

Identifiants

Citer

Radu Ciucanu, Pascal Lafourcade, Gael Marcadet, Marta Soare. SAMBA: A Generic Framework for Secure Federated Multi-Armed Bandits. Journal of Artificial Intelligence Research, 2022, 73, pp.737--765. ⟨10.1613/jair.1.13163⟩. ⟨hal-03553894⟩
190 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More