Collaborative Exploration and Exploitation in massively Multi-Player Bandits - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Preprints, Working Papers, ... Year : 2021

Collaborative Exploration and Exploitation in massively Multi-Player Bandits


In this paper, we propose an approach to optimize the performance of Internet of Things (IoT) networks. We formulate the optimization problem as a massive multi-player multi-armed bandit problem, where the devices are the players and the radio channels are the arms, with collisions possibly preventing message reception. For handling a realistic IoT network, we do not assume that sensing information is available (i.e. that the collision are observed) or that the number of players is smaller than the number of arms. As the optimization problem is intractable, we propose two greedy policies: the first one focusing on the number of successful communications, while the second one also takes into account fairness between players. In order to implement an approximation of the targeted policies, we propose an explore-then-exploit approach, and establish a regret lower bound in Ω T 2/3 log T N + K 3/2. For estimating the mean reward of arms, we propose a decentralized exploration algorithm with controlled information exchanges between players. Then we state that the regret of the estimated target policy is optimal with respect to the time horizon T. Finally, we provide some experimental evidences that the proposed algorithms outperform several baselines.
Fichier principal
Vignette du fichier
collaborative_exploration_and_exploitation_in_MPMAB.pdf (1.35 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03370706 , version 1 (08-10-2021)


  • HAL Id : hal-03370706 , version 1


Hiba Dakdouk, Raphaël Féraud, Romain Laroche, Nadège Varsier, Patrick Maillé. Collaborative Exploration and Exploitation in massively Multi-Player Bandits. 2021. ⟨hal-03370706⟩
130 View
85 Download


Gmail Facebook X LinkedIn More