Federated Learning with Packet Losses - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2023

Federated Learning with Packet Losses

Abstract

This paper tackles the problem of training Federated Learning (FL) algorithms over real-world wireless networks with packet losses. Lossy communication channels between the orchestrating server and the clients affect the convergence of FL training as well as the quality of the learned model. Although many previous works investigated how to mitigate the adverse effects of packet losses, this paper demonstrates that FL algorithms over asymmetric lossy channels can still learn the optimal model, the same model that would have been trained in a lossless scenario by classic FL algorithms like FedAvg. Convergence to the optimum only requires slight changes to FedAvg: i) while FedAvg computes a new global model by averaging the received clients' models, our algorithm, UPGA-PL, updates the global model by a pseudo-gradient step; ii) UPGA-PL accounts for the potentially heterogeneous packet losses experienced by the clients to unbias the pseudo-gradient step. Still, UPGA-PL maintains the same computational and communication complexity as FedAvg. In our experiments, UPGA-PL not only outperforms existing stateof-the-art solutions for lossy channels (by more than 5 percentage points on test accuracy) but also matches FedAvg's performance in lossless scenarios after less than 150 communication rounds.
Fichier principal
Vignette du fichier
wpmc.pdf (347.4 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-04364289 , version 1 (26-12-2023)

Identifiers

Cite

Angelo Rodio, Giovanni Neglia, Fabio Busacca, Stefano Mangione, Sergio Palazzo, et al.. Federated Learning with Packet Losses. WPMC 2023 - 26th International Symposium on Wireless Personal Multimedia Communications, Nov 2023, Tampa, United States. pp.1-6, ⟨10.1109/WPMC59531.2023.10338845⟩. ⟨hal-04364289⟩
61 View
58 Download

Altmetric

Share

Gmail Facebook X LinkedIn More