Federated Learning with Packet Losses - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Federated Learning with Packet Losses

Résumé

This paper tackles the problem of training Federated Learning (FL) algorithms over real-world wireless networks with packet losses. Lossy communication channels between the orchestrating server and the clients affect the convergence of FL training as well as the quality of the learned model. Although many previous works investigated how to mitigate the adverse effects of packet losses, this paper demonstrates that FL algorithms over asymmetric lossy channels can still learn the optimal model, the same model that would have been trained in a lossless scenario by classic FL algorithms like FedAvg. Convergence to the optimum only requires slight changes to FedAvg: i) while FedAvg computes a new global model by averaging the received clients' models, our algorithm, UPGA-PL, updates the global model by a pseudo-gradient step; ii) UPGA-PL accounts for the potentially heterogeneous packet losses experienced by the clients to unbias the pseudo-gradient step. Still, UPGA-PL maintains the same computational and communication complexity as FedAvg. In our experiments, UPGA-PL not only outperforms existing stateof-the-art solutions for lossy channels (by more than 5 percentage points on test accuracy) but also matches FedAvg's performance in lossless scenarios after less than 150 communication rounds.
Fichier principal
Vignette du fichier
wpmc.pdf (347.4 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04364289 , version 1 (26-12-2023)

Identifiants

Citer

Angelo Rodio, Giovanni Neglia, Fabio Busacca, Stefano Mangione, Sergio Palazzo, et al.. Federated Learning with Packet Losses. WPMC 2023 - 26th International Symposium on Wireless Personal Multimedia Communications, Nov 2023, Tampa, United States. pp.1-6, ⟨10.1109/WPMC59531.2023.10338845⟩. ⟨hal-04364289⟩
57 Consultations
35 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More