Towards Robust and Bias-free Federated Learning - Archive ouverte HAL Access content directly
Conference Papers Year : 2023

Towards Robust and Bias-free Federated Learning

Abstract

Federated learning (FL) is an exciting machine learning approach where multiple devices collaboratively train a model without sharing their raw data. The FL system is vulnerable to the action of Byzantine clients sending arbitrary model updates, and the trained model may exhibit prediction bias towards specific groups. However, FL mechanisms tackling robustness and bias mitigation have contradicting objectives, motivating the question of building a FL system that comprehensively combines both objectives. In this paper, we first survey state-of-the-art approaches to robustness to Byzantine behavior and bias mitigation and analyze their respective objectives. Then, we conduct an empirical evaluation to illustrate the interplay between state-of-the-art FL robustness mechanisms and FL bias mitigation mechanisms. Specifically, we show that classical robust FL methods may inadvertently filter out benign FL clients that have statistically rare data, particularly for minority groups. Finally, we derive research directions for building more robust and bias-free FL systems.
Fichier principal
Vignette du fichier
document.pdf (700.92 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04102260 , version 1 (23-05-2023)

Identifiers

Cite

Ousmane Touat, Sara Bouchenak. Towards Robust and Bias-free Federated Learning. 3rd Workshop on Machine Learning and Systems (EuroMLSys '23), May 2023, Rome, Italy. pp.49-55, ⟨10.1145/3578356.3592576⟩. ⟨hal-04102260⟩
78 View
116 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More