Communication Dans Un Congrès Année : 2026

Unified Privacy Guarantees for Decentralized Learning via Matrix Factorization

Résumé

Decentralized Learning (DL) enables users to collaboratively train models without sharing raw data by iteratively averaging local updates with neighbors in a network graph. This setting is increasingly popular for its scalability and its ability to keep data local under user control. Strong privacy guarantees in DL are typically achieved through Differential Privacy (DP), with results showing that DL can even amplify privacy by disseminating noise across peer-to-peer communications. Yet in practice, the observed privacy-utility trade-off often appears worse than in centralized training, which may be due to limitations in current DP accounting methods for DL. In this paper, we show that recent advances in centralized DP accounting based on Matrix Factorization (MF) for analyzing temporal noise correlations can also be leveraged in DL. By generalizing existing MF results, we show how to cast both standard DL algorithms and common trust models into a unified formulation. This yields tighter privacy accounting for existing DP-DL algorithms and provides a principled way to develop new ones. To demonstrate the approach, we introduce MAFALDA-SGD, a gossip-based DL algorithm with user-level correlated noise that outperforms existing methods on synthetic and real-world graphs.

Fichier principal
Vignette du fichier
MAFALDA-camera-ready.pdf (613.22 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-05462250 , version 1 (16-01-2026)
hal-05462250 , version 2 (02-03-2026)

Licence

Identifiants

Citer

Aurélien Bellet, Edwige Cyffers, Davide Frey, Romaric Gaudel, Dimitri Lerévérend, et al.. Unified Privacy Guarantees for Decentralized Learning via Matrix Factorization. ICLR 2026 - The Fourteenth International Conference on Learning Representations, Apr 2026, Rio De Janeiro, Brazil. ⟨hal-05462250v2⟩
453 Consultations
202 Téléchargements

Altmetric

Partager

  • More