Scheduling Algorithms for Federated Learning with Minimal Energy Consumption - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Parallel and Distributed Systems Année : 2023

Scheduling Algorithms for Federated Learning with Minimal Energy Consumption

Laércio Lima Pilla

Résumé

Federated Learning (FL) has opened the opportunity for collaboratively training machine learning models on heterogeneous mobile or Edge devices while keeping local data private. With an increase in its adoption, a growing concern is related to its economic and environmental cost (as is also the case for other machine learning techniques). Unfortunately, little work has been done to optimize its energy consumption or emissions of carbon dioxide or equivalents, as energy minimization is usually left as a secondary objective. In this paper, we investigate the problem of minimizing the energy consumption of FL training on heterogeneous devices by controlling the workload distribution. We model this as the Minimal Cost FL Schedule problem, a total cost minimization problem with identical, independent, and atomic tasks that have to be assigned to heterogeneous resources with arbitrary cost functions. We propose a pseudo-polynomial optimal solution to the problem based on the previously unexplored Multiple-Choice Minimum-Cost Maximal Knapsack Packing Problem. We also provide four algorithms for scenarios where cost functions are monotonically increasing and follow the same behavior. These solutions are likewise applicable on the minimization of other kinds of costs, and in other one-dimensional data partition problems.
Fichier principal
Vignette du fichier
energy-fl-2023.pdf (1.5 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03775491 , version 1 (12-09-2022)
hal-03775491 , version 2 (03-02-2023)

Identifiants

Citer

Laércio Lima Pilla. Scheduling Algorithms for Federated Learning with Minimal Energy Consumption. IEEE Transactions on Parallel and Distributed Systems, In press, ⟨10.1109/TPDS.2023.3240833⟩. ⟨hal-03775491v2⟩

Collections

CNRS INRIA INRIA2
102 Consultations
189 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More