Scheduling Machine Learning Compressible Inference Tasks with Limited Energy Budget - Archive ouverte HAL
Communication Dans Un Congrès Année : 2024

Scheduling Machine Learning Compressible Inference Tasks with Limited Energy Budget

Résumé

Advancements in cloud computing have boosted Machine Learning as a Service (MLaaS), highlighting the challenge of scheduling tasks under latency and deadline constraints. Neural network compression offers the latency and energy consumption reduction in data centers, aligning with efforts to minimize cloud computing's carbon footprint, despite some accuracy loss.

This paper investigates the Deadline Scheduling with Compressible Tasks -Energy Aware (DSCT-EA) problem, which addresses the scheduling of compressible machine learning tasks on several machines, with different speeds and energy efficiencies, under an energy budget constraint. Solving DSCT-EA involves determining both the machine on which each task will be processed and its processing time, a problem that has been proven to be NP-Hard. We formulate DSCT-EA as a Mixed-Integer Programming (MIP) problem and also provide an approximation algorithm for solving it. The efficacy of our approach is demonstrated through extensive experimentation, revealing its superiority over traditional scheduling techniques. It allows to save up to 70% of the energy budget of image classification tasks, while only losing 2% of accuracy compared to when not using compression.

Fichier principal
Vignette du fichier
icpp24-68 (3).pdf (895.79 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04676376 , version 1 (23-08-2024)

Identifiants

Citer

Tiago da Silva Barros, Davide Ferre, Frederic Giroire, Ramon Aparicio-Pardo, Stephane Perennes. Scheduling Machine Learning Compressible Inference Tasks with Limited Energy Budget. ICPP 2024 - 53rd International Conference on Parallel Processing, Aug 2024, Gotland, Sweden. pp.961 - 970, ⟨10.1145/3673038.3673106⟩. ⟨hal-04676376⟩
68 Consultations
42 Téléchargements

Altmetric

Partager

More