Communication Dans Un Congrès Année : 2025

Modeling Energy Consumption in Deep Learning Architectures Using Power Laws

Résumé

Modern Deep Learning architectures such as LSTM, GRU, and Transformers achieve remarkable performance in various sequence processing tasks. Yet, their high computational cost and energy consumption have raised concerns about their environmental impact and the sustainability of Deep Learning. In this paper, we present an empirical study assessing the efficiency of training LSTM, GRU, and Transformer models on a GPU. By evaluating these models under various configurations, we characterize the relationship between energy consumption and pre-defined quantities such as hardware efficiency and the number of floating point operations (FLOPs) required for inference. We show that it is possible to derive scaling laws that make energy consumption predictable, given an architecture and a GPU model.

Fichier principal
Vignette du fichier
Ecai2025_paper0632_Mayaki_Cherpenay.pdf (1.11 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-04977474 , version 1 (05-03-2025)
hal-04977474 , version 2 (08-09-2025)

Licence

Identifiants

Citer

Mansour Zoubeirou a Mayaki, Victor Charpenay. Modeling Energy Consumption in Deep Learning Architectures Using Power Laws. 28th European Conference on Artificial Intelligence (ECAI-2025), Oct 2025, Bologne, Italy. ⟨10.3233/FAIA250900⟩. ⟨hal-04977474v2⟩
966 Consultations
1309 Téléchargements

Altmetric

Partager

  • More