The Energy and Carbon Footprint of Training End-to-End Speech Recognizers - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2021

The Energy and Carbon Footprint of Training End-to-End Speech Recognizers

Mirco Ravanelli
  • Fonction : Auteur

Résumé

Deep learning contributes to reaching higher levels of artificial intelligence. Due to its pervasive adoption, however, growing concerns on the environmental impact of this technology have been raised. In particular, the energy consumed at training and inference time by modern neural networks is far from being negligible and will increase even further due to the deployment of ever larger models. This work investigates for the first time the carbon cost of end-to-end automatic speech recognition (ASR). First, it quantifies the amount of CO2 emitted while training state-of-the-art (SOTA) ASR systems on a university-scale cluster. Then, it shows that a tiny performance improvement comes at an extremely high carbon cost. For instance, the conducted experiments reveal that a SOTA Transformer emits 50% of its total training released CO2 solely to achieve a final decrease of 0.3 of the word error rate. With this study, we hope to raise awareness on this crucial topic and we provide guidelines, insights, and estimates enabling researchers to better assess the environmental impact of training speech technologies.
Fichier principal
Vignette du fichier
INTERSPEECH___E2E_ASR_Carbon_Footprint-15.pdf (435.79 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03190119 , version 1 (06-04-2021)

Identifiants

  • HAL Id : hal-03190119 , version 1

Citer

Titouan Parcollet, Mirco Ravanelli. The Energy and Carbon Footprint of Training End-to-End Speech Recognizers. 2021. ⟨hal-03190119⟩

Collections

UNIV-AVIGNON LIA
558 Consultations
1598 Téléchargements

Partager

Gmail Facebook X LinkedIn More