Improving the Energy Efficiency of CNN Inference on FPGA using Partial Reconfiguration - Archive ouverte HAL
Communication Dans Un Congrès Année : 2024

Improving the Energy Efficiency of CNN Inference on FPGA using Partial Reconfiguration

Résumé

With the increasing demand for edge AI application scenarios, as the most popular deep learning models, Convolutional Neural Networks (CNNs) need advanced solutions for the deployment of highly energy-efficient implementations. This paper presents a novel approach to improve the efficiency of CNN inference on Field-Programmable Gate Arrays (FPGAs) using Partial Reconfiguration (PR). Our method deconstructs CNN topology into different layers for runtime reconfiguration with fewer resources, aiming to significantly reduce static power and overall energy consumption. To identify the conditions for practical PR efficiency, we present a thorough design space exploration study with three CNN benchmarks, each evaluated across three different implementations. The comparison results demonstrate that our PR approach can achieve up to 3.88 and 1.67 times energy savings compared to software and static hardware implementations, respectively. These results also show that the benefits of PR improve with the depth of the network, suggesting very promising levels of gains as the network gets larger and under the key conditions of using fast optimized reconfiguration controllers and methodical system-level exploration of the increased hardware implementation complexity.

Fichier principal
Vignette du fichier
Improving_the_Energy_Efficiency_of_CNN_Inference_on_FPGA_using_Partial_Reconfiguration.pdf (262.3 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04699445 , version 1 (16-09-2024)

Identifiants

  • HAL Id : hal-04699445 , version 1

Citer

Zhuoer Li, Sébastien Bilavarn. Improving the Energy Efficiency of CNN Inference on FPGA using Partial Reconfiguration. DASIP 2024, Jan 2024, Munich, Germany. ⟨hal-04699445⟩
2 Consultations
3 Téléchargements

Partager

More