Hardware-Aware Quantization for Multiplierless Neural Network Controllers - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

Hardware-Aware Quantization for Multiplierless Neural Network Controllers

Résumé

Deep neural networks (DNNs) have been successfully applied to the approximation of non-linear control systems. These DNNs, deployed in safety-critical embedded systems, are relatively small but require a high throughput. Our goal is to perform a coefficient quantization to reduce the arithmetic complexity while maintaining an inference with high numerical accuracy. The key idea is to target multiplierless parallel architectures, where constant multiplications are replaced by bit-shifts and additions. We propose an adder-aware training that finds the quantized fixed-point coefficients minimizing the number of adders and thus improving the area, latency and power. With this approach, we demonstrate that an automatic cruise control floating-point DNN can be retrained to have only power-of-two coefficients, while maintaining a similar mean squared error (MSE) and formally satisfying a safety check. We provide a pushbutton training and implementation framework, automatically generating the VHDL code.
Fichier principal
Vignette du fichier
NNControllers.pdf (306.71 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03908463 , version 1 (20-12-2022)

Identifiants

  • HAL Id : hal-03908463 , version 1

Citer

Tobias Habermann, Jonas Kühle, Martin Kumm, Anastasia Volkova. Hardware-Aware Quantization for Multiplierless Neural Network Controllers. The IEEE Asia Pacific Conference on Circuits and Systems (APCCAS), Nov 2022, Shenzhen, China. ⟨hal-03908463⟩
110 Consultations
117 Téléchargements

Partager

Gmail Facebook X LinkedIn More