Hardware-Aware Quantization for Multiplierless Neural Network Controllers - Archive ouverte HAL Access content directly
Conference Papers Year : 2022

Hardware-Aware Quantization for Multiplierless Neural Network Controllers

Abstract

Deep neural networks (DNNs) have been successfully applied to the approximation of non-linear control systems. These DNNs, deployed in safety-critical embedded systems, are relatively small but require a high throughput. Our goal is to perform a coefficient quantization to reduce the arithmetic complexity while maintaining an inference with high numerical accuracy. The key idea is to target multiplierless parallel architectures, where constant multiplications are replaced by bit-shifts and additions. We propose an adder-aware training that finds the quantized fixed-point coefficients minimizing the number of adders and thus improving the area, latency and power. With this approach, we demonstrate that an automatic cruise control floating-point DNN can be retrained to have only power-of-two coefficients, while maintaining a similar mean squared error (MSE) and formally satisfying a safety check. We provide a pushbutton training and implementation framework, automatically generating the VHDL code.
Fichier principal
Vignette du fichier
NNControllers.pdf (306.71 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03908463 , version 1 (20-12-2022)

Identifiers

Cite

Tobias Habermann, Jonas Kühle, Martin Kumm, Anastasia Volkova. Hardware-Aware Quantization for Multiplierless Neural Network Controllers. The IEEE Asia Pacific Conference on Circuits and Systems (APCCAS), Nov 2022, Shenzhen, China. ⟨10.1109/APCCAS55924.2022.10090271⟩. ⟨hal-03908463⟩
132 View
169 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More