Stochastic Computing for Hardware Implementation of Binarized Neural Networks - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Access Année : 2019

Stochastic Computing for Hardware Implementation of Binarized Neural Networks

Résumé

Binarized Neural Networks, a recently discovered class of neural networks with minimal memory requirements and no reliance on multiplication, are a fantastic opportunity for the realization of compact and energy efficient inference hardware. However, such neural networks are generally not entirely binarized: their first layer remains with fixed point input. In this work, we propose a stochastic computing version of Binarized Neural Networks, where the input is also binarized. Simulations on the example of the Fashion-MNIST and CIFAR-10 datasets show that such networks can approach the performance of conventional Binarized Neural Networks. We evidence that the training procedure should be adapted for use with stochastic computing. Finally, the ASIC implementation of our scheme is investigated, in a system that closely associates logic and memory, implemented by Spin Torque Magnetoresistive Random Access Memory. This analysis shows that the stochastic computing approach can allow considerable savings with regards to conventional Binarized Neural networks in terms of area (62% area reduction on the Fashion-MNIST task). It can also allow important savings in terms of energy consumption, if we accept reasonable reduction of accuracy: for example a factor 2.1 can be saved, with the cost of 1.4% in Fashion-MNIST test accuracy. These results highlight the high potential of Binarized Neural Networks for hardware implementation, and that adapting them to hardware constrains can provide important benefits.
Fichier principal
Vignette du fichier
Hirtzlin, IEEE Access 2019, Stochastic Computing for Hardware Implementation of Binarized Neural Networks.pdf (3.19 Mo) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-02158846 , version 1 (08-03-2022)

Identifiants

Citer

Tifenn Hirtzlin, Bogdan Penkovsky, Marc Bocquet, Jacques-Olivier Klein, Jean-Michel Portal, et al.. Stochastic Computing for Hardware Implementation of Binarized Neural Networks. IEEE Access, 2019, pp.1-1. ⟨10.1109/ACCESS.2019.2921104⟩. ⟨hal-02158846⟩
94 Consultations
35 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More