Minconvnets: a New Class of Multiplication-Less Neural Networks - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

Minconvnets: a New Class of Multiplication-Less Neural Networks

Résumé

In this article, MinConvNets where the multiplications in the forward propagation path of CNNs are approximated by minimum comparator operations are introduced. Hardware complexity of minimum operator is of the order of O(N), whereas for multiplication it is O(N 2 ). Firstly, a methodology to find approximate operations based on statistical correlation is presented. We show that it is possible to replace multipliers by minimum operations in the forward propagation under certain constraints, i.e. given similar mean and variances of the feature and the weight vectors. A modified training method which guarantees the above constraints is proposed. And it is shown that equivalent precision can be achieved during inference with MinConvNets by using transfer learning from well trained exact CNNs.

Dates et versions

hal-04297354 , version 1 (21-11-2023)

Identifiants

Citer

Xuecan Yang, Sumanta Chaudhuri, Laurence Likforman-Sulem, Lirida Naviner. Minconvnets: a New Class of Multiplication-Less Neural Networks. 2022 IEEE International Conference on Image Processing (ICIP), Oct 2022, Bordeaux, France. pp.881-885, ⟨10.1109/ICIP46576.2022.9897286⟩. ⟨hal-04297354⟩
69 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More