FasterAI: a lightweight library for neural networks compression - Archive ouverte HAL
Article Dans Une Revue Electronics Année : 2022

FasterAI: a lightweight library for neural networks compression

Résumé

FasterAI is a PyTorch-based library, aiming to facilitate the use of deep neural network compression techniques, such as sparsification, pruning, knowledge distillation, or regularization. The library is built with the purpose of enabling quick implementation and experimentation. More particularly, compression techniques are leveraging callback systems of libraries, such as fastai and Pytorch Lightning to propose a user-friendly and high-level API. The main asset of FasterAI is its lightweight, yet powerful, simplicity of use. Indeed, because it has been developed in a very granular way, users can create thousands of unique experiments by using different combinations of parameters, with only a single line of additional code. This allows FasterAI to be suited for practical usage, as it contains the most common compression techniques available out-of-the-box, but also for research, as implementing a new compression technique usually boils down to writing a single line of code. In this paper, we propose an in-depth presentation of the different compression techniques available in FasterAI. As a proof of concept and to better grasp how the library is used, we present results achieved by applying each technique on a ResNet-18 architecture, trained on CALTECH-101.
Fichier principal
Vignette du fichier
electronics-11-03789.pdf (3.32 Mo) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-03930120 , version 1 (05-01-2024)

Identifiants

Citer

Nathan Hubens, Matei Mancas, Bernard Gosselin, Marius Preda, Titus Zaharia. FasterAI: a lightweight library for neural networks compression. Electronics, 2022, 11 (22), pp.3789. ⟨10.3390/electronics11223789⟩. ⟨hal-03930120⟩
47 Consultations
35 Téléchargements

Altmetric

Partager

More