Communication Dans Un Congrès Année : 2023

Compressing Neural Networks with Two-Layer Decoupling

Résumé

The single-layer decoupling problem has recently been used for the compression of neural networks. However, methods that are based on the single-layer decoupling problem only allow the compression of a neural network to a single flexible layer. As a result, compressing more complex networks leads to worse approximations of the original network due to only having one flexible layer. Having the ability to compress to more than one flexible layer thus allows to better approximate the underlying network compared to compression into only a single flexible layer. Performing compression into more than one flexible layer corresponds to solving a multi-layer decoupling problem. As a first step towards general multi-layer decoupling, this work introduces a method for solving the two-layer decoupling problem in the approximate case. This method enables the compression of neural networks into two flexible layers.

Fichier principal
Vignette du fichier
conference_101719.pdf (1.31 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-05008394 , version 1 (27-03-2025)

Licence

Identifiants

Citer

Joppe de Jonghe, Konstantin Usevich, Philippe Dreesen, Mariya Ishteva. Compressing Neural Networks with Two-Layer Decoupling. 2023 IEEE 9th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP), Dec 2023, Los Sueños, Costa Rica. pp.226-230, ⟨10.1109/CAMSAP58249.2023.10403509⟩. ⟨hal-05008394⟩
100 Consultations
127 Téléchargements

Altmetric

Partager

  • More