Deep Model Compression and Architecture Optimization for Embedded Systems: A Survey - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Journal of Signal Processing Systems Année : 2020

Deep Model Compression and Architecture Optimization for Embedded Systems: A Survey

Anthony Berthelier
  • Fonction : Auteur
  • PersonId : 1079682
Thierry Chateau
Christophe Blanc

Résumé

Over the past, deep neural networks have proved to be an essential element for developing intelligent solutions. They have achieved remarkable performances at a cost of deeper layers and millions of parameters. Therefore utilising these networks on limited resource platforms for smart cameras is a challenging task. In this context, models need to be (i) accelerated and (ii) memory efficient without significantly compromising on performance. Numerous works have been done to obtain smaller, faster and accurate models. This paper presents a survey of methods suitable for porting deep neural networks on resource-limited devices, especially for smart cameras. These methods can be roughly divided in two main sections. In the first part, we present compression techniques. These techniques are categorized into: knowledge distillation, pruning, quantization, hashing, reduction of numerical precision and binarization. In the second part, we focus on architecture optimization. We introduce the methods to enhance networks structures as well as neural architecture search techniques. In each of their parts, we describe different methods, and analyse them. Finally, we conclude this paper with a discussion on these methods.
Fichier principal
Vignette du fichier
Compression_Survey_hal.pdf (933.72 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03048735 , version 1 (09-12-2020)

Identifiants

Citer

Anthony Berthelier, Thierry Chateau, Stefan Duffner, Christophe Garcia, Christophe Blanc. Deep Model Compression and Architecture Optimization for Embedded Systems: A Survey. Journal of Signal Processing Systems, 2020, ⟨10.1007/s11265-020-01596-1⟩. ⟨hal-03048735⟩
120 Consultations
1425 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More