Efficient Automation of Neural Network Design: A Survey on Differentiable Neural Architecture Search - Archive ouverte HAL
Article Dans Une Revue ACM Computing Surveys Année : 2024

Efficient Automation of Neural Network Design: A Survey on Differentiable Neural Architecture Search

Résumé

In the past few years, Differentiable Neural Architecture Search (DNAS) rapidly imposed itself as the trending approach to automate the discovery of deep neural network architectures. This rise is mainly due to the popularity of DARTS, one of the first major DNAS methods. In contrast with previous works based on Reinforcement Learning or Evolutionary Algorithms, DNAS is faster by several orders of magnitude and uses fewer computational resources. In this comprehensive survey, we focus specifically on DNAS and review recent approaches in this field. Furthermore, we propose a novel challenge-based taxonomy to classify DNAS methods. We also discuss the contributions brought to DNAS in the past few years and its impact on the global NAS field. Finally, we conclude by giving some insights into future research directions for the DNAS field.

Dates et versions

hal-04104238 , version 1 (23-05-2023)

Licence

Identifiants

Citer

Alexandre Heuillet, Ahmad Nasser, Hichem Arioui, Hedi Tabia. Efficient Automation of Neural Network Design: A Survey on Differentiable Neural Architecture Search. ACM Computing Surveys, 2024, 56 (11), pp.270. ⟨10.1145/3665138⟩. ⟨hal-04104238⟩
136 Consultations
0 Téléchargements

Altmetric

Partager

More