Automated Design of Deep Neural Networks - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue ACM Computing Surveys Année : 2022

Automated Design of Deep Neural Networks

Résumé

In recent years, research in applying optimization approaches in the automatic design of deep neural networks has become increasingly popular. Although various approaches have been proposed, there is a lack of a comprehensive survey and taxonomy on this hot research topic. In this article, we propose a unified way to describe the various optimization algorithms that focus on common and important search components of optimization algorithms: representation, objective function, constraints, initial solution(s), and variation operators. In addition to large-scale search space, the problem is characterized by its variable mixed design space, it is very expensive, and it has multiple blackbox objective functions. Hence, this unified methodology has been extended to advanced optimization approaches, such as surrogate-based, multi-objective, and parallel optimization.
Fichier non déposé

Dates et versions

hal-03339896 , version 1 (09-09-2021)

Identifiants

Citer

El-Ghazali Talbi. Automated Design of Deep Neural Networks. ACM Computing Surveys, 2022, 54 (2), pp.1-37. ⟨10.1145/3439730⟩. ⟨hal-03339896⟩
74 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More