Restart strategies enabling automatic differentiation for hyperparameter tuning in inverse problems - Archive ouverte HAL Accéder directement au contenu
Proceedings/Recueil Des Communications Année : 2024

Restart strategies enabling automatic differentiation for hyperparameter tuning in inverse problems

Leo Davy
  • Fonction : Auteur
  • PersonId : 1369124
Nelly Pustelnik
Patrice Abry

Résumé

Numerous signal/image processing tasks can be formulated as variational problems, whose solutions depend, often crucially, on the values of hyperparameters. Their automated selection usually involves the computation of gradients of a well chosen loss function, which often turns unfeasible analytically. The deep-learning inspired use of automatic differentiation to compute such gradients, though appealing, is significantly impaired by the usually large number of iterations inherently attached to functional minimization in variational problems. The present work proposes and assesses the use of a restart strategy for automated hyperparameter tuning, combining the benefits of automatic differentiation with properties of proximal iterative algorithms. It studies theoretically its conditions of applicability in a generic algorithmic framework and its specification to accelerated Chambolle-Pock iterations when dealing with strongly convex objective function. The effectiveness is illustrated for image denoising and texture segmentation problems.
Fichier principal
Vignette du fichier
davy_pustelnik_abry_restart_eusipco24.pdf (4.33 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-04525520 , version 1 (28-03-2024)

Licence

Identifiants

  • HAL Id : hal-04525520 , version 1

Citer

Leo Davy, Nelly Pustelnik, Patrice Abry. Restart strategies enabling automatic differentiation for hyperparameter tuning in inverse problems. European Signal Processing Conference, 2024. ⟨hal-04525520⟩
26 Consultations
45 Téléchargements

Partager

Gmail Mastodon Facebook X LinkedIn More