A Review on the Adaptive-Ridge Algorithm with several extensions - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2023

A Review on the Adaptive-Ridge Algorithm with several extensions

Rémy Abergel
Olivier Bouaziz

Résumé

The Adaptive Ridge Algorithm is an iterative algorithm designed for variable selection. It is also known under the denomination of Iteratively Reweighted Least-Squares Algorithm in the communities of Compressed Sensing and Sparse Signals Recovery. Besides, it can also be interpreted as an optimization algorithm dedicated to the minimization of possibly nonconvex q penalized energies (with 0 < q < 2). In the literature, this algorithm can be derived using various mathematical approaches, namely Half Quadratic Minimization, Majorization-Minimization, Alternating Minimization or Local Approximations. In this work, we will show how the Adaptive Ridge Algorithm can be simply derived and analyzed from a single equation, corresponding to a variational reformulation of the q penalty. We will describe in detail how the Adaptive Ridge Algorithm can be numerically implemented and we will perform a thorough experimental study of its parameters. We will also show how the variational formulation of the q penalty combined with modern duality principles can be used to design an interesting variant of the Adaptive Ridge Algorithm dedicated to the minimization of quadratic functions over (nonconvex) q balls.
Fichier sous embargo
Fichier sous embargo
0 4 21
Année Mois Jours
Avant la publication
jeudi 7 novembre 2024
Fichier sous embargo
jeudi 7 novembre 2024
Connectez-vous pour demander l'accès au fichier

Dates et versions

hal-04051929 , version 1 (30-03-2023)
hal-04051929 , version 2 (19-05-2024)

Identifiants

  • HAL Id : hal-04051929 , version 2

Citer

Rémy Abergel, Olivier Bouaziz, Grégory Nuel. A Review on the Adaptive-Ridge Algorithm with several extensions. 2024. ⟨hal-04051929v2⟩
48 Consultations
75 Téléchargements

Partager

Gmail Mastodon Facebook X LinkedIn More