Homotopy based algorithms for L0-regularized least-squares - Archive ouverte HAL
Article Dans Une Revue IEEE Transactions on Signal Processing Année : 2015

Homotopy based algorithms for L0-regularized least-squares

Résumé

Sparse signal restoration is usually formulated as the minimization of a quadratic cost function ||y-Ax||_2^2, where A is a dictionary and x is an unknown sparse vector. It is well-known that imposing an L0 constraint leads to an NP-hard minimization problem. The convex relaxation approach has received considerable attention, where the L0-norm is replaced by the L1-norm. Among the many efficient L1 solvers, the homotopy algorithm minimizes ||y-Ax||_2^2+lambda ||x||_1 with respect to x for a continuum of lambda's. It is inspired by the piecewise regularity of the L1-regularization path, also referred to as the homotopy path. In this paper, we address the minimization problem ||y-Ax||_2^2+lambda ||x||_0 for a continuum of lambda's and propose two heuristic search algorithms for L0-homotopy. Continuation Single Best Replacement is a forward-backward greedy strategy extending the Single Best Replacement algorithm, previously proposed for L0-minimization at a given lambda. The adaptive search of the lambda-values is inspired by L1-homotopy. L0 Regularization Path Descent is a more complex algorithm exploiting the structural properties of the L0-regularization path, which is piecewise constant with respect to lambda. Both algorithms are empirically evaluated for difficult inverse problems involving ill-conditioned dictionaries. Finally, we show that they can be easily coupled with usual methods of model order selection.
Fichier principal
Vignette du fichier
csbr (1).pdf (657.92 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00948313 , version 1 (18-02-2014)
hal-00948313 , version 2 (27-10-2014)
hal-00948313 , version 3 (18-03-2015)

Identifiants

Citer

Charles Soussen, Jérome Idier, Junbo Duan, David Brie. Homotopy based algorithms for L0-regularized least-squares. IEEE Transactions on Signal Processing, 2015, 63 (13), pp.3301-3316. ⟨10.1109/TSP.2015.2421476⟩. ⟨hal-00948313v3⟩
670 Consultations
1378 Téléchargements

Altmetric

Partager

More