Homotopy based algorithms for L0-regularized least-squares - Archive ouverte HAL Access content directly
Journal Articles IEEE Transactions on Signal Processing Year : 2015

Homotopy based algorithms for L0-regularized least-squares


Sparse signal restoration is usually formulated as the minimization of a quadratic cost function ||y-Ax||_2^2, where A is a dictionary and x is an unknown sparse vector. It is well-known that imposing an L0 constraint leads to an NP-hard minimization problem. The convex relaxation approach has received considerable attention, where the L0-norm is replaced by the L1-norm. Among the many efficient L1 solvers, the homotopy algorithm minimizes ||y-Ax||_2^2+lambda ||x||_1 with respect to x for a continuum of lambda's. It is inspired by the piecewise regularity of the L1-regularization path, also referred to as the homotopy path. In this paper, we address the minimization problem ||y-Ax||_2^2+lambda ||x||_0 for a continuum of lambda's and propose two heuristic search algorithms for L0-homotopy. Continuation Single Best Replacement is a forward-backward greedy strategy extending the Single Best Replacement algorithm, previously proposed for L0-minimization at a given lambda. The adaptive search of the lambda-values is inspired by L1-homotopy. L0 Regularization Path Descent is a more complex algorithm exploiting the structural properties of the L0-regularization path, which is piecewise constant with respect to lambda. Both algorithms are empirically evaluated for difficult inverse problems involving ill-conditioned dictionaries. Finally, we show that they can be easily coupled with usual methods of model order selection.
Fichier principal
Vignette du fichier
csbr (1).pdf (657.92 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-00948313 , version 1 (18-02-2014)
hal-00948313 , version 2 (27-10-2014)
hal-00948313 , version 3 (18-03-2015)



Charles Soussen, Jérome Idier, Junbo Duan, David Brie. Homotopy based algorithms for L0-regularized least-squares. IEEE Transactions on Signal Processing, 2015, 63 (13), pp.3301-3316. ⟨10.1109/TSP.2015.2421476⟩. ⟨hal-00948313v3⟩
577 View
1184 Download



Gmail Facebook Twitter LinkedIn More