Relationship between the optimal solutions of least squares regularized with L0 -norm and constrained by k-sparsity - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Applied and Computational Harmonic Analysis Année : 2016

Relationship between the optimal solutions of least squares regularized with L0 -norm and constrained by k-sparsity

Résumé

Two widely used models to find a sparse solution from a noisy underdetermined linear system are the constrained problem where the quadratic error is minimized subject to a sparsity constraint, and the regularized problem where a regularization parameter balances the minimization of both quadratic error and sparsity. However, the connections between these two problems have remained unclear so far. We provide an exhaustive description of the relationship between their globally optimal solutions. A partial equivalence between them always exists. We exhibit a sequence of critical parameters that partitions the positive axis into a certain number of intervals. For every regularization parameter inside an interval, there is a sparsity level such that the regularized problem and the constrained problem have the same global minimizers. At the values of the critical parameters, the optimal set of the regularized problem contains two optimal sets of the constrained problem. When the length of the sequence of critical parameters equals the number of all sparsity levels, both problems are quasi-completely equivalent. The critical parameters are obtained from the optimal values of the constrained problem.
Fichier principal
Vignette du fichier
KsparsLo_Nikolova.pdf (276.3 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00944006 , version 1 (10-02-2014)
hal-00944006 , version 2 (02-11-2014)
hal-00944006 , version 3 (06-11-2015)
hal-00944006 , version 4 (10-11-2015)
hal-00944006 , version 5 (27-08-2017)

Identifiants

Citer

Mila Nikolova. Relationship between the optimal solutions of least squares regularized with L0 -norm and constrained by k-sparsity. Applied and Computational Harmonic Analysis, 2016, Sparse Representations with Applications in Imaging Science, Data Analysis and Beyond, 41 (1), pp.237 - 265. ⟨10.1016/j.acha.2015.10.010⟩. ⟨hal-00944006v5⟩
373 Consultations
473 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More