From Bernoulli-Gaussian deconvolution to sparse signal restoration - Archive ouverte HAL Access content directly
Journal Articles IEEE Transactions on Signal Processing Year : 2011

From Bernoulli-Gaussian deconvolution to sparse signal restoration

(1) , (2) , (1) , (1)


Formulated as a least square problem under an $\ell_0$ constraint, sparse signal restoration is a discrete optimization problem, known to be NP complete. Classical algorithms include, by increasing cost and efficiency, Matching Pursuit (MP), Orthogonal Matching Pursuit (OMP), Orthogonal Least Squares (OLS), stepwise regression algorithms and the exhaustive search. We revisit the Single Most Likely Replacement (SMLR) algorithm, developed in the mid-80's for Bernoulli-Gaussian signal restoration. We show that the formulation of sparse signal restoration as a limit case of Bernoulli-Gaussian signal restoration leads to an $\ell_0$-penalized least square minimization problem, to which SMLR can be straightforwardly adapted. The resulting algorithm, called Single Best Replacement (SBR), can be interpreted as a forward-backward extension of OLS sharing similarities with stepwise regression algorithms. Some structural properties of SBR are put forward. A fast and stable implementation is proposed. The approach is illustrated on two inverse problems involving highly correlated dictionaries. We show that SBR is very competitive with popular sparse algorithms in terms of trade-off between accuracy and computation time.
Fichier principal
Vignette du fichier
single.pdf (422.17 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-00443842 , version 1 (04-01-2010)
hal-00443842 , version 2 (28-01-2010)
hal-00443842 , version 3 (03-02-2010)
hal-00443842 , version 4 (17-06-2011)



Charles Soussen, Jérôme Idier, David Brie, Junbo Duan. From Bernoulli-Gaussian deconvolution to sparse signal restoration. IEEE Transactions on Signal Processing, 2011, 59 (10), pp.4572-4584. ⟨10.1109/TSP.2011.2160633⟩. ⟨hal-00443842v4⟩
514 View
1714 Download



Gmail Facebook Twitter LinkedIn More