Learning Overcomplete Dictionaries Based on Atom-by-Atom Updating - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Signal Processing Année : 2014

Learning Overcomplete Dictionaries Based on Atom-by-Atom Updating

Résumé

A dictionary learning algorithm learns a set of atoms from some training signals in such a way that each signal can be approximated as a linear combination of only a few atoms. Most dictionary learning algorithms use a two-stage iterative procedure. The first stage is to spars ely approximate the training signals over the current dictionary. The second stage is the update of the dictionary. In this paper we develop some atom-by-atom dictionary learning algorithms, which update the atoms sequentially. Specifically, we propose an efficient alternative to the well-known K-SVD algorithm, and show by various experiments that the proposed algorithm is much faster than K-SVD while its results are better. Moreover, we propose a novel algorithm that instead of alternating between the two dictionary learning stages, performs only the second stage. While in K-SVD each atom is updated along with the nonzero entries of its associated row vector in the coefficient matrix (which we name it its profile), in the new algorithm, each atom is updated along with the whole entries of its profile. As a result, contrary to K-SVD, the support of each profile can be changed while updating the dictionary. To further accelerate the convergence of this algorithm and to have a control on the cardinality of the representations, we then propose its two-stage counterpart by adding the sparse approximation stage. Experimental results on recovery of a known synthetic dictionary and dictionary learning for a class of auto-regressive signals demonstrate the promising performance of the proposed algorithms.
Fichier principal
Vignette du fichier
SadeghiBabaiezadehJutten_DicLearningAtomByAtomUpdating_IEEE_TSP_NonOfficialVersion.pdf (261.79 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00960222 , version 1 (20-03-2014)

Identifiants

Citer

Mostafa Sadeghi, Massoud Babaie-Zadeh, Christian Jutten. Learning Overcomplete Dictionaries Based on Atom-by-Atom Updating. IEEE Transactions on Signal Processing, 2014, 62 (4), pp.883-891. ⟨10.1109/TSP.2013.2295062⟩. ⟨hal-00960222⟩
327 Consultations
1283 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More