The degrees of freedom of the Group Lasso for a General Design - Archive ouverte HAL
Pré-Publication, Document De Travail Année : 2012

The degrees of freedom of the Group Lasso for a General Design

Résumé

In this paper, we are concerned with regression problems where covariates can be grouped in nonoverlapping blocks, and where only a few of them are assumed to be active. In such a situation, the group Lasso is an at- tractive method for variable selection since it promotes sparsity of the groups. We study the sensitivity of any group Lasso solution to the observations and provide its precise local parameterization. When the noise is Gaussian, this allows us to derive an unbiased estimator of the degrees of freedom of the group Lasso. This result holds true for any fixed design, no matter whether it is under- or overdetermined. With these results at hand, various model selec- tion criteria, such as the Stein Unbiased Risk Estimator (SURE), are readily available which can provide an objectively guided choice of the optimal group Lasso fit.
Fichier principal
Vignette du fichier
l1l2-variations-dof.pdf (145.23 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-00768896 , version 1 (26-12-2012)
hal-00768896 , version 2 (27-12-2012)

Identifiants

  • HAL Id : hal-00768896 , version 1

Citer

Samuel Vaiter, Charles Deledalle, Gabriel Peyré, Jalal M. Fadili, Charles H Dossal. The degrees of freedom of the Group Lasso for a General Design. 2012. ⟨hal-00768896v1⟩
460 Consultations
353 Téléchargements

Partager

More