Model selection in density estimation via cross-validation - Archive ouverte HAL
Pré-Publication, Document De Travail Année : 2008

Model selection in density estimation via cross-validation

Alain Celisse

Résumé

The problem of model selection by cross-validation is addressed in the density estimation framework. Extensively used in practice, cross-validation (CV) remains poorly understood, especially in the non-asymptotic setting which is the main concern of this work. A recurrent problem with CV is the computation time it involves. This drawback is overcome here thanks to closed-form expressions for the CV estimator of the risk for a broad class of widespread estimators: projection estimators. In order to shed new lights on CV procedures with respect to the cardinality $p$ of the test set, the CV estimator is interpreted as a penalized criterion with a random penalty. For instance, the amount of penalization is shown to increase with $p$. A theoretical assessment of the CV performance is carried out thanks to two oracle inequalities applying to respectively bounded or square-integrable densities. For several collections of models, adaptivity results with respect to Hölder and Besov spaces are derived as well.
Fichier principal
Vignette du fichier
090407OraclePoly.pdf (424.97 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-00337058 , version 1 (05-11-2008)
hal-00337058 , version 2 (14-04-2009)
hal-00337058 , version 3 (30-03-2012)

Identifiants

Citer

Alain Celisse. Model selection in density estimation via cross-validation. 2008. ⟨hal-00337058v2⟩
308 Consultations
230 Téléchargements

Altmetric

Partager

More