Adaptive and Optimal Online Linear Regression on L1-balls - Archive ouverte HAL
Rapport Année : 2011

Adaptive and Optimal Online Linear Regression on L1-balls

Résumé

We consider the problem of online linear regression on individual sequences. The goal in this paper is for the forecaster to output sequential predictions which are, after T time rounds, almost as good as the ones output by the best linear predictor in a given L1-ball in R^d. We consider both the cases where the dimension d is small and large relative to the time horizon T. We first present regret bounds with optimal dependencies on the sizes U, X and Y of the L1-ball, the input data and the observations. The minimax regret is shown to exhibit a regime transition around the point d = sqrt(T) U X / (2 Y). Furthermore, we present efficient algorithms that are adaptive, i.e., they do not require the knowledge of U, X, and Y, but still achieve nearly optimal regret bounds.
Fichier principal
Vignette du fichier
l1.pdf (354.92 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-00594399 , version 1 (19-05-2011)
hal-00594399 , version 2 (23-05-2011)
hal-00594399 , version 3 (23-01-2012)
hal-00594399 , version 4 (14-01-2019)

Identifiants

Citer

Sébastien Gerchinovitz, Jia Yuan Yu. Adaptive and Optimal Online Linear Regression on L1-balls. 2011. ⟨hal-00594399v1⟩
455 Consultations
399 Téléchargements

Altmetric

Partager

More