A Chaining Algorithm for Online Nonparametric Regression - Archive ouverte HAL Access content directly
Conference Papers Year : 2015

A Chaining Algorithm for Online Nonparametric Regression

Abstract

We consider the problem of online nonparametric regression with arbitrary deterministic sequences. Using ideas from the chaining technique, we design an algorithm that achieves a Dudley-type regret bound similar to the one obtained in a non-constructive fashion by Rakhlin and Sridharan (2014). Our regret bound is expressed in terms of the metric entropy in the sup norm, which yields optimal guarantees when the metric and sequential entropies are of the same order of magnitude. In particular our algorithm is the first one that achieves optimal rates for online regression over Hölder balls. In addition we show for this example how to adapt our chaining algorithm to get a reasonable computational efficiency with similar regret guarantees (up to a log factor).
Fichier principal
Vignette du fichier
GaillardGerchinovitz15.pdf (437 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01120813 , version 1 (26-02-2015)
hal-01120813 , version 2 (01-07-2015)

Identifiers

Cite

Pierre Gaillard, Sébastien Gerchinovitz. A Chaining Algorithm for Online Nonparametric Regression. COLT 2015, Jul 2015, Paris, France. pp.764-796. ⟨hal-01120813v2⟩
296 View
104 Download

Altmetric

Share

Gmail Facebook X LinkedIn More