Lower bounds and selectivity of weak-consistent policies in stochastic multi-armed bandit problem - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Journal of Machine Learning Research Année : 2013

Lower bounds and selectivity of weak-consistent policies in stochastic multi-armed bandit problem

Résumé

This paper is devoted to regret lower bounds in the classical model of stochastic multi-armed bandit. A well-known result of Lai and Robbins, which has then been extended by Burnetas and Katehakis, has established the presence of a logarithmic bound for all consistent policies. We relax the notion of consistency, and exhibit a generalisation of the bound. We also study the existence of logarithmic bounds in general and in the case of Hannan consistency. Moreover, we prove that it is impossible to design an adaptive policy that would select the best of two algorithms by taking advantage of the properties of the environment. To get these results, we study variants of popular Upper Confidence Bounds (UCB) policies. © 2013 Antoine Salomon, Jean-Yves Audibert and Issam El Alaoui.
Fichier non déposé

Dates et versions

hal-00947718 , version 1 (17-02-2014)

Identifiants

  • HAL Id : hal-00947718 , version 1

Citer

Antoine Salomon, Jean-Yves Audibert, Issam El Alaoui. Lower bounds and selectivity of weak-consistent policies in stochastic multi-armed bandit problem. Journal of Machine Learning Research, 2013, 14 (1), pp.187-207. ⟨hal-00947718⟩
97 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More