Sub-sampling for Multi-armed Bandits - Archive ouverte HAL Access content directly
Journal Articles Proceedings of the European Conference on Machine Learning Year : 2014

Sub-sampling for Multi-armed Bandits


The stochastic multi-armed bandit problem is a popular model of the exploration/exploitation trade-off in sequential decision problems. We introduce a novel algorithm that is based on sub-sampling. Despite its simplicity, we show that the algorithm demonstrates excellent empirical performances against state-of-the-art algorithms, including Thompson sampling and KL-UCB. The algorithm is very flexible, it does need to know a set of reward distributions in advance nor the range of the rewards. It is not restricted to Bernoulli distributions and is also invariant under rescaling of the rewards. We provide a detailed experimental study comparing the algorithm to the state of the art, the main intuition that explains the striking results, and conclude with a finite-time regret analysis for this algorithm in the simplified two-arm bandit setting.
Fichier principal
Vignette du fichier
BESA2_corrected.pdf (900.46 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01025651 , version 1 (18-07-2014)
hal-01025651 , version 2 (16-12-2014)


  • HAL Id : hal-01025651 , version 2


Akram Baransi, Odalric-Ambrym Maillard, Shie Mannor. Sub-sampling for Multi-armed Bandits. Proceedings of the European Conference on Machine Learning, 2014, pp.13. ⟨hal-01025651v2⟩


370 View
2606 Download


Gmail Facebook X LinkedIn More