Non-Asymptotic Sequential Tests for Overlapping Hypotheses and application to near optimal arm identification in bandit models - Archive ouverte HAL Access content directly
Journal Articles Sequential Analysis Year : 2021

Non-Asymptotic Sequential Tests for Overlapping Hypotheses and application to near optimal arm identification in bandit models

Abstract

In this paper, we study sequential testing problems with overlapping hypotheses. We first focus on the simple problem of assessing if the mean µ of a Gaussian distribution is $≥ ε− or ≤ε; if µ ∈ (−ε,ε)$, both answers are considered to be correct. Then, we consider PAC-best arm identification in a bandit model: given K probability distributions on R with means $µ_1,. .. , µ_K$ , we derive the asymptotic complexity of identifying, with risk at most $δ$, an index $I ∈ {1,. .. , K}$ such that $µ_I ≥ max_i µ_i −ε$. We provide non asymptotic bounds on the error of a parallel General Likelihood Ratio Test, which can also be used for more general testing problems. We further propose lower bound on the number of observation needed to identify a correct hypothesis. Those lower bounds rely on information-theoretic arguments, and specifically on two versions of a change of measure lemma (a high-level form, and a low-level form) whose relative merits are discussed.
Fichier principal
Vignette du fichier
GK_SQA.pdf (331.76 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-02123833 , version 1 (09-05-2019)
hal-02123833 , version 2 (17-11-2021)

Identifiers

Cite

Aurélien Garivier, Emilie Kaufmann. Non-Asymptotic Sequential Tests for Overlapping Hypotheses and application to near optimal arm identification in bandit models. Sequential Analysis, 2021, 40 (1), pp.61-96. ⟨10.1080/07474946.2021.1847965⟩. ⟨hal-02123833v2⟩
161 View
206 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More