Mixture Martingales Revisited with Applications to Sequential Tests and Confidence Intervals - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2018

Mixture Martingales Revisited with Applications to Sequential Tests and Confidence Intervals

Emilie Kaufmann
Wouter M. Koolen
  • Fonction : Auteur
  • PersonId : 976655

Résumé

This paper presents new deviation inequalities that are valid uniformly in time under adaptive sampling in a multi-armed bandit model. The deviations are measured using the Kullback-Leibler divergence in a given one-dimensional exponential family, and may take into account several arms at a time. They are obtained by constructing for each arm a mixture martingale based on a hierarchical prior, and by multiplying those martingales. Our deviation inequalities allow us to analyze stopping rules based on generalized likelihood ratios for a large class of sequential identification problems, and to construct tight confidence intervals for some functions of the means of the arms.
Fichier principal
Vignette du fichier
KK18_JMLR.pdf (743.68 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-01886612 , version 1 (03-10-2018)
hal-01886612 , version 2 (27-11-2018)
hal-01886612 , version 3 (07-12-2021)

Identifiants

Citer

Emilie Kaufmann, Wouter M. Koolen. Mixture Martingales Revisited with Applications to Sequential Tests and Confidence Intervals. 2018. ⟨hal-01886612v2⟩

Collections

CRISTAL-SEQUEL
204 Consultations
592 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More