Maximin Action Identification: A New Bandit Framework for Games - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2016

Maximin Action Identification: A New Bandit Framework for Games

Résumé

We study an original problem of pure exploration in a strategic bandit model motivated by Monte Carlo Tree Search. It consists in identifying the best action in a game, when the player may sample random outcomes of sequentially chosen pairs of actions. We propose two strategies for the fixed-confidence setting: Maximin-LUCB, based on lower-and upper-confidence bounds; and Maximin-Racing, which operates by successively eliminating the sub-optimal actions. We discuss the sample complexity of both methods and compare their performance empirically. We sketch a lower bound analysis, and possible connections to an optimal algorithm.
Fichier principal
Vignette du fichier
colt.pdf (242.58 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-01273842 , version 1 (14-02-2016)
hal-01273842 , version 2 (21-11-2016)

Identifiants

Citer

Aurélien Garivier, Emilie Kaufmann, Wouter M. Koolen. Maximin Action Identification: A New Bandit Framework for Games. 2016. ⟨hal-01273842v1⟩
1668 Consultations
182 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More