Multi-armed bandit for stratified sampling: Application to numerical integration - Archive ouverte HAL
Communication Dans Un Congrès Année : 2018

Multi-armed bandit for stratified sampling: Application to numerical integration

Résumé

Contextual multi-armed bandits model decision problems, where the properties of the possible decisions are initially partially known, but may become better known as time passes. Such models have numerous applications and many algorithms have been proposed to provide approximate solutions. In this paper, we propose an algorithm for computing mul-tidimensional integration problems. Such problems are very common and can be solved using the Monte-Carlo method with the stratified sampling technique. This method consists in partitioning the integration domain then randomly sampling the partitions. Our algorithm considers the selection of the best partition to sample as a multi-armed bandit problem, which can be solved using the Upper Confidence Bound technique. We have experimented this approach for several integration problems and observed faster convergence rates.
Fichier principal
Vignette du fichier
lepretre57.pdf (531.64 Ko) Télécharger le fichier
taai2017_pres.pdf (7.67 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01660617 , version 1 (11-12-2017)

Identifiants

Citer

Florian Leprêtre, Fabien Teytaud, Julien Dehos. Multi-armed bandit for stratified sampling: Application to numerical integration. TAAI 2017 - Conference on Technologies and Applications of Artificial Intelligence, Dec 2017, Taipei, Taiwan. pp.190-195, ⟨10.1109/TAAI.2017.34⟩. ⟨hal-01660617⟩
252 Consultations
549 Téléchargements

Altmetric

Partager

More