ROI maximization in stochastic online decision-making - Archive ouverte HAL Accéder directement au contenu
Chapitre D'ouvrage Année : 2021

ROI maximization in stochastic online decision-making

Nicolo Cesa-Bianchi
  • Fonction : Auteur
Yishay Mansour
  • Fonction : Auteur
Vianney Perchet
  • Fonction : Auteur

Résumé

We introduce a novel theoretical framework for Return On Investment (ROI) maximization in repeated decision-making. Our setting is motivated by the use case of companies that regularly receive proposals for technological innovations and want to quickly decide whether they are worth implementing. We design an algorithm for learning ROI-maximizing decision-making policies over a sequence of innovation proposals. Our algorithm provably converges to an optimal policy in class Π at a rate of order min 1/(N∆2), N−1/3}, where N is the number of innovations and ∆ is the suboptimality gap in Π. A significant hurdle of our formulation, which sets it aside from other online learning problems such as bandits, is that running a policy does not provide an unbiased estimate of its performance.
Fichier non déposé

Dates et versions

hal-03880759 , version 1 (01-12-2022)

Identifiants

  • HAL Id : hal-03880759 , version 1

Citer

Nicolo Cesa-Bianchi, Cesari Tommaso, Yishay Mansour, Vianney Perchet. ROI maximization in stochastic online decision-making. Ranzato, M; Beygelzimer, A; Dauphin, Y; Liang, P.S; Wortman Vaughan, J. Advances in Neural Information Processing Systems (Online), 34, Neural Information Processing Systems Foundation., 2021, 9781713845393. ⟨hal-03880759⟩
16 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More