Nonlinear Randomized Urn Models: a Stochastic Approximation Viewpoint - Archive ouverte HAL
Article Dans Une Revue Electronic Journal of Probability Année : 2019

Nonlinear Randomized Urn Models: a Stochastic Approximation Viewpoint

Résumé

This paper extends the link between stochastic approximation (SA) theory and randomized urn models developed in Laruelle, Pagès (2013), and their applications to clinical trials introduced in Bai, HU (1999,2005) and Bai, Hu, Shen (2002). We no longer assume that the drawing rule is uniform among the balls of the urn (which contains d colors), but can be reinforced by a function f. This is a way to model risk aversion. Firstly, by considering that f is concave or convex and by reformulating the dynamics of the urn composition as an SA algorithm with remainder, we derive the a.s. convergence and the asymptotic normality (Central Limit Theorem, CLT) of the normalized procedure by calling upon the so-called ODE and SDE methods. An in-depth analysis of the case d=2 exhibits two different behaviors: A single equilibrium point when f is concave, and when f is convex, a transition phase from a single attracting equilibrium to a system with two attracting and one repulsive equilibrium points. The last setting is solved using results on non-convergence toward noisy and noiseless ``traps" in order to deduce the a.s. convergence toward one of the attracting points. Secondly, the special case of a Polya urn (when the addition rule is the identity matrix) is analyzed, still using result from SA theory about ``traps''. Finally, these results are applied to a function with regular variation and to an optimal asset allocation in Finance.
Fichier principal
Vignette du fichier
NonLInearUrns3.pdf (628.96 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-00910902 , version 1 (28-11-2013)
hal-00910902 , version 2 (08-06-2015)
hal-00910902 , version 3 (11-05-2018)

Identifiants

Citer

Sophie Laruelle, Gilles Pagès. Nonlinear Randomized Urn Models: a Stochastic Approximation Viewpoint. Electronic Journal of Probability, 2019, 24 (none), pp.1-47. ⟨10.1214/19-EJP312⟩. ⟨hal-00910902v3⟩
361 Consultations
1201 Téléchargements

Altmetric

Partager

More