Stochastic Proximal Gradient Algorithms for Penalized Mixed Models - Archive ouverte HAL
Article Dans Une Revue Statistics and Computing Année : 2019

Stochastic Proximal Gradient Algorithms for Penalized Mixed Models

Edouard Ollier
Adeline Samson

Résumé

Motivated by penalized likelihood maximization in complex models, we study optimization problems where neither the function to optimize nor its gradient have an explicit expression, but its gradient can be approximated by a Monte Carlo technique. We propose a new algorithm based on a stochastic approximation of the Proximal-Gradient (PG) algorithm. This new algorithm, named Stochastic Approximation PG (SAPG) is the combination of a stochastic gradient descent step which-roughly speaking-computes a smoothed approximation of the past gradient along the iterations, and a proximal step. The choice of the step size and the Monte Carlo batch size for the stochastic gradient descent step in SAPG are discussed. Our convergence results cover the cases of biased and unbiased Monte Carlo approximations. While the convergence analysis of the Monte Carlo-PG is already addressed in the literature (see Atchadé et al. [2016]), the convergence analysis of SAPG is new. The two algorithms are compared on a linear mixed effect model as a toy example. A more challenging application is proposed on non-linear mixed effect models in high dimension with a pharmacokinetic data set including genomic covariates. To our best knowledge, our work provides the first convergence result of a numerical method designed to solve penalized Maximum Likelihood in a non-linear mixed effect model.
Fichier principal
Vignette du fichier
1704.08891.pdf (1.9 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01526281 , version 1 (22-05-2017)

Identifiants

Citer

Gersende Fort, Edouard Ollier, Adeline Samson. Stochastic Proximal Gradient Algorithms for Penalized Mixed Models. Statistics and Computing, 2019, 29 (2), pp.231-253. ⟨10.1007/s11222-018-9805-7⟩. ⟨hal-01526281⟩
456 Consultations
191 Téléchargements

Altmetric

Partager

More