ERROR ESTIMATES BETWEEN SGD WITH MOMENTUM AND UNDERDAMPED LANGEVIN DIFFUSION
Résumé
Stochastic gradient descent with momentum is a popular variant of stochastic gradient descent, which has recently been reported to have a close relationship with the underdamped Langevin diffusion. In this paper, we establish a quantitative error estimate between them in the 1-Wasserstein and total variation distances.
| Origine | Fichiers produits par l'(les) auteur(s) |
|---|