Asymptotic stabilization of inertial gradient dynamics with time-dependent viscosity
Résumé
In a Hilbert space $\mathcal H$, we study the asymptotic behaviour, as time variable $t$ goes to $+\infty$, of nonautonomous gradient-like inertial dynamics, with a time-dependent viscosity coefficient. Given $\Phi: \mathcal H \rightarrow \mathbb R$ a convex differentiable function, $\gamma (\cdot)$ a time-dependent positive damping term, we consider the second-order differential equation $$\ddot{x}(t) + \gamma (t) \dot{x}(t) + \nabla \Phi (x(t)) = 0. $$ This system plays a central role in mechanics and physics in the asymptotic stabilization of nonlinear oscillators. Its importance in optimization was recently put to the fore by Su, Boyd, and Candès. They have shown that in the particular case $\gamma(t) = \frac{3}{t}$, this is a continuous version of the fast gradient method initiated by Nesterov, with $\Phi(x(t))-\min_{\mathcal H} \Phi = \mathcal O (\frac{1}{t^2})$ as $t\to +\infty$ in the worst case. Recently, in the case $\gamma(t) = \frac{\alpha}{t}$ with $\alpha >3$, Attouch and Peypouquet have improved this result by showing the convergence of the trajectories to optimal solutions, and $\Phi(x(t))-\min_{\mathcal H} \Phi = o (\frac{1}{t^2})$ as $t\to +\infty$. For these questions, and the design of fast optimization methods, the tuning of the damping parameter $\gamma(t)$ is a subtle question, which we deal with in this paper in general. We obtain convergence rates for the values, and convergence results of the trajectories under general conditions on $\gamma(\cdot)$ which unify, and often improve the results already present in the literature. We complement these results by showing that they are robust with respect to perturbations.