Riemannian trust-region methods for strict saddle functions with complexity guarantees - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2024

Riemannian trust-region methods for strict saddle functions with complexity guarantees

Résumé

For a function with strict saddle points, we show that the classical trust-region algorithm with exact subproblem minimization finds approximate (local) minimizers in polynomial-time. The accuracy parameter $\varepsilon$ only appears in a $\log\log(\varepsilon^{-1})$ term. In that sense, the complexity is essentially independent of the accuracy $\varepsilon$: using a second-order model allows to benefit from the quadratic convergence rate of Newton's method near minimizers. This is a notable improvement over known results for generic nonconvex functions, where the worst-case number of iterations is of the order $\mathcal{O}(\varepsilon^{-3})$. Our complexity bound depends polynomially on landscape parameters which represent negative curvature and strong convexity constants. In the context where these landscape parameters are known, we present a strict saddle trust-region method with similar complexity guarantees which minimizes the trust-region subproblem approximately. It is based on a truncated conjugate gradient scheme and uses the Lanczos method to compute directions of negative curvature. The complexity result gives an upper bound on the total number of gradient evaluations and Hessian-vector products. All our results apply to the setting where the function is defined on a Riemannian manifold, and Riemannian algorithms are used
Fichier principal
Vignette du fichier
RTR-strict-saddle.pdf (471.05 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04397931 , version 1 (18-01-2024)
hal-04397931 , version 2 (13-02-2024)

Identifiants

Citer

Florentin Goyens, Clément W. Royer. Riemannian trust-region methods for strict saddle functions with complexity guarantees. 2024. ⟨hal-04397931v2⟩
112 Consultations
53 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More