On Riemannian and non-Riemannian Optimisation, and Optimisation Geometry - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IFAC-PapersOnLine Année : 2021

On Riemannian and non-Riemannian Optimisation, and Optimisation Geometry

Résumé

Optimisation algorithms such as the Newton method were first generalised to manifolds by generalising the components of the algorithm directly: gradients were replaced by Riemannian gradients, straight lines were replaced by geodesics, and so forth. This meant having to endow the manifold with a Riemannian metric. Traditionally then, attention focused on the geometry of the underlying manifold. However, we argue the geometry of the manifold is not the right geometry to focus on because it does not take the cost function into consideration. For online optimisation problems requiring the minimisation of many different cost functions, of most relevance is the geometry of the family of cost functions as a whole: if the cost functions fit together in a "nice" way, fast optimisation algorithms can be developed even if individual cost functions are difficult to optimise. In particular, non-convex problems are not necessarily difficult problems. This paper presents a Riemannian-based homotopy algorithm for solving such Optimisation Geometry problems and briefly explains how it can be generalised to a non-Riemannian (e.g., coordinate-adapted) algorithm.
Fichier principal
Vignette du fichier
1-s2.0-S2405896321005954-main.pdf (903.26 Ko) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-03376397 , version 1 (13-10-2021)

Identifiants

Citer

Jeanne Lefevre, Florent Bouchard, Salem Said, Nicolas Le Bihan, Jonathan H Manton. On Riemannian and non-Riemannian Optimisation, and Optimisation Geometry. IFAC-PapersOnLine, 2021, 54 (9), pp.578-583. ⟨10.1016/j.ifacol.2021.06.119⟩. ⟨hal-03376397⟩
33 Consultations
63 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More