A Riemannian low-rank method for optimization over semidefinite matrices with block-diagonal constraints - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2015

A Riemannian low-rank method for optimization over semidefinite matrices with block-diagonal constraints

Résumé

We propose a new algorithm to solve optimization problems of the form min f (X) for a smooth function f under the constraints that X is positive semidefinite and the diagonal blocks of X are small identity matrices. Such problems often arise as the result of relaxing a rank constraint (lifting). In particular, many estimation tasks involving phases, rotations, orthonormal bases or permutations fit in this framework, and so do certain relaxations of combinatorial problems such as Max-Cut. The proposed algorithm exploits the facts that (1) such formulations admit low-rank solutions, and (2) their rank-restricted versions are smooth optimization problems on a Riemannian manifold. Combining insights from both the Riemannian and the convex geometries of the problem, we characterize when second-order critical points of the smooth problem reveal KKT points of the semidefinite problem. We compare against state of the art, mature software and find that, on certain interesting problem instances, what we call the staircase method is orders of magnitude faster, is more accurate and scales better. Code is available.
Fichier principal
Vignette du fichier
1506.00575v1.pdf (954.03 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01213337 , version 1 (08-10-2015)

Identifiants

  • HAL Id : hal-01213337 , version 1

Citer

Nicolas Boumal. A Riemannian low-rank method for optimization over semidefinite matrices with block-diagonal constraints. 2015. ⟨hal-01213337⟩
150 Consultations
721 Téléchargements

Partager

Gmail Facebook X LinkedIn More