A nonsmooth Frank–Wolfe algorithm through a dual cutting-plane approach - Archive ouverte HAL
Pré-Publication, Document De Travail Année : 2024

A nonsmooth Frank–Wolfe algorithm through a dual cutting-plane approach

Résumé

An extension of the Frank–Wolfe Algorithm (FWA), also known as Conditional Gradient algorithm, is proposed. In its standard form, the FWA allows to solve constrained optimization problems involving $\beta$-smooth cost functions, calling at each iteration a Linear Minimization Oracle. More specifically, the oracle solves a problem obtained by linearization of the original cost function. The algorithm designed and investigated in this article, named Dualized Level-Set (DLS) algorithm, extends the FWA and allows to address a class of nonsmooth costs, involving in particular support functions. The key idea behind the construction of the DLS method is a general interpretation of the FWA as a cutting-plane algorithm, from the dual point of view. The DLS algorithm essentially results from a dualization of a specific cutting-plane algorithm, based on projections on some level sets. The DLS algorithm generates a sequence of primal-dual candidates, and we prove that the corresponding primal-dual gap converges with a rate of $O(1/\sqrt{t})$.
Fichier principal
Vignette du fichier
extension.pdf (979.2 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04543088 , version 1 (11-04-2024)

Identifiants

Citer

Guilherme Mazanti, Thibault Moquet, Laurent Pfeiffer. A nonsmooth Frank–Wolfe algorithm through a dual cutting-plane approach. 2024. ⟨hal-04543088⟩
154 Consultations
108 Téléchargements

Altmetric

Partager

More