Stable Bounds on the Duality Gap of Separable Nonconvex Optimization Problems - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Mathematics of Operations Research Année : 2022

Stable Bounds on the Duality Gap of Separable Nonconvex Optimization Problems

Résumé

The Shapley-Folkman theorem shows that Minkowski averages of uniformly bounded sets tend to be convex when the number of terms in the sum becomes much larger than the ambient dimension. In optimization, Aubin and Ekeland show that this produces an a priori bound on the duality gap of separable nonconvex optimization problems involving finite sums. This bound is highly conservative and depends on unstable quantities; we relax it in several directions to show that nonconvexity can have a much milder impact on finite sum minimization problems, such as empirical risk minimization and multitask classification. As a byproduct, we show a new version of Maurey’s classical approximate Carathéodory lemma where we sample a significant fraction of the coefficients, without replacement, as well as a result on sampling constraints using an approximate Helly theorem, both of independent interest.
Fichier non déposé

Dates et versions

hal-03837876 , version 1 (03-11-2022)

Identifiants

Citer

Thomas Kerdreux, Igor Colin, Alexandre d'Aspremont. Stable Bounds on the Duality Gap of Separable Nonconvex Optimization Problems. Mathematics of Operations Research, 2022, ⟨10.1287/moor.2022.1291⟩. ⟨hal-03837876⟩
41 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More