Techniques for accelerating Branch-and-Bound algorithms dedicated to sparse optimization - Archive ouverte HAL Access content directly
Preprints, Working Papers, ... Year :

Techniques for accelerating Branch-and-Bound algorithms dedicated to sparse optimization

(1) , (1) , (2, 3)
1
2
3

Abstract

Sparse optimization-fitting data with a low-cardinality linear model-is addressed through the minimization of a cardinality-penalized least-squares function, for which dedicated branch-and-bound algorithms clearly outperform generic mixed-integerprogramming solvers. Three acceleration techniques are proposed for such algorithms. Convex relaxation problems at each node are addressed with dual approaches, which can early prune suboptimal nodes. Screening methods are implemented, which fix variables to their optimal value during the node evaluation, reducing the subproblem size. Numerical experiments show that the efficiency of such techniques depends on the node cardinality and on the structure of the problem matrix. Last, different exploration strategies are proposed to schedule the nodes. Best-first search is shown to outperform the standard depth-first search used in the related literature. A new strategy is proposed which first explores the nodes with the lowest least-squares value, which is shown to be the best at finding the optimal solution-without proving its optimality. A C++ solver with compiling and usage instructions is made available.
Fichier principal
Vignette du fichier
preprint_Samain_Bourguigon_Ninin_TechniquesAccelBbSparse.pdf (1020.25 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03661177 , version 1 (06-05-2022)

Identifiers

  • HAL Id : hal-03661177 , version 1

Cite

Gwenaël Samain, Sébastien Bourguignon, Jordan Ninin. Techniques for accelerating Branch-and-Bound algorithms dedicated to sparse optimization. 2022. ⟨hal-03661177⟩
38 View
51 Download

Share

Gmail Facebook Twitter LinkedIn More