An indicator for the switch from derivative-free to derivative-based optimization. - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Operations Research Letters Année : 2017

An indicator for the switch from derivative-free to derivative-based optimization.

Résumé

In some optimization problems found in applications, the derivatives of the objective function can be computed or approximated but at an expensive cost, and it is desirable to know when to use derivative-free methods (such as direct search, for instance) or derivative-based methods (such as gradient or quasi-Newton methods). Derivative-free methods may achieve a steady initial progress for some problems, but after some advance they may also become slower or even stagnate due to the lack of derivatives. It is thus of interest to provide a way to appropriately switch from a derivative-free method to a derivative-based one. In this paper, we develop a family of indicators for such a switch based on the decrease properties of both classes of methods (typically used when deriving worst case complexity bounds).
Fichier principal
Vignette du fichier
gratton_22361.pdf (695.96 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03512073 , version 1 (05-01-2022)

Identifiants

Citer

Serge Gratton, Nacer Soualmi, Luis Vicente. An indicator for the switch from derivative-free to derivative-based optimization.. Operations Research Letters, 2017, 45 (4), pp.353-361. ⟨10.1016/j.orl.2017.05.003⟩. ⟨hal-03512073⟩
12 Consultations
13 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More