Finite-Time Regret Minimization for Linear Quadratic Adaptive Controllers: an experiment design approach - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2023

Finite-Time Regret Minimization for Linear Quadratic Adaptive Controllers: an experiment design approach

Résumé

We tackle the problem of finite-time regret minimization in linear quadratic adaptive control. Regret minimization is a scientific field in both adaptive control and reinforcement learning research communities which studies the so-called trade-off between exploration and exploitation. Even though a large focus has been on linear quadratic adaptive control with theoretical finitetime bound guarantees on the expected regret growth rate, most of the proposed optimal exploration strategies do not take into account the scaling constant associated to the growth rate. Moreover, the exploration strategies are limited to white noise excitation. Using the tools from experiment design, we propose a computational tractable solution for the design of the external excitation chosen as a white noise filtered by a finite impulse response filter which is adapted on-line. The numerical example shows a reduced regret than available strategies in the literature.
Fichier principal
Vignette du fichier
Automatica_AF3E_submitted_version.pdf (1.05 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04360490 , version 1 (21-12-2023)

Identifiants

  • HAL Id : hal-04360490 , version 1

Citer

Kévin Colin, Håkan Hjalmarsson, Xavier Bombois. Finite-Time Regret Minimization for Linear Quadratic Adaptive Controllers: an experiment design approach. 2023. ⟨hal-04360490⟩
58 Consultations
42 Téléchargements

Partager

Gmail Facebook X LinkedIn More