On a Phase Transition of Regret in Linear Quadratic Control: The Memoryless Case - Archive ouverte HAL Access content directly
Preprints, Working Papers, ... Year : 2020

On a Phase Transition of Regret in Linear Quadratic Control: The Memoryless Case

Abstract

We consider an idealized version of adaptive control of a MIMO system without state. We demonstrate how rank deficient Fisher information in this simple memoryless problem leads to the impossibility of logarithmic rates of regret. This to some extent resolves an open issue concerning the attainability of logarithmic regret rates in linear quadratic adaptive control. Our analysis rests on a version of the Cramér-Rao inequality that takes into account possible ill-conditioning of Fisher information and a pertubation result on the corresponding singular subspaces. This is used to define a sufficient condition, which we term uniformativeness, for regret to be at least order square root in the samples.
Fichier principal
Vignette du fichier
tracking_phase_transition_FI_rev.pdf (331.86 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-02546670 , version 1 (18-04-2020)
hal-02546670 , version 2 (13-05-2020)
hal-02546670 , version 3 (15-05-2020)
hal-02546670 , version 4 (28-05-2020)
hal-02546670 , version 5 (10-09-2020)

Identifiers

  • HAL Id : hal-02546670 , version 5

Cite

Ingvar Ziemann, Henrik Sandberg. On a Phase Transition of Regret in Linear Quadratic Control: The Memoryless Case. 2020. ⟨hal-02546670v5⟩

Collections

TDS-MACS
110 View
228 Download

Share

Gmail Mastodon Facebook X LinkedIn More