Quantifying the information lost in optimal covariance matrix cleaning - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2023

Quantifying the information lost in optimal covariance matrix cleaning

Résumé

In this work, we examine the prevalent use of Frobenius error minimization in covariance matrix cleaning. Currently, minimizing the Frobenius error offers a limited interpretation within information theory. To better understand this relationship, we focus on the Kullback-Leibler divergence as a measure of the information lost by the optimal estimators. Our analysis centers on rotationally invariant estimators for data following an inverse Wishart population covariance matrix, and we derive an analytical expression for their Kullback-Leibler divergence. Due to the intricate nature of the calculations, we use genetic programming regressors paired with human intuition. Ultimately, we establish a more defined link between the Frobenius error and information theory, showing that the former corresponds to a first-order expansion term of the Kullback-Leibler divergence.

Dates et versions

hal-04323618 , version 1 (05-12-2023)

Identifiants

Citer

Christian Bongiorno, Lamia Lamrani. Quantifying the information lost in optimal covariance matrix cleaning. 2023. ⟨hal-04323618⟩
15 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More