Variance Predictions in VAMP/UAMP with Right Rotationally Invariant Measurement Matrices for niid Generalized Linear Models - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Variance Predictions in VAMP/UAMP with Right Rotationally Invariant Measurement Matrices for niid Generalized Linear Models

Résumé

In the Generalized Linear Model (GLM), the unknowns and the measurements may be non-identically independent distributed (niid), as, for instance, in the Sparse Bayesian Learning (SBL) problem. The Generalized Approximate Message Passing (GAMP) algorithm performs computationally efficient belief propagation for Bayesian inference. The GAMP algorithm predicts the posterior variances correctly in the case of measurement matrices with (n)iid entries. In order to cover more ill-conditioned measurement matrices, the (right) rotationally invariant model was introduced in which the (right) singular vectors are Haar distributed. The associated extension of (G)AMP is the Vector (G)AMP ((G)VAMP) algorithm, which yields correct posterior variance predictions in the case of iid unknowns and measurements. However, due to averaging operations, these predictions become inexact in the case of niid unknowns and/or measurements. In this paper we apply Haar Large System Analysis (LSA) to characterize the variance prediction errors that can occur. We also introduce Unitary AMP (UAMP), which can continue to yield correct results with AMP style complexity.
Fichier principal
Vignette du fichier
publi-7389.pdf (333.86 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04321189 , version 1 (04-12-2023)

Identifiants

Citer

Zilu Zhao, Dirk Slock. Variance Predictions in VAMP/UAMP with Right Rotationally Invariant Measurement Matrices for niid Generalized Linear Models. EUSIPCO 2023, 31st European Signal Processing Conference, IEEE, Sep 2023, Helsinki, Finland. pp.1225-1229, ⟨10.23919/EUSIPCO58844.2023.10289716⟩. ⟨hal-04321189⟩

Collections

EURECOM ANR
15 Consultations
22 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More