Improved Variance Predictions in Approximate Message Passing - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Improved Variance Predictions in Approximate Message Passing

Résumé

In the Generalized Linear Model (GLM), the unknowns may be non-identically independent distributed (niid), as for instance in the Sparse Bayesian Learning (SBL) problem. The Generalized Approximate Message Passing (GAMP) algorithm performs computationally efficient belief propagation for Bayesian inference. The GAMP algorithms predicts the posterior variances correctly in the case of measurement matrices with (n)iid entries. In order to cover more illconditioned measurement matrices, the (right) rotationally invariant (RRI) model was introduced in which the (right) singular vectors are Haar distributed, leading to Vector AMP VAMP however assumes iid priors and posteriors. Here we introduce a convergent version of AMB (AMBAMP) applied to Unitarily transformed data, with a variance correction based on Haar Large System Analysis (LSA). The recently introduced reVAMP perspective shows that the resulting AM-BUAMP algorithm has an underlying multivariate Gaussian posterior approximation, that does not get computed but that allows the LSA. The individual variance predictions are exact asymptotically in the RRI setting, as illustrated by a Gaussian Mixture Model example.
Fichier principal
Vignette du fichier
publi-7393.pdf (420.76 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04321154 , version 1 (04-12-2023)

Identifiants

Citer

Zilu Zhao, Dirk Slock. Improved Variance Predictions in Approximate Message Passing. MLSP 2023, IEEE 33rd International Workshop on Machine Learning for Signal Processing, IEEE, Sep 2023, Rome, Italy. pp.1-6, ⟨10.1109/MLSP55844.2023.10286007⟩. ⟨hal-04321154⟩

Collections

EURECOM ANR
19 Consultations
18 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More