Alternating Constrained Minimization Based Approximate Message Passing - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Alternating Constrained Minimization Based Approximate Message Passing

Résumé

Generalized Approximate Message Passing (GAMP) allows for Bayesian inference in linear models with non-identically independently distributed (n.i.i.d.) priors and n.i.i.d. measurements of the linear mixture outputs. It represents an efficient technique for approximate inference, which becomes accurate when both rows and columns of the measurement matrix can be treated as sets of independent vectors and both dimensions become large. It has been shown that the fixed points of GAMP correspond to the extrema of a large system limit of the Bethe Free Energy (LSL-BFE), which represents a meaningful approximation optimization criterion regardless of whether the measurement matrix exhibits the independence properties. However, the convergence of (G)AMP can be notoriously problematic for certain measurement matrices, and the only sure fixes so far are damping (by a difficult-to-determine amount) or perform a double ADMM. In this paper, we revisit the GAMP algorithm (as e.g. for sparse Bayesian learning (SBL)) by more rigorously applying an alternating constrained minimization strategy to an appropriately reparameterized LSL BFE. This guarantees convergence, at least to a local optimum. We furthermore introduce a natural extension of the BFE to integrate the estimation of (the SBL) hyperparameters via Variational Bayes, leading to Variational AMBGAMP or VAM-BGAMP.
Fichier principal
Vignette du fichier
Alternating_Constrained_Minimization_Based_Approximate_Message_Passing.pdf (1.11 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04093371 , version 1 (10-05-2023)

Identifiants

Citer

Christo Kurisummoottil Thomas, Dirk Slock. Alternating Constrained Minimization Based Approximate Message Passing. ICASSP 2023, IEEE International Conference on Acoustics, Speech and Signal Processing, 4-10 June 2023, Rhodes Islands, Greece, IEEE, Jun 2023, Rhodes Island, Greece. pp.1-5, ⟨10.1109/ICASSP49357.2023.10094948⟩. ⟨hal-04093371⟩

Collections

EURECOM ANR
16 Consultations
23 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More