Bethe Free Energy and Extrinsics in Approximate Message Passing - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Bethe Free Energy and Extrinsics in Approximate Message Passing

Zilu Zhao
  • Fonction : Auteur
  • PersonId : 1349124
Dirk Slock

Résumé

The Bethe Free Energy (BFE) has been found to be closely connected to various message passing algorithms. Studies have indicated that the BFE shares stationary points with message passing algorithms like Belief Propagation (BP) and Expectation Propagation (EP). Generalized Approximate Message Passing (GAM) algorithms have demonstrated significant efficacy in signal recovery. Nevertheless, they may encounter convergence issues. To address these convergence issues, algorithms based on the minimization of the large system limit (LSL) BFE have been introduced. In this paper, we explore the BFE within the context of Generalized Linear Models (GLMs). Applying a BFE based EP approach leads to the re(G)VAMP algorithm which provides asymptotically exact marginal posteriors based on asymptotically Gaussian extrinsics. It also provides equivalent Gaussian priors and hence an equivalent overall Gaussian linear model, which allows the application of large random matrix theory. We show how this leads to the LSL BFE on which GAMP is based. We also reveal the intimate relation of extrinsics to ComponentWise Conditionally Unbiased Minimum Mean Squared Error (CWCU MMSE) estimation for which we provide a novel shortcut derivation in the GLM.
Fichier principal
Vignette du fichier
publi-7600.pdf (270.6 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04501734 , version 1 (12-03-2024)

Identifiants

Citer

Zilu Zhao, Dirk Slock. Bethe Free Energy and Extrinsics in Approximate Message Passing. ASILOMAR 2023, Asilomar Conference on Signals, Systems, and Computers, Asilomar, Oct 2023, San Fransisco (California), United States. pp.897-901, ⟨10.1109/IEEECONF59524.2023.10477003⟩. ⟨hal-04501734⟩

Collections

EURECOM ANR
0 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More