Inverse problems for structured datasets using parallel TAP equations and restricted Boltzmann machines - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Scientific Reports Année : 2021

Inverse problems for structured datasets using parallel TAP equations and restricted Boltzmann machines

Résumé

Abstract We propose an efficient algorithm to solve inverse problems in the presence of binary clustered datasets. We consider the paradigmatic Hopfield model in a teacher student scenario, where this situation is found in the retrieval phase. This problem has been widely analyzed through various methods such as mean-field approaches or the pseudo-likelihood optimization. Our approach is based on the estimation of the posterior using the Thouless–Anderson–Palmer (TAP) equations in a parallel updating scheme. Unlike other methods, it allows to retrieve the original patterns of the teacher dataset and thanks to the parallel update it can be applied to large system sizes. We tackle the same problem using a restricted Boltzmann machine (RBM) and discuss analogies and differences between our algorithm and RBM learning.

Dates et versions

hal-04452550 , version 1 (12-02-2024)

Identifiants

Citer

Aurelien Decelle, Sungmin Hwang, Jacopo Rocchi, Daniele Tantari. Inverse problems for structured datasets using parallel TAP equations and restricted Boltzmann machines. Scientific Reports, 2021, 11 (1), pp.19990. ⟨10.1038/s41598-021-99353-2⟩. ⟨hal-04452550⟩
10 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More