Increasing Capacity of Association Memory by Means of Synaptic Clustering - Archive ouverte HAL
Article Dans Une Revue Neural Processing Letters Année : 2019

Increasing Capacity of Association Memory by Means of Synaptic Clustering

Résumé

Making association is an essential property of human cognition. Systems that try to mimic this process and to make a coherent model of the world should have robust and high capacity association memory. Findings of nonlinear properties of dendritic tree suggest an alternative way how neurons can store associations. In this paper, we present a minimalistic neuron model with clustered synapses and show that it provides much higher association memory capacity compared to traditional models. Due to properties of sparse activation and tracking higher-order correlations in the input pattern an individual neuron can recognize thousands of patterns. Theoretical examination shows that this high capacity is reached because learning exact combinations of active neurons extends the dimension of an input space and thus increases pattern separability. We argue that such beneficial computational properties is realized in biological neural networks through synaptic clustering and sustaining sparse activity in memory-related areas.
Fichier non déposé

Dates et versions

hal-02143550 , version 1 (29-05-2019)

Identifiants

Citer

Viacheslav Osaulenko, Bernard Girau, Oleksandr Makarenko, Patrick Henaff. Increasing Capacity of Association Memory by Means of Synaptic Clustering. Neural Processing Letters, 2019, 50 (3), pp.2717-2730. ⟨10.1007/s11063-019-10051-7⟩. ⟨hal-02143550⟩
107 Consultations
0 Téléchargements

Altmetric

Partager

More