A Robust Model of Gated Working Memory - Archive ouverte HAL
Article Dans Une Revue Neural Computation Année : 2019

A Robust Model of Gated Working Memory

Anthony Strock
  • Fonction : Auteur
Xavier Hinaut
Nicolas P. Rougier

Résumé

Gated working memory is defined as the capacity of holding arbitrary information at any time in order to be used at a later time. Based on electrophysi-ological recordings, several computational models have tackled the problem using dedicated and explicit mechanisms. We propose instead to consider an implicit mechanism based on a random recurrent neural network. We introduce a robust yet simple reservoir model of gated working memory with instantaneous updates. The model is able to store an arbitrary real value at random time over an extended period of time. The dynamics of the model is a line attractor that learns to exploit reentry and a non-linearity during the training phase using only a few representative values. A deeper study of the model shows that there is actually a large range of hyper parameters for which the results hold (number of neurons, sparsity, global weight scaling, etc.) such that any large enough population, mixing excitatory and inhibitory neurons can quickly learn to realize such gated working memory. In a nutshell, with a minimal set of hypotheses, we show that we can have a robust model of working memory. This suggests this property could be an implicit property of any random population, that can be acquired through learning. Furthermore, considering working memory to be a physically open but functionally closed system, we give account on some counter-intuitive electrophysiological recordings.
Fichier principal
Vignette du fichier
NECO-05-19-3483-article.pdf (6.69 Mo) Télécharger le fichier
NECO-05-19-3483-supplementary.pdf (7.3 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Commentaire Supplementary material
Loading...

Dates et versions

hal-02371659 , version 1 (20-11-2019)

Identifiants

Citer

Anthony Strock, Xavier Hinaut, Nicolas P. Rougier. A Robust Model of Gated Working Memory. Neural Computation, 2019, pp.1-29. ⟨10.1162/neco_a_01249⟩. ⟨hal-02371659⟩
164 Consultations
153 Téléchargements

Altmetric

Partager

More