Complementary Working Memories using Free-Energy Optimization for Learning Features and Structure in Sequences - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

Complementary Working Memories using Free-Energy Optimization for Learning Features and Structure in Sequences

Résumé

We propose a global framework for modeling the cortico-basal system (CX-BG) and the fronto-striatal system (PFC-BG) for the generation and recall of audio memory sequences; ie, sound perception and speech production. Our genuine model is based on the neural architecture called INFERNO standing for Iterative Free-Energy Optimization of Recurrent Neural Networks. Free-energy (FE) corresponds to the prediction error on internal or external noise. FE minimization is used for exploring, selecting and learning in PFC the optimal choices of actions to perform in the BG network (eg sound production) in order to reproduce and control the most accurately possible the spike trains representing sounds in CX. The difference between the two working memories relies in the neural coding itself, which is based on temporal ordering in the CX-BG networks (Spike Timing-Dependent Plasticity) and on the rank ordering in the sequence in the PFC-BG networks (gating or gain-modulation). We detail in this short paper the CX-BG system responsible to encode the audio primitives at few milliseconds order, and the PFC-BG system responsible for the learning of temporal structure in sequences. Two experiments done with a small and a big audio database show the capabilities of exploration, generalization and robustness to noise of the neural architecture to retrieve audio primitives as well as long-range sequences based on structure detection. Although both learning mechanisms are implemented with the same algorithm of rank-order coding, the CX-BG system realizes a model-free recurrent neural network (INFERNO) and the PFC-BG system implements a gated recurrent neural network (INFERNO GATE).
Fichier principal
Vignette du fichier
ICRA_WS_200511.pdf (901.08 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02626274 , version 1 (26-05-2020)

Identifiants

  • HAL Id : hal-02626274 , version 1

Citer

Alexandre Pitti, Mathias Quoy, Catherine Lavandier, Sofiane Boucenna. Complementary Working Memories using Free-Energy Optimization for Learning Features and Structure in Sequences. Workshop Brain PIL New advances in brain-inspired perception, interaction and learning, ICRA2020, May 2020, Virtual, France. ⟨hal-02626274⟩
117 Consultations
60 Téléchargements

Partager

Gmail Facebook X LinkedIn More