Confidence-controlled Hebbian learning efficiently extracts category membership from stimuli encoded in view of a categorization task - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Neural Computation Année : 2022

Confidence-controlled Hebbian learning efficiently extracts category membership from stimuli encoded in view of a categorization task

Résumé

In experiments on perceptual decision-making, individuals learn a categorization task through trial-and-error protocols. We explore the capacity of a decision-making attractor network to learn a categorization task through reward-based, Hebbian type, modifications of the weights incoming from the stimulus encoding layer. For the latter, we assume a standard layer of a large number of stimulus specific neurons. Within the general framework of Hebbian learning, authors have hypothesized that the learning rate is modulated by the reward at each trial. Surprisingly, we find that, when the coding layer has been optimized in view of the categorization task, such reward-modulated Hebbian learning (RMHL) fails to extract efficiently the category membership.In a previous work we showed that the attractor neural networks nonlinear dynamics accounts for behavioral confidence in sequences of decision trials. Taking advantage of these findings, we propose that learning is controlled by confidence, as computed from the neural activity of the decision-making attractor network. Here we show that this confidence-controlled, reward-based, Hebbian learning efficiently extracts categorical information from the optimized coding layer. The proposed learning rule is local, and, in contrast to RMHL, does not require to store the average rewards obtained on previous trials. In addition, we find that the confidence-controlled learning rule achieves near optimal performance.
Fichier principal
Vignette du fichier
arxiv_version.pdf (2.97 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02912714 , version 1 (06-08-2020)

Identifiants

Citer

Kevin Berlemont, Jean-Pierre Nadal. Confidence-controlled Hebbian learning efficiently extracts category membership from stimuli encoded in view of a categorization task. Neural Computation, 2022, 34 (1), pp.45-77. ⟨10.1162/neco_a_01452⟩. ⟨hal-02912714⟩
139 Consultations
178 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More