Integrating cortico-limbic-basal ganglia architectures for learning model-based and model-free navigation strategies - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Frontiers in Behavioral Neuroscience Année : 2012

Integrating cortico-limbic-basal ganglia architectures for learning model-based and model-free navigation strategies

Résumé

Behavior in spatial navigation is often organized into map-based (place-driven) vs. map-free (cue-driven) strategies; behavior in operant conditioning research is often organized into goal-directed vs. habitual strategies. Here we attempt to unify the two. We review one powerful theory for distinct forms of learning during instrumental conditioning, namely model-based (maintaining a representation of the world) and model-free (reacting to immediate stimuli) learning algorithms. We extend these lines of argument to propose an alternative taxonomy for spatial navigation, showing how various previously identified strategies can be distinguished as " model-based " or " model-free " depending on the usage of information and not on the type of information (e.g., cue vs. place). We argue that identifying " model-free " learning with dorsolateral striatum and " model-based " learning with dorsomedial striatum could reconcile numerous conflicting results in the spatial navigation literature. From this perspective, we further propose that the ventral striatum plays key roles in the model-building process. We propose that the core of the ventral striatum is positioned to learn the probability of action selection for every transition between states of the world. We further review suggestions that the ventral striatal core and shell are positioned to act as " critics " contributing to the computation of a reward prediction error for model-free and model-based systems, respectively.
Fichier principal
Vignette du fichier
2012ACLI2724.pdf (1.87 Mo) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte
Loading...

Dates et versions

hal-01219958 , version 1 (23-10-2015)

Identifiants

Citer

Mehdi Khamassi, Mark D. Humphries. Integrating cortico-limbic-basal ganglia architectures for learning model-based and model-free navigation strategies. Frontiers in Behavioral Neuroscience, 2012, ⟨10.3389/fnbeh.2012.00079⟩. ⟨hal-01219958⟩
90 Consultations
99 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More