Deep Learning for Brain Encoding and Decoding - Archive ouverte HAL
Communication Dans Un Congrès Année : 2022

Deep Learning for Brain Encoding and Decoding

Résumé

How does the brain represent different modes of information? Can we design a system that can automatically understand what the user is thinking? We can make progress towards answering such questions by studying brain recordings from devices such as functional magnetic resonance imaging (fMRI). The brain encoding problem aims to automatically generate fMRI brain representations given a stimulus. The brain decoding problem is the inverse problem of reconstructing the stimuli given the fMRI brain representation. Both the brain encoding and decoding problems have been studied in detail in the past two decades and the foremost attraction of studying these solutions is that they serve as additional tools for basic research in cognitive science and cognitive neuroscience. Recently, inspired by the effectiveness of deep learning models for natural language processing and computer vision, such models have been applied for neuroscience as well. In this tutorial, we plan to discuss different kinds of stimulus representations, and popular encoding and decoding architectures in detail. The tutorial will provide a working knowledge of the state of the art methods for encoding and decoding, a thorough understanding of the literature, and a better understanding of the benefits and limitations of encoding/decoding with deep learning.
Fichier principal
Vignette du fichier
Paper-ID-1271-cogsci22a-sub1271-i10.pdf (75.53 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03946727 , version 1 (19-01-2023)

Identifiants

  • HAL Id : hal-03946727 , version 1

Citer

Subba Reddy Oota, Jashn Arora, Manish Gupta, Raju S. Bapi, Mariya Toneva. Deep Learning for Brain Encoding and Decoding. COGSCI 2022 - the 44th Annual Conference of the Cognitive Science Society, Jul 2022, Toronto (CA), Canada. ⟨hal-03946727⟩

Collections

CNRS INRIA INRIA2
42 Consultations
257 Téléchargements

Partager

More