Optimal prediction with resource constraints using the information bottleneck - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2020

Optimal prediction with resource constraints using the information bottleneck

Vedant Sachdeva
  • Fonction : Auteur
Thierry Mora
Stephanie Palmer

Résumé

Responding to stimuli requires that organisms encode information about the external world. Not all parts of the signal are important for behavior, and resource limitations demand that signals be compressed. Prediction of the future input is widely beneficial in many biological systems. We compute the trade-offs between representing the past faithfully and predicting the future for input dynamics with different levels of complexity. For motion prediction, we show that, depending on the parameters in the input dynamics, velocity or position coordinates prove more predictive. We identify the properties of global, transferrable strategies for time-varying stimuli. For non-Markovian dynamics we explore the role of long-term memory of the internal representation. Lastly, we show that prediction in evolutionary population dynamics is linked to clustering allele frequencies into non-overlapping memories, revealing a very different prediction strategy from motion prediction.
Responding to stimuli requires that organisms encode information about the external world. Not all parts of the signal are important for behavior, and resource limitations demand that signals be compressed. Prediction of the future input is widely beneficial in many biological systems. We compute the trade-offs between representing the past faithfully and predicting the future for input dynamics with different levels of complexity. For motion prediction, we show that, depending on the parameters in the input dynamics, velocity or position coordinates prove more predictive. We identify the properties of global, transferrable strategies for time-varying stimuli. For non-Markovian dynamics we explore the role of long-term memory of the internal representation. Lastly, we show that prediction in evolutionary population dynamics is linked to clustering allele frequencies into non-overlapping memories, revealing a very different prediction strategy from motion prediction.
Fichier principal
Vignette du fichier
2020.04.29.069179v1.full.pdf (7.16 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-03367851 , version 1 (05-11-2020)
hal-03367851 , version 2 (07-10-2021)

Identifiants

Citer

Vedant Sachdeva, Thierry Mora, Aleksandra Walczak, Stephanie Palmer. Optimal prediction with resource constraints using the information bottleneck. 2020. ⟨hal-03367851v1⟩
116 Consultations
54 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More