A Quick and Easy Way to Estimate Entropy and Mutual Information for Neuroscience - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Frontiers in Neuroinformatics Année : 2021

A Quick and Easy Way to Estimate Entropy and Mutual Information for Neuroscience

Résumé

Calculations of entropy of a signal or mutual information between two variables are valuable analytical tools in the field of neuroscience. They can be applied to all types of data, capture non-linear interactions and are model independent. Yet the limited size and number of recordings one can collect in a series of experiments makes their calculation highly prone to sampling bias. Mathematical methods to overcome this so-called “sampling disaster” exist, but require significant expertise, great time and computational costs. As such, there is a need for a simple, unbiased and computationally efficient tool for estimating the level of entropy and mutual information. In this article, we propose that application of entropy-encoding compression algorithms widely used in text and image compression fulfill these requirements. By simply saving the signal in PNG picture format and measuring the size of the file on the hard drive, we can estimate entropy changes through different conditions. Furthermore, with some simple modifications of the PNG file, we can also estimate the evolution of mutual information between a stimulus and the observed responses through different conditions. We first demonstrate the applicability of this method using white-noise-like signals. Then, while this method can be used in all kind of experimental conditions, we provide examples of its application in patch-clamp recordings, detection of place cells and histological data. Although this method does not give an absolute value of entropy or mutual information, it is mathematically correct, and its simplicity and broad use make it a powerful tool for their estimation through experiments.
Fichier principal
Vignette du fichier
fninf-15-596443 (1).pdf (13.13 Mo) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-04272011 , version 1 (06-11-2023)

Identifiants

Citer

Mickael Zbili, Sylvain Rama. A Quick and Easy Way to Estimate Entropy and Mutual Information for Neuroscience. Frontiers in Neuroinformatics, 2021, 15, pp.596443. ⟨10.3389/fninf.2021.596443⟩. ⟨hal-04272011⟩
15 Consultations
11 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More