Retinotopy improves the categorisation and localisation of visual objects in CNNs - Archive ouverte HAL
Communication Dans Un Congrès Année : 2023

Retinotopy improves the categorisation and localisation of visual objects in CNNs

Résumé

Foveated vision is a trait shared by many animals, including humans, but its contribution to visual function compared to species lacking it is still under question. This study suggests that the retinotopic mapping which defines foveated vision may play a critical role in achieving efficient visual performance, notably for image categorisation and localisation. To test for this hypothesis, we transformed regular images by using a Log-polar mapping, and used this retinotopic images as the the input of convolutional neural networks (CNNs). We then applied transfer learning on pre-trained networks on the ImageNet challenge dataset. Our results show that surprisingly, the network retrained on images which were compressed by the retinotopic mapping performs as well as the retrained network applied to regular images. Moreover, we observed that the retinotopic mapping improves the robustness and localisation of image classification, especially for isolated objects. This was specially acute on a custom version of the dataset which aimed to categorise images that contain or not an animal. In summary, these results suggest that such retinotopic mapping may be an important component of preattentive processes, a central cognitive characteristic of more advanced visual systems.
Fichier principal
Vignette du fichier
jeremie-23-icann.pdf (6.7 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04233656 , version 1 (09-10-2023)

Identifiants

Citer

Jean-Nicolas Jérémie, Emmanuel Daucé, Laurent U Perrinet. Retinotopy improves the categorisation and localisation of visual objects in CNNs. 32nd International Conference on Artificial Neural Networks (ICANN 2023), European Neural Network Society, Sep 2023, Heraklion, Greece. pp.574-584, ⟨10.1007/978-3-031-44207-0_52⟩. ⟨hal-04233656⟩
21 Consultations
31 Téléchargements

Altmetric

Partager

More