Foveated Neural Computation - Archive ouverte HAL Access content directly
Conference Papers Year :

Foveated Neural Computation

(1) , (2, 3) , (4, 5) , (2, 3) , (6, 3) , (5, 1) , (2)


The classic computational scheme of convolutional layers leverages filter banks that are shared over all the spatial coordinates of the input, independently on external information on what is specifically under observation and without any distinctions between what is closer to the observed area and what is peripheral. In this paper we propose to go beyond such a scheme, introducing the notion of Foveated Convolutional Layer (FCL), that formalizes the idea of location-dependent convolutions with foveated processing, i.e., fine-grained processing in a given-focused area and coarser processing in the peripheral regions. We show how the idea of foveated computations can be exploited not only as a filtering mechanism, but also as a mean to speed-up inference with respect to classic convolutional layers, allowing the user to select the appropriate trade-off between level of detail and computational burden. FCLs can be stacked into neural architectures and we evaluate them in several tasks, showing how they efficiently handle the information in the peripheral regions, eventually avoiding the development of misleading biases. When integrated with a model of human attention, FCL-based networks naturally implement a foveated visual system that guides the attention toward the locations of interest, as we experimentally analyze on a stream of visual stimuli.
Fichier principal
Vignette du fichier
_2022__Foveated_Networks___ecml_camera_ready.pdf (1.47 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03881258 , version 1 (01-12-2022)


  • HAL Id : hal-03881258 , version 1


Matteo Tiezzi, Simone Marullo, Alessandro Betti, Enrico Meloni, Lapo Faggi, et al.. Foveated Neural Computation. ECML PKDD 2022 - European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, Sep 2022, Grenoble, France. ⟨hal-03881258⟩
0 View
0 Download


Gmail Facebook Twitter LinkedIn More