On the Shift Invariance of Max Pooling Feature Maps in Convolutional Neural Networks - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2022

On the Shift Invariance of Max Pooling Feature Maps in Convolutional Neural Networks

Résumé

In this paper, we aim to improve the mathematical interpretability of convolutional neural networks for image classification. When trained on natural image datasets, such networks tend to learn parameters in the first layer that closely resemble oriented Gabor filters. By leveraging the properties of discrete Gabor-like convolutions, we prove that, under specific conditions, feature maps computed by the subsequent max pooling operator tend to approximate the modulus of complex Gabor-like coefficients, and as such, are stable with respect to certain input shifts. We then compute a probabilistic measure of shift invariance for these layers. More precisely, we show that some filters, depending on their frequency and orientation, are more likely than others to produce stable image representations. We experimentally validate our theory by considering a deterministic feature extractor based on the dual-tree wavelet packet transform, a particular case of discrete Gabor-like decomposition. We demonstrate a strong correlation between shift invariance on the one hand and similarity with complex modulus on the other hand.
Fichier principal
Vignette du fichier
main.pdf (1 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03779434 , version 1 (16-09-2022)
hal-03779434 , version 2 (24-10-2023)

Licence

Paternité

Identifiants

  • HAL Id : hal-03779434 , version 1

Citer

Hubert Leterme, Kévin Polisano, Valérie Perrier, Karteek Alahari. On the Shift Invariance of Max Pooling Feature Maps in Convolutional Neural Networks. 2022. ⟨hal-03779434v1⟩
187 Consultations
67 Téléchargements

Partager

Gmail Facebook X LinkedIn More