Scale Equivariant U-Net - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

Scale Equivariant U-Net

Résumé

In neural networks, the property of being equivariant to transformations improves generalization when the corresponding symmetry is present in the data. In particular, scale-equivariant networks are suited to computer vision tasks where the same classes of objects appear at different scales, like in most semantic segmentation tasks. Recently, convolutional layers equivariant to a semigroup of scalings and translations have been proposed. However, the equivariance of subsampling and upsampling has never been explicitly studied even though they are necessary building blocks in some segmentation architectures. The U-Net is a representative example of such architectures, which includes the basic elements used for state-of-the-art semantic segmentation. Therefore, this paper introduces the Scale Equivariant U-Net (SEU-Net), a U-Net that is made approximately equivariant to a semigroup of scales and translations through careful application of subsampling and upsampling layers and the use of aforementioned scale-equivariant layers. Moreover, a scale-dropout is proposed in order to improve generalization to different scales in approximately scale-equivariant architectures. The proposed SEU-Net is trained for semantic segmentation of the Oxford Pet IIIT and the DIC-C2DH-HeLa dataset for cell segmentation. The generalization metric to unseen scales is dramatically improved in comparison to the U-Net, even when the U-Net is trained with scale jittering, and to a scale-equivariant architecture that does not perform upsampling operators inside the equivariant pipeline. The scale-dropout induces better generalization on the scale-equivariant models in the Pet experiment, but not on the cell segmentation experiment.
Fichier principal
Vignette du fichier
main.pdf (5.6 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03805743 , version 1 (07-10-2022)

Identifiants

Citer

Mateus Sangalli, Samy Blusseau, Santiago Velasco-Forero, Jesus Angulo. Scale Equivariant U-Net. 33rd British Machine Vision Conference, Nov 2022, Londres, United Kingdom. ⟨hal-03805743⟩
41 Consultations
74 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More