TOPOLOGICALLY-CONSISTENT MAGNITUDE PRUNING FOR VERY LIGHTWEIGHT GRAPH CONVOLUTIONAL NETWORKS - Archive ouverte HAL
Communication Dans Un Congrès Année : 2022

TOPOLOGICALLY-CONSISTENT MAGNITUDE PRUNING FOR VERY LIGHTWEIGHT GRAPH CONVOLUTIONAL NETWORKS

Hichem Sahbi
  • Fonction : Auteur
  • PersonId : 1181870

Résumé

Graph convolution networks (GCNs) are currently mainstream in learning with irregular data. These models rely on message passing and attention mechanisms that capture context and node-to-node relationships. With multi-head attention, GCNs become highly accurate but oversized, and their deployment on cheap devices requires their pruning. However, pruning at high regimes usually leads to topologically inconsistent networks with weak generalization. In this paper, we devise a novel method for lightweight GCN design. Our proposed approach parses and selects subnetworks with the highest magnitudes while guaranteeing their topological consistency. The latter is obtained by selecting only accessible and co-accessible connections which actually contribute in the evaluation of the selected subnetworks. Experiments conducted on the challenging FPHA dataset show the substantial gain of our topologically consistent pruning method especially at very high pruning regimes.
Fichier principal
Vignette du fichier
article.pdf (306.19 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03838830 , version 1 (03-11-2022)

Identifiants

Citer

Hichem Sahbi. TOPOLOGICALLY-CONSISTENT MAGNITUDE PRUNING FOR VERY LIGHTWEIGHT GRAPH CONVOLUTIONAL NETWORKS. IEEE International Conference on Image Processing (ICIP), Oct 2022, Bordeaux, France. pp.3495-3499, ⟨10.1109/ICIP46576.2022.9897899⟩. ⟨hal-03838830⟩
44 Consultations
220 Téléchargements

Altmetric

Partager

More