Article Dans Une Revue Computers and Electronics in Agriculture Année : 2025

Boosting hyperspectral image classification with Gate-Shift-Fuse mechanisms in a novel CNN-Transformer approach

Résumé

Hyperspectral Image (HSI) classification categorizes every pixel sample into distinct land-cover types. While CNN-based methods have demonstrated significant advances in feature representation, they often struggle with extracting deep features. On the other hand, transformer models excel in capturing high-level semantic features, offering complementary strengths. This paper introduces a novel HSI classification framework that combines convolutional blocks with Gate-Shift-Fuse (GSF) and transformer blocks to leverage CNNs for local feature extraction and transformers for long-range context modelling. The GSF block enhances the integration of spatial-spectral features, while an effective attention mechanism module refines feature extraction from HSI cubes. The proposed method was evaluated on four benchmark datasets (Indian Pines, Pavia University, WHU-Hi-LongKou, and WHU-Hi-HanChuan). It achieved state-of-the-art overall accuracies (OA) of 99.47% on the Indian Pines dataset and 99.86% on WHU-Hi-LongKou, demonstrating significant improvements over existing models. These results highlight the framework's ability to address challenges like spectral variability and unbalanced datasets. Our contributions include the integration of the GSF block for enhanced spatialspectral feature fusion and the application of transformers for robust high-level semantic understanding, setting a new benchmark in HSI classification.

Fichier principal
Vignette du fichier
Mohamed Fadhlallah Guerri_2025_1-s2.0-S0168169925005952-main.pdf (1.99 Mo) Télécharger le fichier
Origine Publication financée par une institution
Licence

Dates et versions

hal-05123205 , version 1 (20-06-2025)

Licence

Identifiants

Citer

Mohamed Fadhlallah Guerri, Cosimo Distante, Paolo Spagnolo, Abdelmalik Taleb-Ahmed. Boosting hyperspectral image classification with Gate-Shift-Fuse mechanisms in a novel CNN-Transformer approach. Computers and Electronics in Agriculture, 2025, 237, Part A, pp.110489. ⟨10.1016/j.compag.2025.110489⟩. ⟨hal-05123205⟩
89 Consultations
242 Téléchargements

Altmetric

Partager

  • More