Visual Question Answering of Remote Sensing Image Based on Attention Mechanism - Archive ouverte HAL
Communication Dans Un Congrès Année : 2022

Visual Question Answering of Remote Sensing Image Based on Attention Mechanism

Résumé

In recent years, the research of attention mechanism has made significant progress in the field of computer vision. In the processing of visual problems of remote sensing images, the attention mechanism can make the computer focus on important image areas and improve the accuracy of question answering. Our research focuses on the role of synergistic attention mechanisms in the interaction of question representations and visual representations. On the basis of Modular Collaborative Attention (MCA), according to the complementary characteristics of global features and local features, the hybrid connection strategy is used to perceive global features at the same time without weakening the attention distribution of local features. The impact of attention mechanisms on various types of visual question answering questions has been evaluated:(i) scene classification (ii)object comparison (iii) quantitative statistics (iv) relational judgment. By fusing the global features and local features of different modalities, the model can obtain more information between modalities. Model performance evaluation under the RSVQA-LR dataset. Experimental results show, the method in this paper improves the global accuracy by 9.81% than RSVQA.
Fichier sous embargo
Fichier sous embargo
0 0 11
Année Mois Jours
Avant la publication
mercredi 1 janvier 2025
Fichier sous embargo
mercredi 1 janvier 2025
Connectez-vous pour demander l'accès au fichier

Dates et versions

hal-04666451 , version 1 (01-08-2024)

Licence

Identifiants

Citer

Shihuai Zhang, Qiang Wei, Yangyang Li, Yanqiao Chen, Licheng Jiao. Visual Question Answering of Remote Sensing Image Based on Attention Mechanism. 5th International Conference on Intelligence Science (ICIS), Oct 2022, Xi'an, China. pp.228-238, ⟨10.1007/978-3-031-14903-0_25⟩. ⟨hal-04666451⟩
22 Consultations
1 Téléchargements

Altmetric

Partager

More