NonRegSRNet: A Nonrigid Registration Hyperspectral Super-Resolution Network - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Geoscience and Remote Sensing Année : 2022

NonRegSRNet: A Nonrigid Registration Hyperspectral Super-Resolution Network

Résumé

Due to the limitations of imaging systems, satellite hyperspectral imagery (HSI), which yields rich spectral information in many channels, often suffers from poor spatial resolution. HSI super-resolution (SR) refers to the fusion of high spatial resolution multispectral imagery (MSI) and low spatial resolution HSI to generate HSI that has both a high spatial and high spectral resolution. However, most existing SR methods assume that the two original images used are perfectly registered: in reality, nonrigid deformation areas can exist locally in the two images even if prior registration of the control points has been carried out. To address this problem, we propose a novel unsupervised spectral unmixing and image deformation correction network—NonRegSRNet—with multimodal and multitask learning that can be used for the joint registration of HSI and MSI and to produce SR imagery. More specifically, NonRegSRNet integrates the dense registration and SR tasks into a unified model that includes a triplet convolutional neural network. This allows these two tasks to complement each other so that better registration and SR results can be achieved. Furthermore, because the point spread function (PSF) and spectral response function (SRF) are often unavailable, two special convolutional layers are designed to adaptively learn the parameters of the PSF and SRF, which makes the proposed model more adaptable. Experimental results demonstrate that the proposed method has the ability to produce highly accurate and stable reconstructed images under complex nonrigid deformation conditions. (Code available at https://github.com/saber-zero/NonRegSRNet)
Fichier non déposé

Dates et versions

hal-03932921 , version 1 (10-01-2023)

Identifiants

Citer

Ke Zheng, Lianru Gao, Danfeng Hong, Bing Zhang, Jocelyn Chanussot. NonRegSRNet: A Nonrigid Registration Hyperspectral Super-Resolution Network. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60, pp.5520216. ⟨10.1109/TGRS.2021.3135501⟩. ⟨hal-03932921⟩
23 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More