Spectral Correlation-Based Fusion Network for Hyperspectral Image Super-Resolution
Qiqi Zhu, Meilin Zhang, Yuling Chen, Guizhou Zheng, Jiancheng Luo
Abstract
To address the limitations of hyperspectral imaging systems, super-resolution (SR) techniques that fuse low-resolution hyperspectral image (HSI) with high-resolution multispectral image (MSI) are applied. Due to the significant modal difference between HSI and MSI, and the insufficient consideration of HSI band correlation in previous works, issues arise such as spectral distortions and loss of fine texture and boundaries. In this article, an unsupervised spectral correlation-based fusion network (SCFN) is proposed to address the above challenges. A new dense spectral convolution module (DSCM) is proposed to capture the intrinsic similarity dependence between spectral bands in HSI to effectively extract spectral domain features and mitigate spectral aberrations. To preserve the rich texture details in MSI, a global-local aware block (GAB) is designed for joint global contextual information and emphasize critical regions. To address the cross-modal disparity problem, new joint losses are constructed to improve the preservation of high-frequency information during image reconstruction and effectively minimize spectral disparity for more precise and accurate image reconstruction. The experimental results on three hyperspectral remote sensing datasets demonstrate that SCFN outperforms other methods in both qualitative and quantitative comparisons. Results from the fusion of real hyperspectral and multispectral remote sensing data further confirm the applicability and effectiveness of the proposed network.