DsTer: A dense spectral transformer for remote sensing spectral super-resolution
Jiang He, Qiangqiang Yuan, Jie Li, Yi Xiao, Xinxin Liu, Yun Zou
Abstract
To obtain high-resolution hyperspectral data, spectral super-resolution is a popular computational imaging technique directly from high-resolution multispectral images. Besides sparse recovery, deep learning-based methods perform well in the past years for their powerful nonlinear mapping from multispectral to hyperspectral domains. However, convolutions in deep learning only focus on local information and have been blamed for the neglect of long-range relationships. Nowadays, transformer has been attracting great interest for its global attention to long-range interaction. In this study, we propose a dense spectral transformer with ResNet to achieve spectral super-resolution for multispectral remote sensing images. Combining transformer with ResNet meets the need for 3D data handling to remote sensing images as well as learning long-range relationships. Dense connection helps model exploit features from multi-level transformers. Moreover, spectral recovery results on natural data and three remote sensing data sets all prove the advantage of the proposed model. Furthermore, we also carry out classification experiments on real data to verify the dependability of the reconstructed spectra.