Translution-SNet: A Semisupervised Hyperspectral Image Stripe Noise Removal Based on Transformer and CNN
Chengjun Wang, Miaozhong Xu, Yonghua Jiang, Guo Zhang, Hao Cui, Litao Li, Da Li
Abstract
Hyperspectral remote sensing images (HSIs) have been applied in urban planning, environmental monitoring, and other fields. However, they are susceptible to noise interference, such as Gaussian noise, stripe, and mixed noises, from various factors in the imaging process, which greatly limits their applications. Although previous efforts to improve HSI quality have achieved remarkable results, there are still many challenges to be solved. To avoid the poor generalization ability and improve the stripe removal performance of the network in real scenarios. In this paper, we proposed a novel deep learning model (Translution-SNet) for HSI stripe noise removal based on a semi-supervised training strategy that applies a convolution and transformer for feature extraction. Moreover, we used an unbiased estimation method to calculate the loss function of the unsupervised part from noisy data without a clean image. The semi-supervised method improved the ability of Translution-SNet to deal with various complex stripe noises during stripe removal and strengthened its robustness and generalization ability. Our experimental results showed that Translution-SNet could robustly handle stripe noise of images with different loads and achieve satisfactory results, proving its feasibility and effectiveness. In addition, Translution-SNet showed good generalization ability.