Hyperspectral Unmixing With Multi-Scale Convolution Attention Network
Sheng Hu, Huali Li
Abstract
Hyperspectral unmixing (HU) is to decompose the mixed pixel into the spectral signatures (endmembers) with their corresponding abundances. However, the ignorance of endmember variability in hyperspectral unmixing results in low performance. To solve this problem, a multi-scale convolution attention network containing endmember unmixing network (EU-Net) and abundance unmixing network(AU-Net) which was called as—the Hyperspectral Unmixing with Multi-scale Convolution Attention Network (HUMSCAN) was proposed in this paper. The EU-Net is composed of the variational autoencoder (VAE) and the multi-scale effective convolution block attention module (MSECBAM), which is combined with the S-VCA pre-training to adaptively extract endmembers at the pixel and sub-pixel levels. The AU-Net is based on the MSECBAM frame jointed the spectral and spatial attention features. The proposed HUMSCAN method can simultaneously and unsupervisedly extract endmembers and their corresponding abundances, which can improve the accuracy and efficiency of spectral unmixing. The performance of the proposed method is evaluated both on synthetic and real datasets. Experimental results show its superiority in comparison with other state-of-the-art methods. The source code for this work will be available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/ma264/HUMSCAN</uri> .