Unseen Feature Extraction: Spatial Mapping Expansion With Spectral Compression Network for Hyperspectral Image Classification
Chunyan Yu, Yuanchen Zhu, Meiping Song, Yulei Wang, Qiang Zhang
Abstract
Hyperspectral image classification (HSIC) models have made remarkable progress in the last decade. Nevertheless, the downsized mapping in the convolutional neural network (CNN) and down-sampled mechanism in the transformer-based approach amplify the loss of hidden knowledge in the subpixel that encompasses crucial yet unseen features within a single pixel. Considering this aspect, the mentioned popular solutions for HSIC contradict the inherent characteristic of hyperspectral data. To address this issue, we rethink the size factor in CNN and propose a novel spatial mapping expansion with spectral compression (SMESC) network for HSIC. Specifically, the SMESC builds a mapping expansion network to mine unseen information in subpixels with enlarged feature maps. A channel modulation residual block (CMRB) is developed to compress spectral redundancy and promote salient channels with modulation information. Moreover, we design a multiple-size training strategy to substitute the traditional multiple feature extraction (FE) branches and improve the model adaptation to the different sizes of the testing samples. The extensive experimental results and analysis of four hyperspectral image (HSI) datasets demonstrate the superiority of the proposed architecture compared to other advanced HSIC methods. Our code will be released at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/Chirsycy/SMESC</uri>.