Triplet Spectralwise Transformer Network for Hyperspectral Target Detection
Jinyue Jiao, Zhiqiang Gong, Ping Zhong
Abstract
Recently, deep learning methods have demonstrated their potentials in extracting spectral information for hyperspectral images and have been widely applied in hyperspectral target detection (HTD). However, prior deep learning methods, represented by the convolutional neural networks, mainly focus on the local information and representation, which cannot well capture the long-range dependence. Besides, limited target references cannot meet the need of massive labelled samples for the training process. This work develops a triplet spectral-wise transformer-based target detector (TSTTD) to deal with these problems. First, this work explores a novel triplet spectral-wise transformer network for HTD task, and a data augmentation method is utilized to construct sufficient and balanced training samples for balanced learning. The proposed network shows advantages in learning local features from multiple adjacent bands and global features with long-range dependence. Second, for improving the separability between targets and backgrounds, a novel inter-category separation and intra-category aggregation (ISIA) loss function is proposed, which joints the hard-negative-mining triplet loss and the binary cross entropy loss. Third, experimental results on six data sets show that our proposed method is effective in leading to excellent detection performance when compared with other state-of-the-art methods.