Litcius/Paper detail

SSCNN-S: A Spectral-Spatial Convolution Neural Network with Siamese Architecture for Change Detection

Tianming Zhan, Bo Song, Yang Xu, Minghua Wan, Wang Xin, Guowei Yang, Zebin Wu

2021Remote Sensing61 citationsDOIOpen Access PDF

Abstract

In this paper, a spectral-spatial convolution neural network with Siamese architecture (SSCNN-S) for hyperspectral image (HSI) change detection (CD) is proposed. First, tensors are extracted in two HSIs recorded at different time points separately and tensor pairs are constructed. The tensor pairs are then incorporated into the spectral-spatial network to obtain two spectral-spatial vectors. Thereafter, the Euclidean distances of the two spectral-spatial vectors are calculated to represent the similarity of the tensor pairs. We use a Siamese network based on contrastive loss to train and optimize the network so that the Euclidean distance output by the network describes the similarity of tensor pairs as accurately as possible. Finally, the values obtained by inputting all tensor pairs into the trained model are used to judge whether a pixel belongs to the change area. SSCNN-S aims to transform the problem of HSI CD into a problem of similarity measurement for tensor pairs by introducing the Siamese network. The network used to extract tensor features in SSCNN-S combines spectral and spatial information to reduce the impact of noise on CD. Additionally, a useful four-test scoring method is proposed to improve the experimental efficiency instead of taking the mean value from multiple measurements. Experiments on real data sets have demonstrated the validity of the SSCNN-S method.

Topics & Concepts

Tensor (intrinsic definition)Similarity (geometry)Pattern recognition (psychology)Convolution (computer science)Artificial intelligenceComputer scienceHyperspectral imagingEuclidean distanceNoise (video)Artificial neural networkConvolutional neural networkMathematicsImage (mathematics)AlgorithmGeometryRemote-Sensing Image ClassificationRemote Sensing and Land UseSpectroscopy and Chemometric Analyses