Litcius/Paper detail

Spatial-Temporal Based Multihead Self-Attention for Remote Sensing Image Change Detection

Yong Zhou, Fengkai Wang, Jiaqi Zhao, Rui Yao, Silin Chen, Heping Ma

2022IEEE Transactions on Circuits and Systems for Video Technology80 citationsDOI

Abstract

The neural network-based remote sensing image change detection method faces a large amount of imaging interference and severe class imbalance problems under high-resolution conditions, which bring new challenges to the accuracy of the detection network. In this work, to address the imaging interference caused by different imaging angles and times, the siamese strategy and multi-head self-attention mechanism are used to reduce the imaging differences between the dual-temporal images and fully exploit the inter-temporal information. Secondly, a learnable multi-part feature learning module is used to adaptively exploit features from different scales to obtain more comprehensive features. Finally, a mixed loss function strategy is used to ensure that the network converges effectively and excludes the adverse interference of a large number of negative samples to the network. Extensive experiments show that our method outperforms numerous methods on LEVIR-CD, WHU, and DSIFN datasets.

Topics & Concepts

Computer scienceExploitInterference (communication)Artificial intelligenceChange detectionImage resolutionFeature (linguistics)Image (mathematics)Pattern recognition (psychology)Computer visionArtificial neural networkChannel (broadcasting)Computer networkLinguisticsPhilosophyComputer securityRemote-Sensing Image ClassificationRemote Sensing and Land UseAdvanced Image Fusion Techniques
Spatial-Temporal Based Multihead Self-Attention for Remote Sensing Image Change Detection | Litcius