PRBCD-Net: Predict-Refining-Involved Bidirectional Contrastive Difference Network for Unsupervised Change Detection
Ling Hu, Qichao Liu, Jia Liu, Liang Xiao
Abstract
Heterogeneous bi-temporal images have different visual appearances and inconsistent data distribution for the same scene, making it challenging to detect changes, which need to align the shared information and reduce various unwanted sensor-related noises for comparability. Mainstream methods usually adopt two types of techniques: feature transformation and image translation. The former relies on handcrafted priors while the latter lacks constraints on unwanted backgrounds, leading to limitations such as a lack of robustness to non-intrinsic changes (e.g., seasonal and atmospheric changes, and sensor-related noise) and unsatisfactory detection performance. To overcome these drawbacks, we propose a novel unsupervised predict-refining-involved bidirectional contrastive difference network (PRBCD-Net) composed of a coarse prediction module and iterative refining modules. Each refining module utilizes feature extractors with a cross-reconstruction constraint and bidirectional contrastive constraint to extract discriminative features, and then generate a refined change map by change map optimizers. Two advantages of the proposed PRBCD-Net are: 1) the cross-reconstruction constraint is used to promote the feature distribution consistency of the bi-temporal images by using the forward and backward transformations; 2) the bidirectional contrastive constraint is used to improve the discriminability of features by narrowing the gap between non-intrinsic changes while widening intrinsic changes under the guidance of a coarse change map. Thus, the refining module can generate a finer change map than the coarse one, and the performance can be further improved through multiple iterations. Experimental results demonstrate the effectiveness and robustness of the proposed method compared with state-of-the-art methods.