A Vision-Transformer-Based Approach to Clutter Removal in GPR: DC-ViT
Yavuz Emre Kayacan, Işın Erer
Abstract
Since clutter encountered in Ground Penetrating Radar (GPR) systems deteriorates the performance of target detection algorithms, clutter removal is an active research area in the GPR community. In this paper, instead of Convolutional Neural Network (CNN) architectures used in the recently proposed deep learning-based clutter removal methods, we introduce Declutter Vision Transformers (DC-ViT) to remove the clutter. Transformer Encoders in DC-ViT provide an alternative to CNNs which has limitations to capture long-range dependencies due to its local operations. Also, the implementation of a convolutional layer instead of Multilayer Perceptron (MLP) in the Transformer Encoder increases the capturing ability of local dependencies. While deep features are extracted with blocks consisting of Transformer encoders arranged sequentially, losses during information flow are reduced by using dense connections between these blocks. Our proposed DC-ViT was compared with Low-Rank and Sparse methods such as Robust Principle Component Analysis (RPCA), Robust Nonnegative Matrix Factorization (RNMF), and CNN-based deep networks such as Convolutional Auto-Encoder (CAE) and CR-NET. In comparisons made with the hybrid dataset, DC-ViT is 2.5% better in PSNR results than its closest competitor. As a result of the tests we conducted using our experimental GPR data, the proposed model provided an improvement of up to 20%, compared to its closest competitor in terms of SCR.