TLSTMF-YOLO: Transfer Learning and Feature Fusion Network for Earthquake-Induced Landslide Detection in Remote Sensing Images
Shaoqiang Meng, Zhenming Shi, Saied Pirasteh, Silvia Liberata Ullo, Ming Peng, Changshi Zhou, Wesley Nunes Gonçalves, Limin Zhang
Abstract
Detecting earthquake-induced landslides in remote sensing images is challenging due to the varying sizes of landslides, uneven distribution, and the prevalence of small targets. This study proposes a novel approach, the TLSTMF-YOLO model, which combines a C3-Swin-Transformer and multiscale feature fusion techniques to enhance detection accuracy and efficiency. Key innovations include the use of a convolutional block attention module (CBAM) to improve feature representation, and a bidirectional feature pyramid network (BiFPN) for optimized cross-scale feature fusion. To address data scarcity, a transfer learning strategy is applied, supported by an AdamW optimizer and cosine learning rate strategy for faster convergence. Evaluations on the Jiuzhaigou and Luding landslide datasets demonstrate the model’s effectiveness, achieving precision, recall, and mean average precision (mAP)@0.5 of 95.7%, 89.9%, and 90.5% on the Jiuzhaigou dataset, and 96.0%, 90.9%, and 94.5% on the Luding dataset, respectively. In addition, the model processes frames efficiently, with times of 6.61 and 12.2 ms on the two datasets. These results confirm the model’s capability for accurate and efficient landslide detection, highlighting its potential for real-world applications.