Litcius/Paper detail

Forest Disturbance Detection via Self-Supervised and Transfer Learning With Sentinel-1&2 Images

Rıdvan Salih Kuzu, Oleg Antropov, Matthieu Molinier, Corneliu Octavian Dumitru, Sudipan Saha, Xiao Xiang Zhu

2024IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing10 citationsDOIOpen Access PDF

Abstract

In this study, we examine the potential of leveraging self-supervised learning (SSL) and transfer learning methodologies for forest disturbance mapping using Earth Observation (EO) data. Our focus is on natural disturbances caused by windthrow and snowload damages. Particularly, we investigate the potential of knowledge distillation-based contrastive learning approaches to obtain comprehensive representations of forest structure changes using Copernicus Sentinel-1 and Sentinel-2 satellite imagery. Leveraging pre-trained backbone models from knowledge distillation, we employ transfer learning based on Deep Change Vector Analysis (DCVA) to delineate forest changes. We demonstrate developed approaches on two use-cases, namely mapping windthown forest using bi-temporal Sentinel-1 and Sentinel-2 images, and mapping forest areas damaged by excessive snowload using bi-temporal Sentinel-1 images. Developed self-supervised models were compared in a benchmarking exercise. The best results were provided by pixel-level contrastive learning for Sentinel-1 based snowload damage mapping with an overall accuracy of 84% and <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$F_{1}$</tex-math></inline-formula> score of 0.567, and for Sentinel-2 based forest windthrow mapping with an overall accuracy of 76.5% and <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$F_{1}$</tex-math></inline-formula> score of 0.692. We expect that developed methodologies can be useful for mapping also other types of forest disturbances using Copernicus Sentinel images or similar EO data. Our findings underscore the potential of SSL and transfer learning for enhancing forest disturbance detection using EO.

Topics & Concepts

Artificial intelligenceComputer scienceTransfer of learningDeep learningRandom forestSatellite imageryMachine learningVegetation (pathology)Remote sensingPattern recognition (psychology)GeographyPathologyMedicineRemote Sensing in AgricultureRemote Sensing and LiDAR ApplicationsSpecies Distribution and Climate Change