Transformer-based land use and land cover classification with explainability using satellite imagery
Mehak Khan, Abdul Hanan, Meruyert Kenzhebay, Michele Gazzea, Reza Arghandeh
Abstract
Transformer-based models have greatly improved Land Use and Land Cover (LULC) applications. Their revolutionary ability to analyze and extract key information has greatly advanced the field. However, the high computational cost of these models presents a considerable obstacle to their practical implementation. Therefore, this study aims to strike a balance between computational cost and accuracy when employing transformer-based models for LULC analysis. We exploit transfer learning and fine-tuning strategies to optimize the resource utilization of transformer-based models. Furthermore, transparency is the core principle of our methodology to promote fairness and trust in applying LULC models across various domains, including forestry, environmental studies, and urban or rural planning. To ensure transparency, we have employed Captum, which enables us to uncover and mitigate potential biases and interpret AI-driven decisions. Our results indicate that transfer learning can potentially improve transformer-based models in satellite image classification, and strategic fine-tuning can maintain efficiency with minimal accuracy trade-offs. This research highlights the potential of Explainable AI (XAI) in Transformer-based models for achieving more efficient and transparent LULC analysis, thereby encouraging continued innovation in the field.