StfMLP: Spatiotemporal Fusion Multilayer Perceptron for Remote-Sensing Images
Guangsheng Chen, Hailiang Lu, Donglin Di, Linhui Li, Mahmoud Emam, Weipeng Jing
Abstract
Remote-sensing (RS) images with high spatial and temporal resolutions play a significant role in monitoring periodic landscape changes for earth observation science. To enrich RS images, spatiotemporal fusion (STF) is considered a promising approach. The key challenge in the current STF-based methods is the requirement for large-scale data. In this work, we propose a deep-learning-based method called spatiotemporal fusion multilayer perceptron (StfMLP) to tackle this challenge. First, our method focuses on the given data in the manner of transductive learning. Second, we propose a designed multilayer perceptron (MLP) model to capture the time dependency and consistency among the input images. Consequently, StfMLP is capable of simultaneously achieving more accurate fusion and requiring a small-scale of data. We conduct extensive experiments on two widely adopted public datasets, namely Coleambally irrigation area (CIA) and the lower Gwydir catchment (LGC). The experimental results demonstrate that the proposed method outperforms the state-of-the-art methods effectively. Code, trained model, and cropped images are available online ( <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/luhailaing-max/StfMLP-master</uri> ).