Lightweight Remote-Sensing Image Super-Resolution via Attention-Based Multilevel Feature Fusion Network
Hongyuan Wang, Shuli Cheng, Yongming Li, Anyu Du
Abstract
In recent years, advancements in remote-sensing image super-resolution have achieved remarkable performance. However, many methods demand significant computational resources. This is problematic for edge devices with limited computational capabilities. To alleviate this problem, we propose an attention-based multi-level feature fusion network (AMFFN) to enhance the resolution of remote-sensing images. This proposed network integrates three efficient design strategies to provide a lightweight solution. Initially, we design the partial shallow residual block (PSRB) to replace the redundant convolution operation. The PSRB optimizes feature extraction via partial convolution and capitalizes on information across channels using pointwise convolution. Subsequently, integrating the PSRB, our dynamic feature distillation block (DFDB) leverages an information distillation mechanism to distill and capture only the crucial features securing a robust feature depiction. Conclusively, for superior feature fusion, we conceptualized an attention-based multi-level feature fusion (AMFF) mechanism. The attention intrinsic to AMFF weighs the significance of features from varied branches, assuring that the resulting output is comprehensive and discerning. We conduct thorough experimental validation on two datasets of remote-sensing images and measure network complexity by evaluating network parameters and multi-adds operations. The results show that our method effectively balances computational complexity and performance. In addition, we have expanded the application of AMFFN to the field of natural image super-resolution. Experimental results on five benchmark test datasets further confirm the effectiveness of our method.