Context Aware Edge-Enhanced GAN for Remote Sensing Image Super-Resolution
Zhihan Ren, Lijun He, Jichuan Lu
Abstract
Remote sensing images are essential in many fields, such as land cover classification and building extraction. The huge difference between the directly acquired remote sensing images and the actual scene, due to the complex degradation process and hardware limitations, seriously affects the performance achieved by the same classification or segmentation model. Therefore, using super-resolution (SR) algorithms to improve image quality and achieve better results is an effective method. However, current SR methods only focus on the similarity of pixel values between SR and high-resolution (HR) images without considering perceptual similarities, which usually leads to the problem of over-smoothed and blurred edge details. Moreover, there is little attention to human visual habits and machine vision applications for remote sensing images. In this work, we propose the Context aware Edge-Enhanced Generative Adversarial Network (CEEGAN) SR framework to reconstruct visually pleasing images that can be practically applied in actual scenarios. In the generator of CEEGAN, we build an Edge Feature Enhanced Module (EFEM) to enhance the edges by combining the edge features with context information. Edge Restoration Block (ERB) is designed to fuse multi-scale edge features enhanced by EFEM and reconstruct a refined edge map. Furthermore, we designed an Edge Loss function to constrain the generated SR and HR similarity at the edge domain. Experimental results show that our proposed method can obtain SR images with better reconstruction performance. Meanwhile, CEEGAN can achieve the best results on classification and semantic segmentation datasets for machine vision applications