MHGAN: A Multi-Headed Generative Adversarial Network for Underwater Sonar Image Super-Resolution
Zhengda Ma, Sensen Li, Jie Ding, Binbin Zou
Abstract
Super-Resolution is a technique for recovering image details based on available information, avoiding image quality degradation by increasing an image’s resolution. Despite the great success of deep learning-based SR models, they are rarely applied to underwater sonar scenarios due to the lack of underwater sonar datasets and the difficulty in recovering texture details. To address these challenges, we propose a multi-headed generative adversarial network (MHGAN) for the super-resolution of underwater sonar images. The main body of the generator is designed with the introduced Residual Simple-dense Self-calibrated Block (RSSB), which combines Self-calibrated Attention and Pixel Attention to improve generalization capability. Additionally, the discriminator employs a novel multi-headed U-net structure to acquire detailed texture information at multiple patch sizes of different scales, along with the generated image and High-Resolution(HR) image details. Moreover, we introduce the correction loss, which acts as a pixel-level correction to help improve the quality of the output images, and multi-perceptual loss based on VGG19 to extract multi-scale features for comparison. Meanwhile, we also introduce the Underwater Sonar Dataset for Super-Resolution (USDSR). We perform the visual and quantitative comparison, ablation experiments, and model analysis with state-of-the-art methods on both the public KLSG dataset and the built USDSR dataset. Experimental results demonstrate the effectiveness and superiority of our proposed MHGAN model.