RUIESR: Realistic Underwater Image Enhancement and Super Resolution
Yinyi Li, Liquan Shen, Mengyao Li, Zhengyong Wang, Lihao Zhuang
Abstract
Clear and high-resolution (HR) underwater images are indispensable in acquiring underwater information. However, existing underwater image enhancement and super-resolution (UIESR) networks achieve limited enhancement-super-resolution performance on real-world turbid low-resolution (LR) underwater images because (1) they assume that the resolution degradation is simple and known bicubic down-sampling, generating unrealistic training data for UIESR task; (2) they extract known priors from the underwater imaging model, which is meager to address complex UIESR problems caused by unknown mixed dual-degradation; and (3) they ignore the interaction between blurring and color casts in the RGB color space, leading to unsatisfactory correction results of two distortions. To address these issues, we propose a realistic UIESR network (RUIESR) consisting of three parts: a realistic LR image generation module (RLGM), a dual-degradation estimation module (DEM), and an enhancement and super-resolution module (ESRM). Firstly, RLGM aims to generate LR images obeying underwater LR image distribution by learning real LR properties from unpaired real LR-HR underwater images for training. Secondly, a contrast-driven learning strategy is proposed in the DEM to accurately estimate unknown dual-degradation priors that can aid the reconstruction task. Finally, ESRM is proposed to enhance textures and correct color casts, which includes a dual-branch structure to separate blurring and color casts distortions and utilizes specific priors for each distortion to assist reconstruction. Extensive experiments on real and synthetic underwater datasets show that the proposed RUIESR outperforms existing works regarding visual quality and quantitative metrics.