Litcius/Paper detail

Speckle Noise Reduction for OCT Images Based on Image Style Transfer and Conditional GAN

Yi Zhou, Kai Yu, Meng Wang, Yuhui Ma, Yuanyuan Peng, Zhongyue Chen, Weifang Zhu, Fei Shi, Xinjian Chen

2021IEEE Journal of Biomedical and Health Informatics76 citationsDOI

Abstract

Raw optical coherence tomography (OCT) images typically are of low quality because speckle noise blurs retinal structures, severely compromising visual quality and degrading performances of subsequent image analysis tasks. In our previous study (Ma et al., 2018), we have developed a Conditional Generative Adversarial Network (cGAN) for speckle noise removal in OCT images collected by several commercial OCT scanners, which we collectively refer to as scanner T. In this paper, we improve the cGAN model and apply it to our in-house OCT scanner (scanner B) for speckle noise suppression. The proposed model consists of two steps: 1) We train a Cycle-Consistent GAN (CycleGAN) to learn style transfer between two OCT image datasets collected by different scanners. The purpose of the CycleGAN is to leverage the ground truth dataset created in our previous study. 2) We train a mini-cGAN model based on the PatchGAN mechanism with the ground truth dataset to suppress speckle noise in OCT images. After training, we first apply the CycleGAN model to convert raw images collected by scanner B to match the style of the images from scanner T, and subsequently use the mini-cGAN model to suppress speckle noise in the style transferred images. We evaluate the proposed method on a dataset collected by scanner B. Experimental results show that the improved model outperforms our previous method and other state-of-the-art models in speckle noise removal, retinal structure preservation and contrast enhancement.

Topics & Concepts

Speckle noiseOptical coherence tomographyComputer scienceArtificial intelligenceScannerSpeckle patternComputer visionNoise (video)Noise reductionImage qualityGround truthPattern recognition (psychology)Image (mathematics)OpticsPhysicsAdvanced Image Processing TechniquesOptical Coherence Tomography ApplicationsAdvanced Vision and Imaging
Speckle Noise Reduction for OCT Images Based on Image Style Transfer and Conditional GAN | Litcius