Litcius/Paper detail

Image Colorization Using Color-Features and Adversarial Learning

Hamza Shafiq, Bumshik Lee

2023IEEE Access12 citationsDOIOpen Access PDF

Abstract

In this study, we introduce an innovative image colorization method that not only improves color accuracy and realism but also addresses common issues found in existing methods, such as desaturation and color bleeding. Our proposed method features a novel component called the Color Encoder, which extracts intrinsic color features. Moreover, the proposed Color Encoder aligns essential color features systematically, drawn from a random normal distribution, with real colors. These aligned features are fused at the bottleneck and serve as the foundation for subsequent colorization. Complementing the Color Encoder is our Color Loss mechanism, which aims to align the extracted features from the Color Encoder with the ground-truth color features, enhancing overall color representation accuracy. We also employ a Conditional Wasserstein Generative Adversarial Network (CWGAN) architecture within the framework of a Generative Adversarial Network (GAN) to improve adversarial training and colorization accuracy. To enhance feature representation, we incorporate an attention mechanism at the bottleneck of each encoder layer, further refining our model’s ability to capture essential image details. Experimental results show that our approach significantly outperforms other state-of-the-art methods in terms of both realism and precision, striking a well-balanced performance.

Topics & Concepts

Computer scienceArtificial intelligenceFeature (linguistics)EncoderRepresentation (politics)Generative grammarColor imageComputer visionColor normalizationPattern recognition (psychology)BottleneckImage (mathematics)Image processingOperating systemPoliticsPhilosophyEmbedded systemLawPolitical scienceLinguisticsGenerative Adversarial Networks and Image SynthesisImage Enhancement TechniquesAdvanced Image Processing Techniques
Image Colorization Using Color-Features and Adversarial Learning | Litcius