Litcius/Paper detail

STAR: A Structure and Texture Aware Retinex Model

Jun Xu, Yingkun Hou, Dongwei Ren, Li Liu, Fan Zhu, Mengyang Yu, Haoqian Wang, Ling Shao

2020IEEE Transactions on Image Processing300 citationsDOIOpen Access PDF

Abstract

Retinex theory is developed mainly to decompose an image into the illumination and reflectance components by analyzing local image derivatives. In this theory, larger derivatives are attributed to the changes in reflectance, while smaller derivatives are emerged in the smooth illumination. In this paper, we utilize exponentiated local derivatives (with an exponent γ) of an observed image to generate its structure map and texture map. The structure map is produced by been amplified with γ > 1, while the texture map is generated by been shrank with γ < 1. To this end, we design exponential filters for the local derivatives, and present their capability on extracting accurate structure and texture maps, influenced by the choices of exponents γ. The extracted structure and texture maps are employed to regularize the illumination and reflectance components in Retinex decomposition. A novel Structure and Texture Aware Retinex (STAR) model is further proposed for illumination and reflectance decomposition of a single image. We solve the STAR model by an alternating optimization algorithm. Each sub-problem is transformed into a vectorized least squares regression, with closed-form solutions. Comprehensive experiments on commonly tested datasets demonstrate that, the proposed STAR model produce better quantitative and qualitative performance than previous competing methods, on illumination and reflectance decomposition, low-light image enhancement, and color correction. The code is publicly available at https://github.com/csjunxu/STAR.

Topics & Concepts

Color constancyArtificial intelligenceComputer visionBidirectional texture functionTexture (cosmology)Computer scienceImage textureReflectivityPattern recognition (psychology)Image (mathematics)MathematicsProjective texture mappingExponential functionTexture filteringColor modelExponentRepresentation (politics)Texture compressionIterative reconstructionImage processingBidirectional reflectance distribution functionPixelDecompositionImage Enhancement TechniquesComputer Graphics and Visualization TechniquesColor Science and Applications