Litcius/Paper detail

Objective Quality Assessment of Lenslet Light Field Image Based on Focus Stack

Chunli Meng, Ping An, Xinpeng Huang, Chao Yang, Liquan Shen, Bin Wang

2021IEEE Transactions on Multimedia45 citationsDOI

Abstract

The large amount of complex scene information recorded by light field imaging has the potential for immersive media applications. Compression and reconstruction algorithms are crucial for the transmission, storage, and display of such massive data. Most of the existing quality evaluation indexes do not effectively account for light field characteristics. To accurately evaluate the distortions caused by compression and reconstruction algorithms, it is necessary to construct an image evaluation index that reflects the angular-spatial characteristics of the light field. This work proposes a full-reference light field image quality evaluation index that attempts to extract less information from the focus stack to accurately evaluate the entire light field quality. The proposed framework includes three specific steps. First, we construct a key refocused image extraction framework by the maximal spatial information contrast and the minimal angular information variation. Specifically, the gradient and phase congruency operators are used in the extraction framework. Second, a novel light field quality evaluation index is built based on the angular-spatial characteristics of the key refocused images. In detail, the features used in the key refocused image extraction framework and the chrominance feature are combined to construct the union feature. Third, the similarity of the union feature is pooled by the relevant visual saliency map to obtain the predicted score. Finally, the overall quality of the light field is measured by applying the proposed index to the key refocused images. The high efficiency and precision of the proposed method are shown by extensive comparison experiments.

Topics & Concepts

Computer scienceLight fieldChrominanceImage qualityArtificial intelligenceComputer visionFeature extractionFeature (linguistics)Focus (optics)Field (mathematics)Construct (python library)LuminancePattern recognition (psychology)Image (mathematics)OpticsMathematicsLinguisticsPure mathematicsProgramming languagePhilosophyPhysicsAdvanced Vision and ImagingOptical Coherence Tomography ApplicationsImage and Video Quality Assessment
Objective Quality Assessment of Lenslet Light Field Image Based on Focus Stack | Litcius