Litcius/Paper detail

Ray-Space Motion Compensation for Lenslet Plenoptic Video Coding

Thuc Nguyen Huu, Vinh Van Duong, Jonghoon Yim, Byeungwoo Jeon

2023IEEE Transactions on Image Processing12 citationsDOI

Abstract

Plenoptic images and videos bearing rich information demand a tremendous amount of data storage and high transmission cost. While there has been much study on plenoptic image coding, investigations into plenoptic video coding have been very limited. We investigate the motion compensation (or so-called temporal prediction) for plenoptic video coding from a slightly different perspective by looking at the problem in the ray-space domain instead of in the conventional pixel domain. Here, we develop a novel motion compensation scheme for lenslet video under two sub-cases of ray-space motion, that is, integer ray-space motion and fractional ray-space motion. The proposed new scheme of light field motion-compensated prediction is designed such that it can be easily integrated into well-known video coding techniques such as HEVC. Experimental results compared to relevant existing methods have shown remarkable compression efficiency with an average gain of 20.03% and 21.76% respectively under "Low delayed B " and "Random Access" configurations of HEVC.

Topics & Concepts

Motion compensationComputer visionQuarter-pixel motionComputer scienceArtificial intelligenceCoding (social sciences)Motion estimationData compressionRandom accessBlock-matching algorithmCoding tree unitMultiview Video CodingLight fieldComputer graphics (images)AlgorithmMathematicsDecoding methodsVideo processingVideo trackingOperating systemStatisticsAdvanced Vision and ImagingAdvanced Image Processing TechniquesAdvanced Optical Imaging Technologies