Litcius/Paper detail

Shuffled rolling shutter for snapshot temporal imaging

Esteban Vera, Felipe Guzmán, Nelson Díaz

2021Optics Express22 citationsDOIOpen Access PDF

Abstract

We propose a modification to the rolling shutter mechanism found in CMOS detectors by shuffling the pixels in every scanline. This potential hardware modification improves the sampling of the space-time datacube, allowing the recovery of high-speed videos from a single image using either tensor completion methods or reconstruction algorithms often used for compressive temporal video. We also present a design methodology for optimal sampling schemes and compare them to random shuffling. Simulations, and experimental results obtained by optically emulating the hardware, demonstrate the ability of the shuffled rolling shutter to capture images that allow reconstructing videos, which would otherwise be impossible when using the traditional rolling shutter mechanism.

Topics & Concepts

ShutterComputer scienceRolling shutterComputer visionSnapshot (computer storage)DetectorArtificial intelligencePixelShufflingOpticsSampling (signal processing)Iterative reconstructionImage sensorImage processingOptical imagingSpatial light modulatorCompressed sensingCMOSComputer graphics (images)CCD and CMOS Imaging SensorsDigital Image Processing TechniquesMedical Imaging Techniques and Applications