A 30-fps 192 × 192 CMOS Image Sensor With Per-Frame Spatial-Temporal Coded Exposure for Compressive Focal-Stack Depth Sensing
Yi Luo, Shahriar Mirabbasi
Abstract
In this article, we present a CMOS image sensor (CIS) for coded-exposure-based compressive focal-stack imaging. The proposed CIS has a pixel design, which includes two capacitive trans-impedance amplifiers (CTIAs) and a static random access memory (SRAM), and is capable of per-frame exposure encoding with adjustable spatiotemporal resolutions. A proof-of-concept CIS prototype with a 192 <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\times $ </tex-math></inline-formula> 192 pixel array is designed and fabricated in a 0.13- <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\mu \text{m}$ </tex-math></inline-formula> CMOS process with a pixel size of 12.6 <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\times $ </tex-math></inline-formula> 12.6 <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\mu \text{m}^{2}$ </tex-math></inline-formula> . Operating at 30 frames per second (fps), the CIS demonstrates spatial–temporal coded exposure at a maximum rate of 768 masks/frame. The column-wise 10-bit single-slope (SS) analog-to-digital converter (ADC) includes a ramp-slope adaptation feature used for power optimization. During a frame of coded exposure, a linear focal sweep is implemented by a voice-coil motor (VCM) lens mounted in front of the proposed CIS. Through the sparse reconstruction of the coded image, a focal stack consisting of a volume of defocused images is used to synthesize the scene depth map. By introducing coded exposure, the proposed on-chip compressive focal-stack imaging approach facilitates a frame-saving method for passive depth sensing in machine vision and other imaging applications.