Litcius/Paper detail

Pixel-wise programmability enables dynamic high-SNR cameras for high-speed microscopy

Jie Zhang, Jonathan P. Newman, Zeguan Wang, Yong Qian, Pedro A. Feliciano‐Ramos, Wei Guo, Takato Honda, Zhe Chen, Changyang Linghu, Ralph Etienne-Cummings, Eric R. Fossum, Edward S. Boyden, Matthew Wilson

2024Nature Communications14 citationsDOIOpen Access PDF

Abstract

High-speed wide-field fluorescence microscopy has the potential to capture biological processes with exceptional spatiotemporal resolution. However, conventional cameras suffer from low signal-to-noise ratio at high frame rates, limiting their ability to detect faint fluorescent events. Here, we introduce an image sensor where each pixel has individually programmable sampling speed and phase, so that pixels can be arranged to simultaneously sample at high speed with a high signal-to-noise ratio. In high-speed voltage imaging experiments, our image sensor significantly increases the output signal-to-noise ratio compared to a low-noise scientific CMOS camera (~2-3 folds). This signal-to-noise ratio gain enables the detection of weak neuronal action potentials and subthreshold activities missed by the standard scientific CMOS cameras. Our camera with flexible pixel exposure configurations offers versatile sampling strategies to improve signal quality in various experimental conditions.

Topics & Concepts

PixelComputer scienceSIGNAL (programming language)Noise (video)Signal-to-noise ratio (imaging)Artificial intelligenceImage sensorCMOSSampling (signal processing)Frame rateCMOS sensorFixed-pattern noiseComputer visionPhysicsOptoelectronicsImage (mathematics)TelecommunicationsProgramming languageFilter (signal processing)Advanced Fluorescence Microscopy TechniquesCCD and CMOS Imaging SensorsPhotoreceptor and optogenetics research
Pixel-wise programmability enables dynamic high-SNR cameras for high-speed microscopy | Litcius