Litcius/Paper detail

Deep learning-driven adaptive optics for single-molecule localization microscopy

Peiyi Zhang, Donghan Ma, Xi Cheng, Andy P. Tsai, Yu Tang, Hao-Cheng Gao, Li Fang, Cheng Bi, Gary E. Landreth, Alexander A. Chubykin, Fang Huang

2023Nature Methods39 citationsDOIOpen Access PDF

Abstract

The inhomogeneous refractive indices of biological tissues blur and distort single-molecule emission patterns generating image artifacts and decreasing the achievable resolution of single-molecule localization microscopy (SMLM). Conventional sensorless adaptive optics methods rely on iterative mirror changes and image-quality metrics. However, these metrics result in inconsistent metric responses and thus fundamentally limit their efficacy for aberration correction in tissues. To bypass iterative trial-then-evaluate processes, we developed deep learning-driven adaptive optics for SMLM to allow direct inference of wavefront distortion and near real-time compensation. Our trained deep neural network monitors the individual emission patterns from single-molecule experiments, infers their shared wavefront distortion, feeds the estimates through a dynamic filter and drives a deformable mirror to compensate sample-induced aberrations. We demonstrated that our method simultaneously estimates and compensates 28 wavefront deformation shapes and improves the resolution and fidelity of three-dimensional SMLM through >130-µm-thick brain tissue specimens.

Topics & Concepts

WavefrontAdaptive opticsDistortion (music)OpticsDeformable mirrorComputer scienceMetric (unit)Artificial intelligenceMicroscopyIterative reconstructionComputer visionImage qualityArtificial neural networkPhysicsResolution (logic)Image (mathematics)Operations managementAmplifierComputer networkBandwidth (computing)EconomicsAdvanced Fluorescence Microscopy TechniquesOptical Coherence Tomography ApplicationsPhotoacoustic and Ultrasonic Imaging