We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

eess.IV

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Electrical Engineering and Systems Science > Image and Video Processing

Title: Coordinate-based neural representations for computational adaptive optics in widefield microscopy

Abstract: Widefield microscopy is widely used for non-invasive imaging of biological structures at subcellular resolution. When applied to complex specimen, its image quality is degraded by sample-induced optical aberration. Adaptive optics can correct wavefront distortion and restore diffraction-limited resolution but require wavefront sensing and corrective devices, increasing system complexity and cost. Here, we describe a self-supervised machine learning algorithm, CoCoA, that performs joint wavefront estimation and three-dimensional structural information extraction from a single input 3D image stack without the need for external training dataset. We implemented CoCoA for widefield imaging of mouse brain tissues and validated its performance with direct-wavefront-sensing-based adaptive optics. Importantly, we systematically explored and quantitatively characterized the limiting factors of CoCoA's performance. Using CoCoA, we demonstrated the first in vivo widefield mouse brain imaging using machine-learning-based adaptive optics. Incorporating coordinate-based neural representations and a forward physics model, the self-supervised scheme of CoCoA should be applicable to microscopy modalities in general.
Comments: 60 pages, 20 figures, 2 tables
Subjects: Image and Video Processing (eess.IV); Systems and Control (eess.SY); Optics (physics.optics)
Cite as: arXiv:2307.03812 [eess.IV]
  (or arXiv:2307.03812v3 [eess.IV] for this version)

Submission history

From: Iksung Kang [view email]
[v1] Fri, 7 Jul 2023 19:36:24 GMT (13258kb)
[v2] Thu, 25 Apr 2024 04:49:04 GMT (13290kb)
[v3] Wed, 1 May 2024 23:31:41 GMT (32032kb)

Link back to: arXiv, form interface, contact.