cs.CVJul 23, 2026

Physics-Informed Deep Learning Model for Cross-Modality Super-Resolution in Fluorescence Microscopy

Authors: Mohammad SoltaninezhadElena CorbettaFrancisco Paez LariosPaul M. JordanOliver WerzChristian EggelingThomas Bocklitz

Organizations: Department “Photonic Data Science”, Leibniz Institute of Photonic Technology, Member of Leibniz Health Technologies, Member of the Leibniz Center for Photonics in Infection Research (LPI), Jena, Germany · Work group “Photonic Data Science”, Institute of Physical Chemistry (IPC) and Abbe Center of Photonics (ACP), Friedrich Schiller University Jena, Member of the Leibniz Center for Photonics in Infection Research (LPI), Jena, Germany · Institute of Applied Optics and Biophysics, Friedrich Schiller University Jena, Jena, Germany · Leibniz Institute of Photonic Technologies Department of Biophysical Imaging, Jena, Germany · Department of Pharmaceutical/Medicinal Chemistry, Institute of Pharmacy, Friedrich Schiller University Jena, 07743 Jena, Germany · Jena Center for Soft Matter (JCSM), Friedrich Schiller University Jena, 07743 Jena, Germany

Abstract

Cross-modality image translation offers a route to super-resolution fluorescence microscopy from low-resolution images while reducing phototoxicity and instrumentation demands. However, purely data-driven models can produce visually plausible outputs that are inconsistent with optical image formation. Here, we propose a physics-informed generative adversarial network for confocal-to-STED image translation that incorporates microscope-specific point spread function information into the training objective. Simulated and experimentally measured PSFs were evaluated using a limited paired confocal-STED dataset of TOM20-labeled mitochondria in human primary M2 macrophages acquired across different experimental days. Performance was assessed using reference-based and non-reference-based image-quality metrics, together with complementary frequency- and distribution-sensitive analyses. The no-reference metrics probed physics-relevant image properties, including spatial-frequency content, contrast, and signal-to-noise behavior. PSF-guided models improved structural fidelity, reduced local deviations, and achieved closer agreement with STED references than non-PSF baselines, particularly in frequency-domain analyses. These results demonstrate that optical priors can improve the structural fidelity and physical plausibility of generative microscopy models for cross-modality super-resolution imaging.

Explore similar work

CardsList