cs.CVMar 5, 2026

Physics-consistent deep learning for blind aberration recovery in mobile optics

Authors: Kartik Jhawar, Tamo Sancho Miguel Tandoc, Khoo Jun Xuan, Wang Lipo

Organizations: Institute for Digital Molecular Analytics and Science (IDMxS), Nanyang Technological University, Singapore 636921 · School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798

Abstract

Mobile photography is often limited by complex, lens-specific optical aberrations. While recent deep learning methods approach this as an end-to-end deblurring task, these "black-box" models lack explicit optical modeling and can hallucinate details. Conversely, classical blind deconvolution remains highly unstable. To bridge this gap, we present Lens2Zernike, a deep learning framework that blindly recovers physical optical parameters from a single blurred image. To the best of our knowledge, no prior work has simultaneously integrated supervision across three distinct optical domains. We introduce a novel physics-consistent strategy that explicitly minimizes errors via direct Zernike coefficient regression (z), differentiable physics constraints encompassing both wavefront and point spread function derivations (p), and auxiliary multi-task spatial map predictions (m). Through an ablation study on a ResNet-18 backbone, we demonstrate that our full multi-task framework (z+p+m) yields a 35% improvement over coefficient-only baselines. Crucially, comparative analysis reveals that our approach outperforms two established deep learning methods from previous literature, achieving significantly lower regression errors. Ultimately, we demonstrate that these recovered physical parameters enable stable non-blind deconvolution, providing substantial in-domain improvement on the patented Institute for Digital Molecular Analytics and Science (IDMxS) Mobile Camera Lens Database for restoring diffraction-limited details from severely aberrated mobile captures.

Figures & tables

Explore similar work

CardsList
  1. A Gradient-Regularized Deep Learning Method for Restoring Image in Myopic Vision

    Oct 13, 2026Kebin Contreras, Luis Toscano-Palomino, Rafael Torres +1Image RestorationImage Deblurring

  2. ErA: Error-Aware Deep Unrolling Network for Single Image Defocus Deblurring

    Jun 4, 2026Tu Vo, Chan Y. ParkImage DeblurringComputational Imaging

  3. Physen-Noise2Noise: Physics-Guided Self-Supervised Defocus Deblurring with Bias Correction under Low-Light Conditions

    May 23, 2026Ziyan Huang, Lang Wu, Hongji Wang +3Unsupervised Image RestorationImage Deblurring