cs.CVMar 23, 2026

PA-SFM: Tracker-free differentiable acoustic radiation for freehand 3D photoacoustic imaging

Authors: Shuang Li, Jian Gao, Chulhong Kim, Seongwook Choi, Qian Chen, Yibing Wang, Shuang Wu, Yu Zhang, +5 more

Organizations: Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, China. · School of Intelligence Science and Technology, Nanjing University, Suzhou, China. · Department of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, and Medical Science and Engineering, Medical Device Innovation Center, Pohang University of Science and Technology, Pohang, Republic of Korea. · National Biomedical Imaging Center, Peking University, Beijing, China.

Abstract

Three-dimensional (3D) handheld photoacoustic tomography typically relies on bulky and expensive external positioning sensors to correct motion artifacts, which severely limits its clinical flexibility and accessibility. To address this challenge, we present PA-SFM, a tracker-free framework that leverages exclusively single-modality photoacoustic data for both sensor pose recovery and high-fidelity 3D reconstruction via differentiable acoustic radiation modeling. Unlike traditional structure-from-motion (SFM) methods based on visual features, PA-SFM integrates the acoustic wave equation into a differentiable programming pipeline. By leveraging a high-performance, GPU-accelerated acoustic radiation kernel, the framework simultaneously optimizes the 3D photoacoustic source distribution and the sensor array pose via gradient descent. To ensure robust convergence in freehand scenarios, we introduce a coarse-to-fine optimization strategy that incorporates geometric consistency checks and rigid-body constraints to eliminate motion outliers. We validated the proposed method through both numerical simulations and in-vivo rat experiments. The results demonstrate that PA-SFM achieves sub-millimeter positioning accuracy and restores high-resolution 3D vascular structures comparable to ground-truth benchmarks, offering a low-cost, software-defined solution for clinical freehand photoacoustic imaging. The source code is publicly available at https://github.com/JaegerCQ/PA-SFM.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. PAGS: Autofocusing Photoacoustic Tomography via Speed-of-Sound-Adaptive Gaussian Splatting

    Aug 26, 2026Jiarui Ge, Jintao Ma, Bangxu Fan +4Image ReconstructionMedical Imaging

  2. Self-Supervised Angular Deblurring in Photoacoustic Reconstruction via Noisier2Inverse

    Apr 17, 2026Markus Haltmeier, Nadja Gruber, Gyeongha HwangMedical ImagingImage Deblurring

  3. Matrix-Free Photoacoustic Image Reconstruction via Sensor-Token Self-Attention

    Jul 28, 2026Mary John, Shibili Said, Imad Barhumi +2Medical ImagingImage Reconstruction