Organizations: MoE Key Lab of Artificial Intelligence, Institute of AI, School of Computer Science, Shanghai Jiao Tong University, Shanghai, China. · National Biomedical Imaging Center, College of Future Technology, Peking University, Beijing, China. · Academy for Advanced Interdisciplinary Studies, Peking University, Beijing, China. · Key Laboratory of Machine Perception, Ministry of Education, Beijing, China. · PKU–Nanjing Institute of Translational Medicine, Nanjing, China.
Photoacoustic computed tomography (PACT) combines optical absorption contrast with acoustic detection for high-resolution deep-tissue imaging. A persistent challenge is that unknown speed-of-sound (SoS) heterogeneity changes acoustic time-of-flight, causing defocusing artifacts when reconstruction assumes a uniform SoS. Existing SoS-adaptive methods either rely on calibrated acoustic priors or optimize dense physical medium models, which becomes expensive and difficult to scale in 3D. We propose PAGS, a differentiable framework for blind autofocusing PACT via speed-of-sound-adaptive Gaussian splatting. PAGS represents the initial pressure field with sparse Gaussian photoacoustic (PA) sources and replaces explicit medium recovery with a compact anisotropic path-averaged SoS (ASoS) field parameterized by spherical harmonic probes. This latent propagation field directly controls source-to-transducer arrival-time alignment, while an analytic Gaussian acoustic projection maps the source representation to transducer signals efficiently. The resulting closed-loop signal-domain optimization jointly updates the Gaussian PA source parameters and the ASoS field from measured data, without calibrated SoS priors. Experiments on simulated and physical phantom data demonstrate improved reconstruction sharpness under heterogeneous acoustic media, robustness to sparse-view sampling, and computational benefits from the analytic Gaussian projection.
Figures & tables
Figure 1: Overview of the proposed PAGS framework for blind autofocusing photoacoustic tomography. Compared with universal back-projection (UBP) under a uniform speed-of-sound (SoS) assumption, PAGS represents the initial pressure field with sparse Gaussian photoacoustic (PA) sources and learns an anisotropic path-averaged SoS (ASoS) field with spherical harmonic (SH) probes, enabling focused reconstruction without calibrated SoS priors.
Figure 2: Core implementation details of PAGS. (a) The differentiable reconstruction model couples Gaussian photoacoustic (PA) sources, anisotropic path-averaged SoS coefficients, and transducer measurements through an analytic acoustic forward model. (b) The anisotropic path-averaged SoS (ASoS) field represents the direction-varying path-averaged SoS from each source location to the transducer array, implicitly capturing the accumulated propagation effect of heterogeneous media. (c) The ASoS query uses two interpolations: spherical harmonic (SH) coefficients are first obtained at the PA source position by spatial interpolation from neighboring probes, and the path-averaged SoS is then obtained by angular SH interpolation along each source–transducer direction.
Figure 3: In silico configuration and results. Left: transducer positions (top) and acquisition geometry with a grey spherical cap, a yellow ellipsoid speed-of-sound interface, and red phantom voxels of 0.1 mm edge length (bottom). Middle: qualitative reconstruction comparison in three orthogonal views. Right: corresponding digital phantom. Scale bar: 2 mm. PAGS corrects artifacts induced by a heterogeneous acoustic medium without calibrated SoS priors, yielding sharper vascular structures than uniform-SoS baselines.
Method
PSNR ↑
RMSE ↓
SSIM ↑
Vanilla UBP
23.2
0.0695
0.230
Dual-SoS UBP (Oracle)
28.2
0.0388
0.384
Vanilla SlingBAG
29.0
0.0354
0.331
PAGS (Ours)
30.3
0.0305
0.537
Table 1: Quantitative evaluation on the in silico dataset, calculated against a uniform-SoS UBP reference after rigid registration and peak-intensity normalization.
Figure 4: Physical phantom reconstruction results, scale bar: 5 mm. The left panels compare global views, zoomed regions marked by red boxes, and local line-profile locations marked in yellow. The right panels show the normalized PA amplitude profiles along the marked lines. Compared with uniform-SoS UBP, prior-informed Dual-SoS UBP, and vanilla SlingBAG, PAGS produces sharper absorber boundaries, improved local contrast, and clearer separation between neighboring structures under blind SoS adaptation.
Figure 5: Robustness under sparse-view sampling on the physical phantom data, scale bar: 5 mm. PAGS is evaluated by retaining 50%, 25%, and 12.5% of the detector channels. The reconstruction degrades gradually as sampling becomes sparser, while major vascular structures and branch connectivity remain visible.
Figure 6: Mean squared error (MSE) loss convergence of the four ablation configurations on the heterogeneous-SoS simulation. The ASoS field substantially reduces the final signal residual, while the analytic Gaussian forward model lowers the computational cost of each optimization iteration.
Configuration
Forward model
SoS field
Time/iter. (s) ↓
Baseline
10-sphere approx.
Uniform
6.7
+ ASoS field
10-sphere approx.
SH probes
6.9
+ Analytic
Analytic
Uniform
2.3
Full PAGS
Analytic
SH probes
2.4
Table 2: Computational efficiency of the four ablation configurations. The analytic Gaussian forward model provides the main speedup, while adding the ASoS field introduces only minor overhead.
Photoacoustic tomography (PAT) is an emerging imaging modality that combines the complementary strengths of optical contrast and ultrasonic resolution. A central task is image reconstruction, where measured acoustic signals are used to recover the initial pressure distribution. For ideal point-like or line-like detectors, several efficient and fast reconstruction algorithms exist, including Fourier methods, filtered backprojection, and time reversal. However, when applied to data acquired with finite-size detectors, these methods yield systematically blurred images. Although sharper images can be obtained by compensating for finite-detector effects, supervised learning approaches typically require ground-truth images that may not be available in practice. We propose a self-supervised reconstruction method based on Noisier2Inverse that addresses finite-size detector effects without requiring ground-truth data. Our approach operates directly on noisy measurements and learns to recover high-quality PAT images in a ground-truth-free manner. Its key components are: (i) PAT-specific modeling that recasts the problem as angular deblurring; (ii) a Noisier2Inverse formulation in the polar domain that leverages the known angular point-spread function; and (iii) a novel, statistically grounded early-stopping rule. In experiments, the proposed method consistently outperforms alternative approaches that do not use supervised data and achieves performance close to supervised benchmarks, while remaining practical for real acquisitions with finite-size detectors.
Markus Haltmeier, Nadja Gruber, Gyeongha Hwang
Department of Mathematics, University of Innsbruck Technikerstrasse 13, 6020 Innsbruck, Austria · Department of Computer Science, University of Innsbruck Technikerstrasse 21a, 6020 Innsbruck, Austria · Department of Mathematics, Yeungnam University 280 Daehak-Ro, Gyeongsan, Gyeongbuk 38541, South Korea
Three-dimensional (3D) handheld photoacoustic tomography typically relies on bulky and expensive external positioning sensors to correct motion artifacts, which severely limits its clinical flexibility and accessibility. To address this challenge, we present PA-SFM, a tracker-free framework that leverages exclusively single-modality photoacoustic data for both sensor pose recovery and high-fidelity 3D reconstruction via differentiable acoustic radiation modeling. Unlike traditional structure-from-motion (SFM) methods based on visual features, PA-SFM integrates the acoustic wave equation into a differentiable programming pipeline. By leveraging a high-performance, GPU-accelerated acoustic radiation kernel, the framework simultaneously optimizes the 3D photoacoustic source distribution and the sensor array pose via gradient descent. To ensure robust convergence in freehand scenarios, we introduce a coarse-to-fine optimization strategy that incorporates geometric consistency checks and rigid-body constraints to eliminate motion outliers. We validated the proposed method through both numerical simulations and in-vivo rat experiments. The results demonstrate that PA-SFM achieves sub-millimeter positioning accuracy and restores high-resolution 3D vascular structures comparable to ground-truth benchmarks, offering a low-cost, software-defined solution for clinical freehand photoacoustic imaging. The source code is publicly available at https://github.com/JaegerCQ/PA-SFM.
Shuang Li, Jian Gao, Chulhong Kim +10
Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, China. · School of Intelligence Science and Technology, Nanjing University, Suzhou, China. · Department of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, and Medical Science and Engineering, Medical Device Innovation Center, Pohang University of Science and Technology, Pohang, Republic of Korea. +1
Photoacoustic tomography (PAT) combines the optical absorption contrast of biological tissue with the spatial resolution of ultrasound, yet recovering the initial pressure distribution from sparse-view sensor measurements remains an ill-posed inverse problem. Iterative compressive-sensing solvers and unrolled deep networks both retain a dependence on the system matrix at inference, which leaves real-time clinical reconstruction computationally expensive. This paper proposes the Sensor Attention Network (SAN), a Transformer-based architecture that treats the full time series of each sensor as a token and maps raw measurements directly to the reconstructed image without invoking the system matrix at inference. For training and benchmarking, an analytical k-space H-matrix is constructed and validated against the k-Wave pseudo-spectral solver under matched geometry, achieving a mean per-sensor Pearson correlation of 0.919 +/- 0.049, with k-space apodization and Gaussian temporal damping acting synergistically to reduce the energy-normalized mismatch by 49%. Trained with a vessel-weighted loss on 488 augmented samples and evaluated on 46 held-out samples against ISTA, split-Bregman total variation (SBTV), and learned ISTA (LISTA), SAN attains the highest mean SSIM (0.522) and PSNR (22.09 dB) and the lowest NMSE (0.233). Paired t-tests and Wilcoxon signed-rank tests confirm the superiority of SAN over LISTA on PSNR, NMSE, and Pearson correlation at p < 1e-8, and over ISTA and SBTV on all fidelity metrics. By bypassing the H-matrix at inference, SAN reduces reconstruction time by at least an order of magnitude, supporting real-time PAT reconstruction.
Mary John, Shibili Said, Imad Barhumi +2
Abu Dhabi Polytechnic, Abu Dhabi, United Arab Emirates · United Arab Emirates University, Al Ain, United Arab Emirates