Initial condition recovery in nonlinear damped viscous photoacoustic tomography using a convolutional neural network-guided gradient-free optimization framework
Authors: Madhu Gupta, Anwesa Dey, Prapti Tala, Souvik Roy
Organizations: Department of Mathematics, Indian Institute of Technology, Gandhinagar, Gujarat, India. · Department of Mathematics, University of Utah, Salt Lake City, Utah, UT, USA. · Department of Mathematics, The University of Texas at Arlington, Arlington, TX, USA.
Photoacoustic tomography (PAT) is a hybrid imaging modality that combines high optical contrast with high ultrasonic resolution for biomedical imaging applications. In this work, we investigate the inverse problem of recovering the initial pressure distribution from boundary measurements in the presence of nonlinear acoustic propagation and viscous attenuation effects. To model these phenomena more accurately, we consider a nonlinear damped viscoelastic wave equation incorporating spatially varying sound speed, temporal attenuation, and nonlinear propagation mechanisms. We first establish the well-posedness of the corresponding forward problem using a Galerkin approximation combined with energy estimates and a fixed-point argument. For the inverse problem, we derive existence, uniqueness, and local uniqueness results under suitable assumptions through a harmonic extension reduction, spectral Laplace transform techniques, and observability estimates. To numerically reconstruct the initial pressure field, we develop a hybrid reconstruction framework that combines a convolutional neural network (CNN) with a gradient-free optimization strategy based on the sequential quadratic Hamiltonian (SQH) method derived from Pontryagin's maximum principle. The CNN is used to generate an informative initial guess, while the SQH framework enforces the governing PDE dynamics during the reconstruction process. Numerical experiments demonstrate that the proposed hybrid strategy significantly improves reconstruction quality, contrast, and robustness compared to standalone time-reversal and CNN-based approaches.
Figures & tables
Figure 1: Test Case 1: Reconstructions with two phantoms; Top row corresponds to the 2D profiles; Bottom row corresponds to a 1D cross sectional profile
Figure 2: Test Case 2: Reconstructions with 3 phantoms; Top row corresponds to the 2D profiles; Bottom row corresponds to a 1D cross sectional profile
Figure 3: Test Case 3: Reconstructions in 2D with the heart and lung phantom; Top row corresponds to the 2D profiles; Bottom row corresponds to a 1D cross sectional profile
Phantom
Test Case
TR
CNN
SQH
2 phantom
Test case 1
5.2e-3
4.3e-3
3.9e-3
3 phantom
Test case 2
1.1e-2
1.5e-2
8.8e-3
Heart and lung
Test case 3
1.1e-2
1.3e-2
8.9e-3
Table 1: MSE values for the various test cases.
Phantom
Test Case
TR
CNN
SQH
2 phantom
Test case 1
22.85
23.67
24.05
3 phantom
Test case 2
19.57
18.11
20.55
Heart and lung
Test case 3
19.57
8.86
20.51
Table 2: PSNR values for the various test cases.
Phantom
Test Case
TR
CNN
SQH
2 phantom
Test case 1
0.5
0.94
0.92
3 phantom
Test case 2
0.32
0.84
0.86
Heart and lung
Test case 3
0.33
0.48
0.87
Table 3: SSIM values for the various test cases.
Figure 4: Test Case 4: Reconstructions with 3 phantoms with space-time varying coefficients
Figure 5: Test Case 5: Reconstructions in 2D with the heart and lung phantom with space-time varying coefficients
Phantom
Test Case
TR
CNN
SQH
3 phantom
Test case 4
1.1e-2
1.5e-2
1.0e-2
Heart and lung
Test case 5
2.5e-2
1.4e-1
2.4e-3
Table 4: MSE values for the space-time varying coefficients test cases.
Phantom
Test Case
TR
CNN
SQH
3 phantom
Test case 4
19.57
18.11
19.86
Heart and lung
Test case 5
15.94
8.54
16.12
Table 5: PSNR values for the space-time varying coefficients test cases.
Phantom
Test Case
TR
CNN
SQH
3 phantom
Test case 4
0.32
0.84
0.86
Heart and lung
Test case 5
0.19
0.56
0.72
Table 6: SSIM values for the space-time varying coefficients test cases.
Photoacoustic tomography (PAT) combines the optical absorption contrast of biological tissue with the spatial resolution of ultrasound, yet recovering the initial pressure distribution from sparse-view sensor measurements remains an ill-posed inverse problem. Iterative compressive-sensing solvers and unrolled deep networks both retain a dependence on the system matrix at inference, which leaves real-time clinical reconstruction computationally expensive. This paper proposes the Sensor Attention Network (SAN), a Transformer-based architecture that treats the full time series of each sensor as a token and maps raw measurements directly to the reconstructed image without invoking the system matrix at inference. For training and benchmarking, an analytical k-space H-matrix is constructed and validated against the k-Wave pseudo-spectral solver under matched geometry, achieving a mean per-sensor Pearson correlation of 0.919 +/- 0.049, with k-space apodization and Gaussian temporal damping acting synergistically to reduce the energy-normalized mismatch by 49%. Trained with a vessel-weighted loss on 488 augmented samples and evaluated on 46 held-out samples against ISTA, split-Bregman total variation (SBTV), and learned ISTA (LISTA), SAN attains the highest mean SSIM (0.522) and PSNR (22.09 dB) and the lowest NMSE (0.233). Paired t-tests and Wilcoxon signed-rank tests confirm the superiority of SAN over LISTA on PSNR, NMSE, and Pearson correlation at p < 1e-8, and over ISTA and SBTV on all fidelity metrics. By bypassing the H-matrix at inference, SAN reduces reconstruction time by at least an order of magnitude, supporting real-time PAT reconstruction.
Mary John, Shibili Said, Imad Barhumi +2
Abu Dhabi Polytechnic, Abu Dhabi, United Arab Emirates · United Arab Emirates University, Al Ain, United Arab Emirates
Photoacoustic tomography (PAT) is an emerging imaging modality that combines the complementary strengths of optical contrast and ultrasonic resolution. A central task is image reconstruction, where measured acoustic signals are used to recover the initial pressure distribution. For ideal point-like or line-like detectors, several efficient and fast reconstruction algorithms exist, including Fourier methods, filtered backprojection, and time reversal. However, when applied to data acquired with finite-size detectors, these methods yield systematically blurred images. Although sharper images can be obtained by compensating for finite-detector effects, supervised learning approaches typically require ground-truth images that may not be available in practice. We propose a self-supervised reconstruction method based on Noisier2Inverse that addresses finite-size detector effects without requiring ground-truth data. Our approach operates directly on noisy measurements and learns to recover high-quality PAT images in a ground-truth-free manner. Its key components are: (i) PAT-specific modeling that recasts the problem as angular deblurring; (ii) a Noisier2Inverse formulation in the polar domain that leverages the known angular point-spread function; and (iii) a novel, statistically grounded early-stopping rule. In experiments, the proposed method consistently outperforms alternative approaches that do not use supervised data and achieves performance close to supervised benchmarks, while remaining practical for real acquisitions with finite-size detectors.
Markus Haltmeier, Nadja Gruber, Gyeongha Hwang
Department of Mathematics, University of Innsbruck Technikerstrasse 13, 6020 Innsbruck, Austria · Department of Computer Science, University of Innsbruck Technikerstrasse 21a, 6020 Innsbruck, Austria · Department of Mathematics, Yeungnam University 280 Daehak-Ro, Gyeongsan, Gyeongbuk 38541, South Korea
We study the deep image prior (DIP) framework applied to photoacoustic tomography (PAT) as an unsupervised reconstruction approach to mitigate limited-view artifacts and noise commonly encountered in experimental settings. Efficient implementation is achieved by employing recently published fast forward and adjoint algorithms for circular measurement geometries. Initialization via a fast inverse and total variation (TV) regularization are applied to further suppress noise and mitigate overfitting. For comparison, we compute a classical TV reconstruction. Our experiments comprise simulated PAT measurements under limited-view geometries and varying levels of added noise as well as experimental measurements together with using a digital twin for quality assessment. Our findings suggest that DIP framework provides an effective unsupervised strategy for robust PAT reconstruction even in the challenging case of a limited view geometry providing improvement in several quantitative measures over total variation reconstructions.
Hanna Pulkkinen, Jenni Poimala, Leonid Kunyansky +2
1Research Unit of Mathematical Sciences, University of Oulu, Finland · Department of Technical Physics, University of Eastern Finland, Finland · Department of Mathematics, University of Arizona, USA +2