CT-Conditioned Diffusion Prior with Physics-Constrained Sampling for PET Super-Resolution
Authors: Liutao Yang, Zi Wang, Peiyuan Jing, Xiaowen Wang, Javier A. Montoya-Zegarra, Kuangyu Shi, Daoqiang Zhang, Guang Yang
Organizations: Department of Bioengineering and Imperial-X, Imperial College London, London, U.K. · College of Artificial Intelligence, Nanjing University of Aeronautics and Astronautics, Nanjing, China. · School of Engineering, Zurich University of Applied Sciences, Winterthur, Switzerland. · Department of Nuclear Medicine, Inselspital, University of Bern, Bern, Switzerland. · National Heart and Lung Institute, Imperial College London, London, U.K. · Cardiovascular Research Centre, Royal Brompton Hospital, London, U.K.
PET super-resolution is highly under-constrained because paired multi-resolution scans from the same subject are rarely available, and effective resolution is determined by scanner-specific physics (e.g., PSF, detector geometry, and acquisition settings). This limits supervised end-to-end training and makes purely image-domain generative restoration prone to hallucinated structures when anatomical and physical constraints are weak. We formulate PET super-resolution as posterior inference under heterogeneous system configurations and propose a CT-conditioned diffusion framework with physics-constrained sampling. During training, a conditional diffusion prior is learned from high-quality PET/CT pairs using cross-attention for anatomical guidance, without requiring paired LR--HR PET data. During inference, measurement consistency is enforced through a scanner-aware forward model with explicit PSF effects and gradient-based data-consistency refinement. Under both standard and OOD settings, the proposed method consistently improves experimental metrics and lesion-level clinical relevance indicators over strong baselines, while reducing hallucination artifacts and improving structural fidelity.
Figures & tables
Figure 1: Conceptual motivation and method positioning for PET super-resolution. (a) PET super-resolution is ill-posed due to scanner-dependent degradation and limited paired data. (b) Supervised CNN mapping depends on paired LR–HR data and tends to over-smooth details. (c) Image-domain diffusion can recover texture but may introduce hallucinations without structural/physics constraints. (d) Our method combines CT-conditioned priors with scanner-aware, PSF-aware consistency for faithful and physically consistent reconstruction.
Figure 2: Overview of the proposed CT-guided diffusion framework. Pretraining (a): learn a CT-conditioned diffusion prior from high-quality PET/CT. Inference (b): start from noisy PET, iteratively denoise, and apply measurement-domain data-consistency updates. PPCR: progressively enforces physics constraints (late activation and coarse-to-fine PSF) to produce a scanner-consistent high-resolution PET output.
Setting
FWHM
Dose
Angular
Radial
Target Spacing
SR Factor
Standard
8 mm
10%
× 2
× 2
8 mm
× 4
OOD
12 mm
5%
× 3
× 2
12 mm
× 6
Table 1: Degradation settings for standard and out-of-distribution (OOD) evaluation.
8 mm (SR × 4)
12 mm (SR × 6)
Method
PSNR ↑
SSIM ↑
NMSE ↓
PSNR ↑
SSIM ↑
NMSE ↓
LR
36.63 ± 4.56 ∗
0.887 ± 0.04 ∗
0.09 ± 0.05 ∗
34.98 ± 3.75 ∗
0.849 ± 0.05 ∗
0.09 ± 0.05 ∗
DeepSR [ 5 ]
42.49 ± 3.70 ∗
0.957 ± 0.02 ∗
0.03 ± 0.03 ∗
37.27 ± 3.31 ∗
0.896 ± 0.04 ∗
0.06 ± 0.05 ∗
UNet [ 20 ]
39.50 ± 4.55 ∗
0.929 ± 0.05 ∗
0.06 ± 0.07 ∗
36.35 ± 3.81 ∗
0.877 ± 0.07 ∗
0.09 ± 0.10 ∗
SRCNN [ 21 ]
42.75 ± 3.70 ∗
0.960 ± 0.02 ∗
0.03 ± 0.03 ∗
37.33 ± 3.32 ∗
0.899 ± 0.04 ∗
0.06 ± 0.05 ∗
SRDPM [ 7 ]
40.30 ± 3.29 ∗
0.923 ± 0.03 ∗
0.04 ± 0.05 ∗
36.74 ± 3.08 ∗
0.877 ± 0.05 ∗
0.08 ± 0.05 ∗
Table 2: Quantitative comparison under standard (8 mm, SR × 4) and OOD (12 mm, SR × 6) settings. Best results are bolded ; second-best are underlined .
Figure 3: Qualitative comparison under the standard setting (8 mm, SR × 4).
Components
Metrics
Variant
CT cond.
DC
PSF
Sched.
PSNR ↑
SSIM ↑
NMSE ↓
w/o DC
CrossAttn
43.92 ± 3.45
0.962 ± 0.02
0.018 ± 0.02
w/o PSF
CrossAttn
✓
✓
45.11 ± 3.26
0.971 ± 0.02
0.014 ± 0.01
w/o PPCR
CrossAttn
✓
✓
45.78 ± 3.18
0.975 ± 0.01
0.012 ± 0.01
CT Concat
Concat
✓
✓
✓
45.94 ± 3.15
0.976 ± 0.01
0.011 ± 0.01
Ours
CrossAttn
✓
✓
✓
46.84 ± 3.08
0.980 ± 0.01
0.010 ± 0.01
Table 3: Ablation study under the standard degradation setting (8 mm, SR × 4). “CT cond.” indicates the conditioning strategy. Best results are bolded .
Figure 4: Lesion-level quantitative comparison on two lung cancer cases. Each lesion reports Δ SUVmax, Δ SUVmean, and lesion NMSE within the lesion mask; lower values indicate better consistency.
Medical image super-resolution reconstructs fine spatial detail from low-resolution scans to support clearer anatomy and more useful clinical measurements.
Reconstructing 3D Computed Tomography (CT) images from a few X-ray projections is a highly ill-posed inverse problem due to the loss of volumetric information. We propose PhyDiCT, a training-free framework that integrates a differentiable Physics-based forward model, grounded in the Beer-Lambert law, with a text-conditioned Diffusion as a strong prior to reconstruct 3D lung CT images. We refer to our approach as training-free since the prior model is used without fine-tuning, and our goal is to steer the denoising procedure to generate samples consistent with X-ray observations. We guide the diffusion generation using Split Gibbs sampling to jointly optimize for projection fidelity (reward) and consistency with prior knowledge. Also, we introduce a test-time refinement step that enhances image realism and anatomical coherence. We extensively evaluate our method on publicly available 3D CT datasets using both perceptual and semantic metrics, demonstrating that it surpasses existing plug-and-play diffusion and fully trained reconstruction approaches. Our findings highlight that combining a strong generative prior with the underlying physics of image formation substantially improves reconstruction quality, e.g., 7.5% improvement on SSIM compared to full training methods. Code will be released at https://github.com/batmanlab/PhyDiCT.
Positron emission tomography (PET) provides essential functional information for disease assessment, however reducing injected activity or acquisition time produces low-dose (LD) PET with stronger count dependent noise and less reliable uptake quantification. Diffusion models offer a promising solution for PET denoising by progressively recovering high-dose (HD) PET images from LD inputs. However, LD-to-HD PET denoising is still challenging due to insufficient anatomical guidance, unstable multi-scale feature propagation, and uncertain frequency domain uptake recovery. We propose AnF-DiffPET, an anatomy- and frequency-guided diffusion framework for computed tomography (CT) conditioned LD PET denoising. The framework integrates Anatomical-Frequency Guidance (AFG), Multi-Scale Cross-Transformer Reconstruction (MSCTR), and Frequency-Contrastive Hard Mining (FCHM) to enhance anatomy aware feature modulation and frequency domain consistency during denoising. Experimental results across four PET/CT datasets show that the proposed method improves image fidelity, anatomical consistency, and quantitative fidelity over representative CNN-based, GAN-based, transformer-based, and diffusion-based methods. The code and trained models will be publicly released upon acceptance.
Xuepeng Liu, Ruili Li, Zetong Liu +5
College of Medicine and Biological Information Engineering, Northeastern University, Shenyang 110169, China · Tohoku University School of Medicine, Sendai 980-8575, Japan · Department of Clinical Neurosciences, University of Cambridge, UK
Positron Emission Tomography (PET) provides important metabolic information for tumor detection and staging but remains significantly less accessible than Computed Tomography (CT) due to its high cost, infrastructure requirements, and reliance on injected radioactive tracers. CT-to-PET image translation using generative models aims to address this disparity, yet state-of-the-art diffusion-based methods are limited by the scarcity of paired training data. To overcome this, we propose a domain-adapted latent diffusion framework that transfers natural-image priors using a relatively small dataset of 21,930 paired CT/PET slices, incorporating a signed power transform to resolve extreme intensity sparsity in PET data. Compared to CPDM, a state-ofthe-art baseline for CT-to-PET image translation, our approach yields superior performance in pixel-wise reconstruction and localized tumor fidelity, demonstrating effective transfer of natural-image priors to the medical domain. We further provide a systematic analysis of evaluation metric reliability for sparse PET data, showing that standard full-image metrics can be misleading indicators of translated image quality, and propose background-filtered and mask-restricted metrics as more clinically meaningful alternatives.
Yann Bourdé, Lea Bogensperger, Arnela Hadzic +1
Department of Quantitative Biomedicine, University of Zurich · Institute for Medical Informatics, Statistics and Documentation, Medical University of Graz