Extremely Sparse-View Computed Tomography from 2D Projections via Pose-Aware Diffusion Priors
Organizations: The University of Tokyo · National Institute of Informatics
Abstract
Extremely sparse-view computed tomography (xSV-CT) is critical when scanning time, motion, or radiation tolerance limits each scan to only a few projections. In many such scenarios, the same acquisition limits also constrain dataset construction, making pre-reconstructed 3D volumes from dense scans unavailable. This exposes a gap in current sparse-view approaches: Optimization-based methods, which use the sparse measurements directly but lack data-driven priors to suppress artifacts, and learning-based methods, which use strong priors but usually require densely scanned training volumes acquired outside the xSV-CT regime. We study this train-sparse / infer-sparse setting by learning a pose-aware diffusion prior from one 2D projection per training sample, then guiding diffusion sampling with measured-view fidelity, shared-volume reprojection, and projection-physics consistency for tomographic reconstruction. On two public CT datasets across 1-, 4-, and 8-view settings, the proposed method achieves the best novel-view synthesis scores and best or competitive reconstruction quality compared with baselines that use dense-volume supervision.
Figures & tables
| Metric | PSNR | SSIM | LPIPS | |||||||||||||||||
| Dataset | CT-RATE [ 61 ] | SinoCT [ 62 ] | CT-RATE | SinoCT | CT-RATE | SinoCT | ||||||||||||||
| Inference Views | 1 | 4 | 8 | 1 | 4 | 8 | 1 | 4 | 8 | 1 | 4 | 8 | 1 | 4 | 8 | 1 | 4 | 8 | ||
| Projection- | based | FBP [ 52 ] | 7.2 | 10.1 | 11.3 | 10.6 | 11.5 | 12.2 | 0.15 | 0.13 | 0.29 | 0.28 | 0.39 | 0.42 | 0.50 | 0.48 | 0.48 | 0.52 | 0.48 | 0.43 |
| OS-SART [ 25 ] | 7.4 | 8.9 | 14.7 | 12.1 | 11.9 | 19.6 | 0.14 | 0.16 | 0.31 | 0.35 | 0.44 | 0.53 | 0.50 | 0.46 | 0.36 | 0.54 | 0.43 | 0.40 | ||
| SAX-NeRF [ 10 ] | 15.0 | 19.7 | 20.5 | 11.4 | 12.3 | 15.1 | 0.32 | 0.56 | 0.61 | 0.28 | 0.42 | 0.49 | 0.43 | 0.42 | 0.39 | 0.52 | 0.43 | 0.40 | ||
| R 2 -Gaussian [ 11 ] | 14.1 | 15.4 | 25.8 | 11.2 | 13.6 | 16.8 | 0.46 | 0.52 | 0.59 | 0.21 | 0.31 | 0.44 | 0.45 | 0.45 | 0.40 | 0.58 | 0.51 | 0.46 | ||
| Metric | PSNR | SSIM | LPIPS | |||||||||||||||||
| Dataset | CT-RATE [ 61 ] | SinoCT [ 62 ] | CT-RATE | SinoCT | CT-RATE | SinoCT | ||||||||||||||
| Inference Views | 1 | 4 | 8 | 1 | 4 | 8 | 1 | 4 | 8 | 1 | 4 | 8 | 1 | 4 | 8 | 1 | 4 | 8 | ||
| Projection- | based | FBP [ 52 ] | 7.4 | 8.0 | 9.6 | 11.7 | 11.7 | 13.0 | 0.12 | 0.19 | 0.23 | 0.34 | 0.38 | 0.39 | 0.55 | 0.53 | 0.54 | 0.54 | 0.45 | 0.43 |
| OS-SART [ 25 ] | 7.9 | 7.8 | 11.2 | 12.7 | 17.8 | 19.0 | 0.15 | 0.19 | 0.27 | 0.33 | 0.37 | 0.44 | 0.50 | 0.48 | 0.56 | 0.53 | 0.43 | 0.41 | ||
| SAX-NeRF [ 10 ] | 6.3 | 11.4 | 20.2 | 9.4 | 15.0 | 17.9 | 0.15 | 0.37 | 0.54 | 0.29 | 0.40 | 0.46 | 0.66 | 0.52 | 0.40 | 0.49 | 0.42 | 0.36 | ||
| R 2 -Gaussian [ 11 ] | 9.8 | 15.9 | 24.8 | 9.3 | 12.0 | 19.1 | 0.21 | 0.40 | 0.56 | 0.23 | 0.28 | 0.42 | 0.55 | 0.45 | 0.29 | 0.56 | 0.47 | 0.41 | ||
| Task | Novel View Synthesis | Tomographic Reconstruction | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Dataset | CT-RATE | SinoCT | CT-RATE | SinoCT | ||||||||
| Metric | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS |
| No pose | 11.9 | 0.21 | 0.56 | 12.5 | 0.23 | 0.50 | 9.4 | 0.17 | 0.61 | 10.7 | 0.25 | 0.53 |
| Naive CrossAttn | 24.5 | 0.40 | 0.48 | 20.2 | 0.45 | 0.47 | 11.5 | 0.33 | 0.41 | 15.6 | 0.39 | 0.50 |
| w.o. , | 15.6 | 0.32 | 0.55 | 14.6 | 0.32 | 0.49 | 9.2 | 0.19 | 0.59 | 10.0 | 0.18 | 0.53 |
| w.o. | 28.6 | 0.78 | 0.30 | 21.4 | 0.50 | 0.40 | 16.4 | 0.35 | 0.44 | 18.9 | 0.51 | 0.47 |
| Views | mean | std. |
|---|---|---|
| 1-view | 5.48 | 4.64 |
| 4-view | 1.31 | 1.74 |
| 8-view | 0.96 | 0.91 |
Appendix figures & tables35 assets
Supplementary material from the paper’s appendix.
Appendix
| Dataset | Projection Geometry | No. Training | No. Validation | |||
|---|---|---|---|---|---|---|
| Detector Shape | Volume Shape | Detector Pixel Size | Voxel Size | Cases | Cases | |
| CT-RATE [ 61 ] | 4200 | 600 | ||||
| SinoCT [ 62 ] | 2800 | 400 | ||||
| Method | Supervision | Retraining |
|---|---|---|
| DiffusionMBIR [ 37 ] | Reconstructed axial slices | Per dataset (view-count agnostic) |
| C 2 RV [ 13 ] | Reconstructed 3D volumes | Per dataset and per view count |
| DSDF [ 14 ] | Reconstructed 3D volumes | Per dataset and per view count (both stages) |
| Ours | X-ray projections | Per dataset (view-count agnostic) |
| #Train Views/Sample | #Test Views | ||
|---|---|---|---|
| 1 | 4 | 8 | |
| 1 (Ours) | 23.1 / 21.1 | 32.8 / 24.5 | 36.3 / 28.6 |
| 4 | 23.0 / 21.1 | 33.2 / 24.8 | 36.9 / 28.6 |
| 32 | 26.0 / 21.3 | 33.6 / 24.8 | 38.1 / 29.3 |
| Equiv. | Novel View Syn. | Reconstruction | ||||
|---|---|---|---|---|---|---|
| Dosage | P | S | L | P | S | L |
| 100% | 36.3 | 0.95 | 0.17 | 28.6 | 0.69 | 0.27 |
| 75% | 34.3 | 0.90 | 0.20 | 26.1 | 0.66 | 0.28 |
| 50% | 33.6 | 0.89 | 0.23 | 25.3 | 0.66 | 0.30 |
| 25% | 30.6 | 0.85 | 0.24 | 25.0 | 0.65 | 0.31 |
| 10% | 31.2 | 0.85 | 0.24 | 24.3 | 0.61 | 0.30 |
| Variant | PSNR |
|---|---|
| FBP, , corrupted projections | 20.7 |
| FBP, , corrupted projections, non-metal region | 21.2 |
| Ours, , corrupted projections | 26.4 ( ) |
| Ours, , corrupted projections, non-metal region | 27.7 ( ) |
| Case No. | Case 1 | Case 2 | |||||
|---|---|---|---|---|---|---|---|
| No. Inference Views | 1-view | 4-view | 8-view | 1-view | 4-view | 8-view | |
| CT-RATE | NVS | Fig. 12 | Fig. 13 | Fig. 14 | Fig. 15 | Fig. 16 | Fig. 17 |
| TR | Fig. 18 | Fig. 19 | Fig. 20 | Fig. 21 | Fig. 22 | Fig. 23 | |
| SinoCT | NVS | Fig. 24 | Fig. 25 | Fig. 26 | Fig. 27 | Fig. 28 | Fig. 29 |
| TR | Fig. 30 | Fig. 31 | Fig. 32 | Fig. 33 | Fig. 34 | Fig. 35 | |
Sparse-View CT Reconstruction
Sparse-view computed tomography (CT) reconstruction recovers 3D images from limited X-ray projections while suppressing artifacts and preserving anatomy.
See all 52 papers