CATCH: Counterfactual Anatomical Tissue Inpainting with Conditional Haar Diffusion
Organizations: Pioneer Centre for AI, University of Copenhagen, Copenhagen, Denmark
Abstract
BraTS local synthesis replaces masked regions in T1-weighted brain MRI with plausible tumor-free tissue while preserving observed anatomy. We present CATCH, conditional 3D diffusion in an invertible Haar-wavelet domain. Its denoiser receives noisy target coefficients, voided-image coefficients, and a signed mask; tumor-excluded wavelet reconstruction and a hole-focused loss guide training, and hard compositing preserves observed voxels. We compare fixed masks, tumor-component augmentation, and a weighted mixture of tumor-derived, irregular-blob, and ellipsoidal masks. Of 25 development cases, five prespecified cases select each arm's checkpoint and all 25 of their trajectory aggregations; a separate 75-case internal set compares the frozen pipelines and selects a weighted mixture for organizer evaluation. Five-trajectory averaging yielded internal SSIM/PSNR/MSE (meanSD) of , dB, and . As the sole officially evaluated pipeline, weighted mixture yielded , dB, and on the 219-case BraTS 2026 validation set. Against compute-matched random augmentation internally, it improved SSIM by 0.019 (95% bootstrap CI: 0.013-0.025), PSNR by 0.95dB, and MSE by 0.003; all three paired comparisons remained significant after Holm correction. Results favor the complete weighted-mixture policy within CATCH; absent official fixed- and random-pipeline scores and a directly comparable external baseline limit broader conclusions.
Figures & tables
| Configuration | Fixed mask | Random aug. | Weighted mixture |
|---|---|---|---|
| 2.920 | 4.707 | 4.400 | |
| Mean | 2.787 | 2.133 | 2.693 |
| Median | 2.973 | 3.533 | 3.773 |
| Mean | 3.240 | 1.600 | 1.587 |
| Median | 3.080 | 3.027 | 2.547 |
| Pipeline | SSIM | PSNR (dB) | MSE ( ) | Rank |
|---|---|---|---|---|
| Fixed ( ) | 0.756 0.162 | 17.84 1.75 | 1.365 0.807 | 2.551 |
| Fixed (mean ) | 0.756 0.162 | 17.85 1.75 | 1.364 0.807 | 2.551 |
| Random (mean ) | 0.778 0.140 | 18.24 2.19 | 1.252 0.718 | 2.076 |
| Weighted (mean ) | 0.797 0.131 | 19.18 1.80 | 0.987 0.536 | 1.373 |
Image Inpainting
Image inpainting reconstructs missing or corrupted image regions using surrounding context, learned visual priors, and optional structural or reference guidance.
See all 92 papers