cs.CVMar 17, 2026

SA-CycleGAN-2.5D: Self-Attention CycleGAN with Tri-Planar Context for Multi-Site MRI Harmonization

Authors: Ishrith Gowda, Chunwei Liu

Organizations: Department of Electrical Engineering and Computer Sciences University of California, Berkeley Berkeley, CA 94720 · Department of Computer Science Purdue University West Lafayette, IN 47907

Abstract

Multi-site neuroimaging analysis is fundamentally confounded by scanner-induced covariate shifts, where the marginal distribution of voxel intensities P(x)P(\mathbf{x}) varies non-linearly across acquisition protocols while the conditional anatomy P(y∣x)P(\mathbf{y}|\mathbf{x}) remains constant. This is particularly detrimental to radiomic reproducibility, where acquisition variance often exceeds biological pathology variance. Existing statistical harmonization methods (e.g., ComBat) operate in feature space, precluding spatial downstream tasks, while standard deep learning approaches are theoretically bounded by local effective receptive fields (ERF), failing to model the global intensity correlations characteristic of field-strength bias. We propose SA-CycleGAN-2.5D, a domain adaptation framework motivated by the HΔHHΔH-divergence bound of Ben-David et al., integrating three architectural innovations: (1) A 2.5D tri-planar manifold injection preserving through-plane gradients ∇z\nabla_z at O(HW)O(HW) complexity; (2) A U-ResNet generator with dense voxel-to-voxel self-attention, surpassing the O(L)O(\sqrt{L}) receptive field limit of CNNs to model global scanner field biases; and (3) A spectrally-normalized discriminator constraining the Lipschitz constant (KD≤1K_D \le 1) for stable adversarial optimization. Evaluated on 654 glioma patients across two institutional domains (BraTS and UPenn-GBM), our method reduces Maximum Mean Discrepancy (MMD) by 99.1% (1.729→0.0151.729 \to 0.015) and degrades domain classifier accuracy to near-chance (59.7%). Ablation confirms that global attention is statistically essential (Cohen's d=1.32d = 1.32, p<0.001p < 0.001) for the harder heterogeneous-to-homogeneous translation direction. By bridging 2D efficiency and 3D consistency, our framework yields voxel-level harmonized images that preserve tumor pathophysiology, enabling reproducible multi-center radiomic analysis.

Figures & tables

Explore similar work

CardsList
  1. HARP: HARmonizing in-vivo diffusion MRI using Phantom-only training

    Mar 5, 2026Hwihun Jeong, Qiang Liu, Kathryn E. Keenan +7Diffusion MRIMedical Image Analysis

  2. IHF-Harmony: Multi-Modality Magnetic Resonance Images Harmonization using Invertible Hierarchy Flow Model

    Feb 25, 2026Pengli Zhu, Yitao Zhu, Haowen Pang +1Magnetic Resonance ImagingUnpaired Image-to-Image Translation