HARP: HARmonizing in-vivo diffusion MRI using Phantom-only training
Authors: Hwihun Jeong, Qiang Liu, Kathryn E. Keenan, Elisabeth A. Wilde, Walter Schneider, Sudhir Pathak, Anthony Zuccolotto, Lauren J. O'Donnell, +2 more
Organizations: Department of Psychiatry, Brigham and Women’s Hospital, Harvard Medical School, Boston, Massachusetts, United States of America · College of Engineering, Northeastern University, Boston, Massachusetts, United States of America · Physical Measurement Laboratory, National Institute of Standards and Technology, Boulder, Colorado, United States of America · Department of Neurology, University of Utah School of Medicine, Salt Lake City, Utah, United States of America · George E. Wahlen Veterans Affairs Medical Center, Salt Lake City, Utah, United States of America · University of Pittsburgh, Pittsburgh, Pennsylvania , United States of America · Psychology Software Tools, Pittsburgh, Pennsylvania , United States of America · Department of Radiology, Brigham and Women’s Hospital, Harvard Medical School, Boston, Massachusetts, United States of America · Harvard-MIT Health Sciences and Technology, Cambridge, Massachusetts, United States of America
Purpose: Combining multi-site diffusion MRI (dMRI) data is hindered by inter-scanner variability, which confounds subsequent analysis. Previous harmonization methods require large, matched or traveling human subjects from multiple sites, which are impractical to acquire in many situations. This study aims to develop a deep learning-based dMRI harmonization framework that eliminates the reliance on multi-site in-vivo traveling human data for training. Methods: HARP employs a voxel-wise 1D neural network trained on an easily transportable diffusion phantom. The model learns relationships between spherical harmonics coefficients of different sites without memorizing spatial structures. Results: HARP reduced inter-scanner variability levels significantly in various measures. Quantitatively, it decreased inter-scanner variability as measured by standard error in FA (12%), MD (10%), and GFA (30%) with scan-rescan standard error as the baseline, while preserving fiber orientations and tractography after harmonization. Conclusion: We believe that HARP represents an important first step toward dMRI harmonization using only phantom data, thereby obviating the need for complex, matched in vivo multi-site cohorts. This phantom-only strategy substantially enhances the feasibility and scalability of quantitative dMRI for large-scale clinical studies.
Figures & tables
Figure 1: Conceptual overview of the HARP framework. (a) Comparison between conventional harmonization and the proposed HARP. Unlike traditional methods that necessitate the acquisition of matched or traveling human subject data from multiple sites, HARP utilizes easily accessible diffusion phantom data for network training. (b) Architectural overview of the 1D voxel-wise neural network. The network receives spherical harmonics coefficients from the source site as input and estimates harmonized spherical harmonics coefficients. This non-spatial architecture ensures robust generalizability when transferring the learned relationships from phantom training to in-vivo human inference.
(a) GE → Siemens
b value (s/mm 2 )
Number of gradients
TE (ms)
TR (ms)
Slice thickness (mm)
1000
60
59.1
7500
1.5
1500
60
63.4
9200
1.5
2000
60
72.4
10400
1.5
1000
30
59.1
7000
1.5
2000
30
72.4
12000
1.5
Table 1: Diffusion phantom acquisition protocols for multi-site harmonization. The experimental configurations are illustrated for two distinct scenarios: (a) inter-vendor harmonization between a GE Premier (source site) and a Siemens Prisma (target site), and (b) inter-platform harmonization between a Siemens Skyra (source site) and a Siemens Prisma (target site).
Figure 2: Voxel-wise standard error maps for GE → Siemens harmonization. The spatial distribution of standard errors for fractional anisotropy (FA), mean diffusivity (MD), and generalized fractional anisotropy (GFA) is displayed. Columns 1 and 2 represent the scan-rescan standard error for the source and target sites, respectively. Prior to harmonization (Column 3), the inter-scanner standard error is notably high across all metrics. The application of HARP (Column 5), which is trained exclusively on phantom data, results in a substantial reduction of standard error, achieving performance closer to the in-vivo-trained LinearRISH baseline (Column 4).
Scan-rescan standard error
Inter-scanner standard error
Source
Target
No harmonization
LinearRISH
HARP
\multirow 3*GE → Siemens
FA ( ×10−3 )
42.2 ± 24.5
26.6 ± 15.9
46.5 (10%) ± 23.1
39.9 (-5%) ± 19.1
41.6 (-1%) ± 18.4
MD ( ×10−6 )
60.6 ± 60.9
36.9 ± 36.5
65.7 (8%) ± 63.2
59.3 (-2%) ± 57.3
55.2 (-9%) ± 55.1
GFA ( ×10−3 )
42.7 ± 26.5
23.5 ± 16.1
81.9 (92%) ± 37.9
34.4 (-19%) ± 20.0
56.9 (33%) ± 28.6
\multirow 2*Skyra → Prisma
FA ( ×10−3 )
28.4 ± 23.8
25.1 ± 14.0
44.4 (56%) ± 30.2
37.8 (33%) ± 20.3
40.3 (42%) ± 24.0
MD ( ×10−6 )
48.0 ± 56.1
48.0 ± 48.4
80.7 (68%) ± 93.8
74.9 (56%) ± 93.1
77.0 (61%) ± 92.7
Table 2: Average voxel-wise standard error values for FA, MD, and GFA across three harmonization scenarios. The inter-scanner standard error is reported for the No harmonization data, LinearRISH, and the proposed HARP. Values in parentheses represent the percentage difference between inter-scanner standard error and source site scan-rescan standard error: ( σe,Scan−rescanσe,Inter−scanner−σe,Scan−rescan ).
Figure 3: Box plots illustrating the standard errors for averaged FA, MD, and GFA values across selected white matter regions of interest. The variability is categorized into source site scan-rescan (red), target site scan-rescan (yellow), inter-scanner without harmonization (blue), inter-scanner with LinearRISH (green), and inter-scanner with HARP (purple). Statistical significance from paired t-tests is indicated by *, **, and *** for p-values less than 0.05, 0.01, and 0.001, respectively. HARP significantly reduces the standard error across most tracts, with the exception of FA in the GE → Siemens scenario and MD in the Skyra → Prisma scenario at b = 1000 s/mm 2 .
Figure 4: Box plots illustrating the standard errors for averaged FA, MD, and GFA values across selected gray matter regions of interest. The color coding follows the same scheme as in Figure 3 : source site scan-rescan (red), target site scan-rescan (yellow), inter-scanner without harmonization (blue), inter-scanner with LinearRISH (green), and inter-scanner with HARP (purple). Significance levels are denoted by *, **, and *** for p< 0.05, 0.01, and 0.001, respectively. In gray matter regions, HARP consistently and significantly reduces the inter-scanner standard error across all cases, demonstrating robust harmonization that aligns with the performance of the in-vivo-trained baseline.
Scan-rescan standard error
Inter-scanner standard error
Source
Target
No harmonization
LinearRISH
HARP (proposed)
\multirow 6*GE → Siemens
\multirow 2*FA ( ×10−3 )
WM
3.33 ± 0.75
3.04 ± 0.76
12.2 ± 4.58
4.64 ± 0.92
11.0 ± 3.27
GM
4.09 ± 1.37
2.21 ± 1.13
28.8 ± 3.55
7.31 ± 1.21
15.1 ± 2.56
\multirow 2*MD ( ×10−6 )
WM
6.47 ± 1.77
2.90 ± 1.18
22.1 ± 8.03
8.07 ± 2.38
15.9 ± 5.90
GM
12.1 ± 3.07
8.95 ± 4.61
29.9 ± 15.5
17.6 ± 7.44
19.7 ± 9.34
\multirow 2*GFA ( ×10−3 )
WM
5.45 ± 2.87
3.16 ± 1.30
58.1 ± 10.0
6.73 ± 0.96
32.5 ± 8.28
Table 3: Quantitative summary of mean standard error values for FA, MD, and GFA averaged across white matter (WM) and gray matter (GM) regions of interest.
Figure 5: Visual comparison of (a) tractography (arcuate fasciculus and corticospinal tract) and (b) fiber orientation maps before (top) and after (bottom) HARP harmonization. The high consistency between rows confirms that the 1D voxel-wise framework preserves underlying fiber information.
\multirow 2* GE → Siemens
Skyra → Prisma
Skyra → Prisma
b=1000 s/mm 2
b=2000 s/mm 2
wDICE
0.872
0.874
0.910
Angular error
6.49 ∘
6.83 ∘
4.93 ∘
Table 4: Weighted DICE (wDICE) and angular error values comparing dMRI data before and after HARP harmonization. Across all scenarios, high wDICE scores and low angular errors demonstrate that HARP preserves the underlying fiber information.
Retrospective MRI harmonization is limited by poor scalability across modalities and reliance on traveling subject datasets. To address these challenges, we introduce IHF-Harmony, a unified invertible hierarchy flow framework for multi-modality harmonization using unpaired data. By decomposing the translation process into reversible feature transformations, IHF-Harmony guarantees bijective mapping and lossless reconstruction to prevent anatomical distortion. Specifically, an invertible hierarchy flow (IHF) performs hierarchical subtractive coupling to progressively remove artefact-related features, while an artefact-aware normalization (AAN) employs anatomy-fixed feature modulation to accurately transfer target characteristics. Combined with anatomy and artefact consistency loss objectives, IHF-Harmony achieves high-fidelity harmonization that retains source anatomy. Experiments across multiple MRI modalities demonstrate that IHF-Harmony outperforms existing methods in both anatomical fidelity and downstream task performance, facilitating robust harmonization for large-scale multi-site imaging studies. Code is available at https://github.com/Idea89560041/IHF-Harmony.
Pengli Zhu, Yitao Zhu, Haowen Pang +1
Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong · School of Integrated Circuits and Electronics, Beijing Institute of Technology, China · Mental Health Research Center, The Hong Kong Polytechnic University, Hong Kong +1
Multi-site neuroimaging analysis is fundamentally confounded by scanner-induced covariate shifts, where the marginal distribution of voxel intensities P(x) varies non-linearly across acquisition protocols while the conditional anatomy P(y∣x) remains constant. This is particularly detrimental to radiomic reproducibility, where acquisition variance often exceeds biological pathology variance. Existing statistical harmonization methods (e.g., ComBat) operate in feature space, precluding spatial downstream tasks, while standard deep learning approaches are theoretically bounded by local effective receptive fields (ERF), failing to model the global intensity correlations characteristic of field-strength bias. We propose SA-CycleGAN-2.5D, a domain adaptation framework motivated by the HΔH-divergence bound of Ben-David et al., integrating three architectural innovations: (1) A 2.5D tri-planar manifold injection preserving through-plane gradients ∇z at O(HW) complexity; (2) A U-ResNet generator with dense voxel-to-voxel self-attention, surpassing the O(L) receptive field limit of CNNs to model global scanner field biases; and (3) A spectrally-normalized discriminator constraining the Lipschitz constant (KD≤1) for stable adversarial optimization. Evaluated on 654 glioma patients across two institutional domains (BraTS and UPenn-GBM), our method reduces Maximum Mean Discrepancy (MMD) by 99.1% (1.729→0.015) and degrades domain classifier accuracy to near-chance (59.7%). Ablation confirms that global attention is statistically essential (Cohen's d=1.32, p<0.001) for the harder heterogeneous-to-homogeneous translation direction. By bridging 2D efficiency and 3D consistency, our framework yields voxel-level harmonized images that preserve tumor pathophysiology, enabling reproducible multi-center radiomic analysis.
Ishrith Gowda, Chunwei Liu
Department of Electrical Engineering and Computer Sciences University of California, Berkeley Berkeley, CA 94720 · Department of Computer Science Purdue University West Lafayette, IN 47907
Harmonization methods such as ComBat and its variants are widely used to mitigate diffusion MRI (dMRI) site-specific biases. However, ComBat assumes that subject distributions exhibit a Gaussian profile. In practice, patients with neurological disorders often present diffusion metrics that deviate markedly from those of healthy controls, introducing pathological outliers that distort site-effect estimation. This problem is particularly challenging in clinical practice as most patients undergoing brain imaging have an underlying and yet undiagnosed condition, making it difficult to exclude them from harmonization cohorts, as their scans were precisely prescribed to establish a diagnosis. In this paper, we show that harmonizing data to a normative reference population with ComBat while including pathological cases induces significant distortions. Across 7 neurological conditions, we evaluated 10 outlier rejection methods with 4 ComBat variants over a wide range of scenarios, revealing that many filtering strategies fail in the presence of pathology. In contrast, a simple MLP provides robust outlier compensation enabling reliable harmonization while preserving disease-related signal. Experiments on both control and real multi-site cohorts, comprising up to 80% of subjects with neurological disorders, demonstrate that Robust-ComBat consistently outperforms conventional statistical baselines with lower harmonization error across all ComBat variants.
VitaLab, Dep of Computer Science, University of Sherbrooke, Sherbrooke, QC, J1K 2R1, Canada · Imeka Solutions Inc., Sherbrooke, J1H 4A7, QC, Canada · A comprehensive list of authors and affiliations of this consortium appear at the end of the paper.