BFHD: Bidirectional Feature Harmonization Decomposition for Heterogeneous Clinical Assessments
Authors: Yuanhao Zhuo, Zixi Qin, Ling Qin, Wanqing Li
Organizations: University of Wollongong, Wollongong, NSW 2522, Australia · The People’s Hospital of Guangxi Zhuang Autonomous Region, Nanning, Guangxi 530021, China
Clinical assessments are often collected using heterogeneous assessment systems across centers and time, leading to records that mix different but related sets of measurements. This motivates harmonization beyond total-score linking. We formulate clinical harmonization at the measurement level as a bidirectional recoverability problem: given paired observations from two assessment systems, the goal is to identify which measurements can be reliably translated in both directions within an application-defined tolerance, while separating non-translatable components. We propose Bidirectional Feature Harmonization Decomposition (BFHD), a feasibility-driven framework that enforces bidirectionally coupled translation and uses feature-wise output gating to produce an explicit decomposition in the original measurement space. Experiments on synthetic data and real clinical assessment pairs show that BFHD achieves broader feasible harmonization coverage and improved subset stability compared to baselines.
Figures & tables
Model
Acc X
Acc Y
JX
JY
Ours
0.880±0.024
0.830±0.024
0.933
0.924
CMLP
0.855±0.015
0.810±0.049
0.975
0.789
NICE
0.735±0.039
0.725±0.040
0.837
0.814
Table 1: Synthetic feasibility recovery under ground-truth ε ( sgen =5). Acc X and Acc Y denote index-level structure recovery accuracy for systems X and Y , respectively (mean ±std across 10 seeds). JX and JY report Jaccard similarity. For baseline models without gating, recoverability is inferred post hoc using a relaxed 2εgen feasibility criterion. Additional results are provided in Appendix D.1 .
Data
Method
#RecA
JA
#A>0.7
#A>0.5
#RecB
JB
#B>0.7
#B>0.5
IRT
11
0.733
4.5
10.5
7
0.785
4
7
CAS(A)
XGB
9
0.710
6
9
7
0.842
5
7
↔
FRF
9
0.683
4.5
9
7.5
0.858
6
7.5
SNAP(B)
CMLP
9
0.640
5
9
7
0.764
6
7
NICE
11
0.867
4
11
9
0.774
5
9
Ours
11
0.930
4
11
9
0.817
5
9
Table 2: Real-world harmonization results under εcutoff=0.6 . For each row, A and B correspond to the two assessment systems. #RecA / #RecB are the median numbers of recoverable measurements and JA / JB are Jaccard stability across 10 seeds. #A>0.7 , #A>0.5 (and analogously for B) count selected measurements whose CCC exceeds 0.7 or 0.5, used as diagnostic measures of feasibility.
Figure 1: ε -sweep on EMBIC and NeuroBAT. Median number of recoverable measurements ( #rec ) as a function of the feasibility threshold ε . CAS ↔ SNAP results are reported in Appendix D.2 .
Method
#Ret A
Ret% A
#Ret B
Ret% B
IRT
3
42.9±0.0
0
N/A
XGB
6
85.7±0.0
0.5
62.5±48.4
FRF
5
56.0±8.0
0
0.0±0.0
CMLP
6
71.0±7.5
1
90.0±10.0
NICE
6
77.4±9.9
2
49.2±10.5
Ours
7
100.0±0.0
3
100.0±0.0
Table 3: Temporal deployment utility under protocol drift on the EMBIC(A) ↔ NeuroBAT(B) assessment pair. εcutoff=0.6 . #Ret A /#Ret B denote the numbers of training-period recoverable measurements that remain feasible on the held-out test split. Ret% A /Ret% B report the corresponding retention rates. (mean ±std across 10 seeds) Additional results in Appendix D.3 .
Variant
#RecA
JA
#RecB
JB
Ours (full)
7
0.910
2
0.689
- TWMLP
7
0.886
1
0.600
- L0 penalty
0†
N/A
0†
N/A
- No gating
7
0.806
2
0.523
- No hinge
13†
N/A
9†
N/A
Table 4: Ablation study on EMBIC (A) ↔ NeuroBAT (B) under εcutoff=0.6 . Notation are consistent with Table 2 . Additional results in Appendix D.4 . † indicate trivial gating solutions.
Appendix figures & tables6 assets
Supplementary material from the paper’s appendix.
Appendix
Deploy X→Y^ (source-side: X )
Method
Acc (Obs)
Acc (Trans)
X-only
0.909±0.047
-
CMLP
0.919±0.024
0.881±0.047
NICE
0.916±0.023
0.897±0.033
Ours
0.913±0.023
0.901±0.037
Deploy Y→X^ (source-side: Y )
Appendix
Table 5: Downstream prediction under size-matched harmonized subsets. Results are reported as mean ± standard deviation over ten random seeds. Obs denotes using observed measurements in the prediction space, while Trans denotes using translated measurements obtained from the opposite view. Single-view reference (X-only / Y-only) serve as reference result.
pmiss
Method
Missing in X ( Xmiss→Y^ )
Missing in Y ( Ymiss→X^ )
#Ret
Retain
Std
#Ret
Retain
Std
0.1
Ours
9
0.860
0.097
7
0.813
0.140
NICE
8.5
0.788
0.152
7
0.877
0.121
CMLP
8
0.815
0.196
6
0.725
0.293
0.2
Ours
6.5
0.513
0.158
5.5
0.634
0.112
NICE
6.5
0.524
0.203
6
0.632
0.168
Appendix
Table 6: Robustness under MCAR missingness. For each method, #Ret denotes the median number of measurements that remain feasible under missingness. Retain denotes the retention rate relative to the reference feasible set defined at p=0 (Experiment 2). Results are reported as mean ± standard deviation across random seeds.
Data
Method
Acc X
Acc Y
JX
JY
Joverall
CCC X
CCC Y
Ours
0.915±0.023
0.900±0.000
0.948
1.000
0.974
0.738±0.014
0.754±0.063
sgen = 1
CMLP
0.890±0.037
0.900±0.000
0.896
1.000
0.948
0.768±0.019
0.758±0.014
NICE
0.850±0.000
0.805±0.047
1.000
0.824
0.912
0.722±0.013
0.745±0.013
Ours
0.830±0.056
0.755±0.042
0.783
0.812
0.797
0.574±0.033
0.619±0.049
sgen = 2
CMLP
0.810±0.037
0.710±0.030
0.848
0.722
0.785
0.612±0.023
0.678±0.024
NICE
0.550±0.032
0.605±0.035
0.400
0.544
0.472
0.668±0.043
0.648±0.016
Appendix
Table 7: Experiment 1 (Synthetic): feasibility structure recovery and stability across different data-generation seeds ( sgen∈{1,…,5} ). Acc is index-level recoverability label accuracy (mean ± std over training seeds). JX and JY are Jaccard similarities of selected recoverable subsets across training seeds; Joverall is the average of JX and JY . CCC statistics summarize agreement strength among selected measurement indices (mean ± std).
Figure 2: ε -sweep on CAS ↔ SNAP. Median number of recoverable measurements (#Rec) as a function of the feasibility threshold ε , shown separately for CAS (A) and SNAP (B). Results are aggregated over random seeds.
Direction
Method
#Ret
Ret% (mean ± std)
CCC > 0.5
CCC > 0.6
CCC > 0.7
EMBIC → NeuroBAT (target: NeuroBAT)
FRF
0
0.0±0.0
0
0
0
IRT
0
-
0
0
0
XGB
0.5
62.5±48.4
0.5
0
0
CMLP
1
90.0±10.0
1
1
0
NICE
2
49.2±10.5
2
1
0
Appendix
Table 8: Extended results for experiment 3. For each deployment direction (source → target), #Ret is the median number of retained recoverable measurements in the target space, and Ret% is the corresponding retention rate (mean ± std across random seeds), and is reported in percentage units. CCC > 0.5/0.6/0.7 report the median number of retained measurements whose concordance correlation coefficient on the test period exceeds the corresponding threshold. “-” denotes not applicable (no recoverable measurement is identified on the training period, hence retention is undefined). All results use εcutoff=0.6 .
Variant
#RecA
JA
#RecB
JB
Ours (full)
11
0.930
9
0.817
TWMLP backbone
11
0.929
9
0.947
L0 penalty
0†
-
0†
-
No gating
11
0.806
9
0.774
No hinge
27†
-
18†
-
Appendix
Table 9: Ablation results on CAS (A) ↔ SNAP (B) under εcutoff=0.6 . #Rec A /#Rec B denote median numbers of recoverable measurements. JA / JB denote Jaccard similarity across random seeds. Degenerate variants are marked with “-”.
Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong · School of Integrated Circuits and Electronics, Beijing Institute of Technology, China · Mental Health Research Center, The Hong Kong Polytechnic University, Hong Kong +1
Institute of Psychiatry, Psychology and Neuroscience, King’s College London, UK · NIHR Biomedical Research Centre: Maudsley, UK · Modality.AI Inc, San Francisco, California, USA +12
Universidad Autónoma de Madrid, Spain · Université de Bordeaux, France · Video Processing and Understanding Lab, Universidad Autónoma de Madrid, Spain +1