Ref-MIL: Plug-and-Play Posterior Refinement for Multiple Instance Learning in QSM-Based Brain Disease Classification
Authors: Ang Gaoa, Rui Jina, Yin Liu, Pengfei Rong, Feng Liu, G. Bruce Pike, Hongfu Sun, Yang Gao
Organizations: School of Computer Science and Engineering, Central South University, Changsha, China · Department of Radiology, The Third Xiangya Hospital, Central South University, Changsha, China · School of Electrical Engineering and Computer Science, University of Queensland, Brisbane, Australia · Departments of Radiology and Clinical Neurosciences, Hotchkiss Brain Institute, University of Calgary, Calgary, Canada · School of Engineering, University of Newcastle, Newcastle, Australia
Quantitative susceptibility mapping (QSM) is a novel quantitative MRI contrast for studying tissue susceptibility changes in brain disorders, including Parkinson's disease (PD) and multiple sclerosis (MS). However, small cohorts and the lack of local annotations make developing deep learning models for QSM-based diagnosis challenging. In this work, we propose PoRef-MIL, a weakly supervised multiple instance learning (MIL) framework combining iterative slice relabeling and network retraining with a plug-and-play posterior refinement module (PRM). During training, a 2D dual-branch diagnosis network and a subject-level classifier were alternately trained for five rounds. The classifier was used to update slice pseudo-labels for retraining the diagnosis network. The PRM was applied during inference to refine slice probabilities through bidirectional posterior inference and calculate entropy-derived confidence from the refined probabilities, which was then used in sliding-window scoring to obtain subject-level predictions. PoRef-MIL was evaluated on an in-house PD cohort of 287 participants and a public MS cohort of 150 participants. Compared with eight classification methods, PoRef-MIL achieved the highest mean areas under the receiver operating characteristic curve of 0.942 and 0.872, and accuracies of 0.926 and 0.833, for PD and MS classification, respectively. Ablation experiments were conducted to validate the effectiveness of iterative relabeling and PRM, and the plug-and-play feature of the proposed PRM was also evaluated using four state-of-the-art MIL models. Overall, PoRef-MIL offers a promising approach to QSM-based disease classification in small cohorts without manual slice annotations.
Figures & tables
Figure 1: Overview of the 2D dual-branch diagnosis network and its iterative training in PoRef-MIL. (a) In the 2D diagnosis network, each 2D QSM slice is processed by four feature extraction blocks (FEBs), followed by max pooling and slice-level classification. (b) Each FEB block fuses the features from the transformer-based and convolutional branches through cross-attention. (c) Latent features extracted from all 2D slices within a 3D volume are processed by self-attention along the slice direction, and slice scores are then aggregated using attention weights to compute a bag-level focal loss under subject-level supervision. Pseudo-labels derived from these scores are used to retrain the diagnosis network and update the FEB for the next relabeling round. This cycle is repeated for K rounds.
Figure 2: Posterior Refinement Module (PRM) in the proposed PoRef-MIL inference framework. The 3D QSM volumes are treated as a consecutive series of 2D slices, which are fed into the pretrained 2D dual-branch diagnosis network to obtain initial slice probabilities. The slice probabilities and states are then refined using a bidirectional posterior refinement module. After the refinement, entropy-derived confidence is calculated from these probabilities and used in sliding-window scoring to determine the final subject-level predictions.
Characteristics
PD dataset
MS dataset
HC
PD
HC
MS
Participant Counts:
131
156
50
100
Age (years) 1
59.4±8.34
60.7±8.08
57.1±16.7
47.6±11.4
Gender (M/F) 2
55 / 76
81 / 75
19 / 31
42 / 58
Table 1: Demographic characteristics of the PD and MS cohorts
Method
AUC
ACC
SEN
SPE
F1 Score
PD dataset
AG-SE-ResNeXt50 ( Wang et al., 2023 )
0.893±0.002∗∗
0.846±0.015∗∗
0.858±0.018∗∗
0.831±0.021∗∗
0.858±0.014∗∗
MMRN ( Han et al., 2023 )
0.899±0.002∗∗
0.860±0.012∗∗
0.832±0.014∗∗
0.892±0.032∗
0.866±0.010∗∗
CAAE + CRAT ( Cobbinah et al., 2022 )
0.903±0.003∗∗
0.870±0.020∗∗
0.858±0.018∗∗
0.885±0.027∗
0.878±0.019∗∗
DenseFormer-MoE ( Ding et al., 2025 )
0.906±0.001∗∗
0.856±0.015∗∗
0.813±0.014∗∗
0.908±0.021
0.860±0.014∗∗
PMIL ( Yan et al., 2024 )
0.890±0.013∗∗
0.853±0.010∗∗
0.865±0.014∗∗
0.838±0.017∗∗
0.865±0.009∗∗
Table 2: Comparison of the Proposed PoRef-MIL with Eight State-of-the-Art Methods on PD and MS Datasets
Model Configurations
PD dataset
MS dataset ( Fiscone et al., 2024 )
AUC
ACC
F1 Score
AUC
ACC
F1 Score
AttriMIL w/o PRM
0.912±0.002
0.874±0.008
0.884±0.007
0.820±0.010
0.780±0.018
0.840±0.015
AttriMIL + PRM
0.920±0.003
0.888±0.010
0.898±0.008
0.844±0.012
0.807±0.028
0.859±0.021
DA-MIDL w/o PRM
0.914±0.002
0.867±0.010
0.876±0.009
0.802±0.033
0.773±0.043
0.823±0.035
DA-MIDL + PRM
0.924±0.003
0.891±0.015
0.899±0.014
0.834±0.015
0.807±0.028
0.850±0.022
PMIL w/o PRM
0.890±0.013
0.853±0.010
0.865±0.009
0.790±0.021
0.740±0.028
0.810±0.021
Table 3: Plug-and-play Effectiveness of the Proposed Posterior Refinement Module (PRM) Across the Five MIL Models
Figure 3: Comparison of receiver operating characteristic (ROC) curves of the proposed PoRef-MIL with the other methods on PD (a) and MS (b) test sets, with corresponding confusion matrices of PoRef-MIL results (mean ± standard deviation across the five trained models) shown on the right.
Figure 4: Grad-CAM maps and slice-level predictions for representative PD (a, b) and MS (c, d) subjects. (a) and (c) show Grad-CAM maps overlaid on the original QSM slices, with warmer colors indicating stronger contributions. (b) and (d) show the initial slice-level abnormality probability distributions, with red and blue dots indicating slices predicted as abnormal and healthy, respectively. The red and blue dashed step lines represent the corresponding slice states after PRM, with shaded intervals marking slices 45 to 77 in the PD subject and slices 63 to 76 in the MS subject. Purple dashed curves indicate entropy-derived confidence calculated from the refined slice-level probabilities. (e) shows additional coronal and sagittal Grad-CAM heatmaps for a PD subject and an MS subject, respectively, generated using separately trained models.
K
AUC
ACC
F1 Score
PD dataset
– a
0.912±0.002
0.895±0.012
0.903±0.012
0
0.667±0.027
0.639±0.016
0.673±0.012
1
0.913±0.006
0.877±0.018
0.888±0.015
2
0.924±0.005
0.898±0.015
0.906±0.014
3
0.932±0.005
0.909±0.015
0.916±0.013
Table 4: Classification Performance with Conventional MIL and Different Iterative Slice Relabeling Rounds
Inputs
AUC
ACC
F1 Score
PD dataset
T1w
0.908±0.012
0.898±0.015
0.906±0.014
QSM
0.942±0.002
0.926±0.008
0.932±0.008
T1w+QSM
0.964±0.004
0.944±0.015
0.949±0.013
MS dataset
T1w
0.844±0.030
0.800±0.053
0.848±0.040
Table 5: Single-modality and multimodal classification with PoRef-MIL
Figure 5: Comparison of the numbers of model-predicted abnormal slices between healthy controls (HCs) and patients in the (a) PD and (b) MS test sets. Percentages indicate the mean proportion of predicted abnormal slices among all analyzed slices per subject (128 slices for PD and 96 slices for MS).
Age Input
AUC
ACC
F1 Score
PD dataset
w/ FiLM
0.931±0.006
0.916±0.008
0.921±0.008
w/o Age
0.942±0.002
0.926±0.008
0.932±0.008
MS dataset
w/ FiLM
0.860±0.032
0.813±0.061
0.854±0.049
w/o Age
0.872±0.034
0.833±0.053
0.871±0.042
Table 6: Evaluation of FiLM-based Age Conditioning in PoRef-MIL