Quantifying Cross-Modal Interactions in Multimodal Glioma Survival Prediction via InterSHAP: Evidence for Additive Signal Integration
Organizations: Department of Computer Science, Munster Technological University, Cork, Ireland
Abstract
Multimodal deep learning for cancer prognosis is commonly assumed to benefit from synergistic cross-modal interactions, yet this assumption has not been directly tested in survival prediction settings. This work adapts InterSHAP, a Shapley interaction index-based metric, from classification to Cox proportional hazards models and applies it to quantify cross-modal interactions in glioma survival prediction. Using TCGA-GBM and TCGA-LGG data (n=575), we evaluate four fusion architectures combining whole-slide image (WSI) and RNA-seq features. Our central finding is an inverse relationship between predictive performance and measured interaction: architectures achieving superior discrimination (C-index 0.640.82) exhibit equivalent or lower cross-modal interaction (4.8%3.0%). Variance decomposition reveals stable additive contributions across all architectures (WSI40%, RNA55%, Interaction4%), indicating that performance gains arise from complementary signal aggregation rather than learned synergy. These findings provide a practical model auditing tool for comparing fusion strategies, reframe the role of architectural complexity in multimodal fusion, and have implications for privacy-preserving federated deployment.
Figures & tables
| Architecture | Params | C-Index | InterSHAP (%) | Brier@36mo |
| Early Fusion MLP | 8.8M | 0.636 0.02 | 4.82 4.65 | 0.192 |
| Cross-Attention | 1.8M | 0.814 0.01 | 3.03 2.64 | 0.156 |
| Bilinear Fusion | 0.54M | 0.819 0.01 | 3.72 3.16 | 0.151 |
| Gated Fusion | 3.2M | 0.807 0.02 | 4.45 4.94 | 0.162 |
| Architecture | C-Index | InterSHAP (%) | vs MLP (95% CI) |
| MLP (baseline) | 0.636 | 4.82 | — |
| Cross-Attention | 0.814 | 3.03 | ( ) ∗∗∗ |
| Bilinear | 0.819 | 3.72 | ( ) ∗∗ |
| Gated | 0.807 | 4.45 | ( ) |
Multimodal Fusion
Multimodal fusion combines information from different data types to improve prediction, perception, and decision-making.
See all 771 papers