cs.CVMar 31, 2026

Trimodal Deep Learning for Glioma Survival Prediction: A Feasibility Study Integrating Histopathology, Gene Expression, and MRI

Authors: Iain Swift, JingHua Ye

Organizations: Department of Computer Science, Munster Technological University, Cork, Ireland

Abstract

Multimodal deep learning has improved prognostic accuracy for brain tumours by integrating histopathology and genomic data, yet the contribution of volumetric MRI within unified survival frameworks remains unexplored. This pilot study extends a bimodal framework by incorporating Fluid Attenuated Inversion Recovery (FLAIR) MRI from BraTS2021 as a third modality. Using the TCGA-GBMLGG cohort (664 patients), we evaluate three unimodal models, nine bimodal configurations, and three trimodal configurations across early, late, and joint fusion strategies. In this small cohort setting, trimodal early fusion achieves an exploratory Composite Score (CS = 0.854), with a controlled ΔΔCS of +0.011 over the bimodal baseline on identical patients, though this difference is not statistically significant (p = 0.250, permutation test). MRI achieves reasonable unimodal discrimination (CS = 0.755) but does not substantially improve bimodal pairs, while providing measurable uplift in the three-way combination. All MRI containing experiments are constrained to 19 test patients, yielding wide bootstrap confidence intervals (e.g. [0.400,1.000]) that preclude definitive conclusions. These findings provide preliminary evidence that a third imaging modality may add prognostic value even with limited sample sizes, and that additional modalities require sufficient multimodal context to contribute effectively.

Figures & tables

Explore similar work

CardsList
  1. Trimodal Glioma Representation Alignment via Volumetric Contrastive Learning

    Jun 12, 2026Denise Marini, Eleonora Grassucci, Danilo ComminielloCancer Survival PredictionCross-Modal Alignment

  2. Multimodal Brain Tumour Classification Using Feature Fusion

    Jun 9, 2026Wajih ul Islam, Muhammad Yaqoob, Javed Ali Khan +1Multimodal ClassificationMedical Image Classification

  3. Quantifying Cross-Modal Interactions in Multimodal Glioma Survival Prediction via InterSHAP: Evidence for Additive Signal Integration

    Mar 31, 2026Iain Swift, JingHua Ye, Ruairi O'ReillyMultimodal FusionMultimodal Survival Analysis