cs.AISep 18, 2026

MIST: Multimodal Survival Prediction with Genomic-Guided Histology Attention

Authors: Muhammet Sami Yavuz, Sabri Mustafa Kahya, Richard R. Chen, Jana Lipkova, Benedikt Wiestler

Abstract

Multimodal survival models can combine complementary prognostic information from whole-slide images and genomic profiles, but effective fusion remains challenging amid external cohort shift and computational complexity. To address these challenges, we propose MIST, multimodal survival prediction with genomic-guided histology attention. MIST represents genomic features as tokens and allows them to query compact foundation-model-derived histology context tokens before survival prediction. This design enriches molecular information with histology context rather than merging separately encoded modalities only at the final stage. Training combines discrete-time survival prediction with genomic feature masking, WSI dropout, and paired WSI-genomics contrastive alignment. Across four external evaluations in colon, renal, lung, and glioblastoma cohorts, MIST improves external C-index over standard fusion baselines in the primary comparisons. These results support genomic-guided histology attention as a compact and effective strategy for multimodal oncology outcome prediction. Our code is available at https://github.com/samiyavuuz/MIST .

Explore similar work

CardsList
  1. Attention-Based Multimodal Survival Prediction with Cross-Modal Bilinear Fusion

    May 12, 2026Hassan Keshvarikhojasteh, Josien P. W. Pluim, Mitko VetaRepresentation LearningCancer Survival Prediction

  2. ProtoPathway: Biologically Structured Prototype-Pathway Fusion for Multimodal Cancer Survival Prediction

    May 20, 2026Amaya Gallagher-Syed, Costantino Pitzalis, Myles J. Lewis +2Cancer Survival PredictionOncology

  3. Together, Then Apart: Balancing Alignment and Distinctiveness for Multimodal Survival Analysis

    Nov 22, 2025Wenjing Liu, Qin Ren, Wen Zhang +2Cancer Survival PredictionSurvival Analysis