Learning from Limited and Incomplete Data: A Multimodal Framework for Predicting Pathological Response in NSCLC
Organizations: Unit of Artificial Intelligence and Computer Systems, Department of Engineering, Università Campus Bio-Medico di Roma, Rome, Italy · Fondazione Policlinico Universitario Campus Bio-Medico, Rome, Italy · Department of Medicine and Surgery, Università Campus Bio-Medico di Roma, Rome, Italy · Department of Diagnostics and Intervention, Radiation Physics, Biomedical Engineering, Umeå University, Umeå, Sweden
Abstract
Major pathological response (pR) following neoadjuvant therapy is a clinically meaningful endpoint in non-small cell lung cancer, strongly associated with improved survival. However, accurate preoperative prediction of pR remains challenging, particularly in real-world clinical settings characterized by limited data availability and incomplete clinical profiles. In this study, we propose a multimodal deep learning framework designed to address these constraints by integrating foundation model-based CT feature extraction with a missing-aware architecture for clinical variables. This approach enables robust learning from small cohorts while explicitly modeling missing clinical information, without relying on conventional imputation strategies. A weighted fusion mechanism is employed to leverage the complementary contributions of imaging and clinical modalities, yielding a multimodal model that consistently outperforms both unimodal imaging and clinical baselines. These findings underscore the added value of integrating heterogeneous data sources and highlight the potential of multimodal, missing-aware systems to support pR prediction under realistic clinical conditions.
Figures & tables
| Experiment | TNR (%) | TPR (%) | BA (%) | MCC (%) |
| Unimodal Imaging | 65.38 | 50.36 | 57.87 | 16.50 |
| Unimodal Clinical | 74.87 | 52.50 | 63.68 | 27.86 |
| Unimodal Missing-Aware Clinical | 75.00 | 58.93 | 66.96 | 34.45 |
| Multimodal | 76.67 | 61.79 | 69.23 | 39.13 |