Large language models as oncology world models
Organizations: Institute for Medical AI (IMAI), Heidelberg University Hospital and Medical Faculty of Heidelberg University, Heidelberg, Germany. · Medical Oncology, National Center for Tumor Diseases (NCT), University Hospital Heidelberg, Heidelberg, Germany. · Drug Development Department, Gustave Roussy, Villejuif, France. · Université Paris-Saclay, Gustave Roussy, INSERM U1361, IHU PRISM, Villejuif, France. ·
Abstract
Large language models (LLMs) can synthesize cancer patient cases, but their internal representation of oncology, or world model, has not been explored systematically. By only specifying tumor type, we show that LLMs tend to generate similar patients per cancer, with on average 81.0% to 93.2% of a cancer's patients sharing the most frequent value of each baseline feature. By systematically varying patient features in 12 clinical scenarios, we show that they follow biomarker and treatment logic in 29 of 36 model-scenario assessments, against 1 of 12 when previous treatment or frailty matters. Continuing real patient trajectories, an LLM predicted 89.9% 12-month survival, and 79.2% with similar patients as examples, against 72.2% observed. To represent these trajectories, we developed the Clinical State Space, a dynamic representation framework that we also applied to real patients. Despite the limits we show, improved world models may support digital twins, which our framework can evaluate.
LLM World Models
Large language model world models predict how environments change so agents can plan, learn, and evaluate actions before execution.
See all 38 papers