cs.LGMay 5, 2026

Enhance the after-discharge mortality rate prediction via learning from the medical notes

Authors: Zijiang Yang

Organizations: University of Texas at Austin, Austin TX 78712, USA

Abstract

With the increase of the Electronic Health Records (EHR) data, more and more researchers are developing machine learning models to learn from the medical notes. These unstructured text data pose significant challenges on the learning process as the quality of data is low. These data are often messy, repetitive and redundant. We have shown these notes data to be informative by conducting the after-discharge mortality rate prediction task. The AUC-ROC for models using the medical note information is generally 0.1 higher than those without the medical notes. Furthermore, we propose the Deep Neural Network(DNN) model with 'pooling' mechanism to enhance the mortality prediction. Based on the experimental results, we demonstrate that the proposed model outperforms the traditional machine learning models like the tree-based models. The proposed method learns from the most informative medical notes and improves the prediction accuracy significantly. The AUC-ROC for the proposed model is 2% to 14% higher than the traditional ones in 15-days, 30-days, 60-days, 365-days after-discharge mortality prediction tasks. Moreover, we can discover some interesting knowledge through the traditional and proposed models. These knowledge are inspiring but also consistent with the previous findings. The models are able to reveal the relationships between the informative keywords and documents from the medical notes and the severity of the patients.

Explore similar work

Sep 14, 2026cs.LG

Knowledge-Enriched Structured EHR Features for 30-Day Hospital Readmission Prediction on MIMIC-IV

Recent approaches to 30-day hospital readmission prediction rely on pre-trained language models applied to discharge summaries. Although these methods achieve strong performance, they depend on the availability of clinical notes, incur substantial computational costs, and yield representations that lack interpretability. We propose a knowledge-enriched feature representation that augments structured Electronic Health Record (EHR) data with four medical knowledge sources: disease ontology mapping, procedure classification, drug ingredient vocabulary, and organ system laboratory aggregation, without using clinical notes. Each feature dimension corresponds to a named clinical concept, yielding a sparse and interpretable patient representation. The approach is evaluated with six classifiers on a MIMIC-IV v2.2 cohort. Under 20-fold cross-validation, the best configuration achieves an AUROC of 0.743. This performance is comparable to that of previously reported methods on this dataset, including both those using only structured data and those incorporating clinical notes, while requiring considerably less computational cost. Interpretability analysis shows that demographics, organ system labs, drug ingredient features, and first-level ontology disease categories drive prediction, while deeper hierarchy levels contribute negligibly. These findings indicate that knowledge-enriched structured features offer a competitive and efficient alternative to embeddings from clinical notes for 30-day readmission prediction.
Mohamad Najafi, Hongyun Fu, Mathias Brochhausen +2
Aug 5, 2026cs.LG

MiGHT-EHR: A Multi-task Graph Transformer for Heterogeneous Temporal Electronic Health Records

Learning from Electronic Health Records (EHRs) has gained significant attention due to its potential to improve clinical prediction. However, effective learning remains challenging because EHRs encode heterogeneous, temporally ordered clinical interactions. In particular, EHRs contain: (i) heterogeneous clinical entities, including patients, visits, diagnoses, prescriptions, and procedures, together with their heterogeneous interactions, (ii) longitudinal patient trajectories across hospital visits and (iii) shared statistical dependencies across related clinical prediction tasks. Existing EHR learning methods capture only a subset of these properties. To bridge this gap, we propose Multi-task Graph transformer for Heterogeneous Temporal EHRs (MiGHT-EHR), which jointly models all three within a unified representation learning method. MiGHT-EHR constructs a heterogeneous graph from EHRs in which nodes represent clinical entities and edges connect statistically associated entities identified via normalized point-wise mutual information. Across MIMIC-III and MIMIC-IV datasets, MiGHT-EHR outperforms state-of-the-art methods on average across four tasks: drug recommendation, prediction of length-of-stay, mortality, and readmission, with particularly strong improvements in mortality and readmission prediction. Furthermore, a post-hoc analysis of the learned representations reveals that patient neighborhoods are organized by clinical outcomes, salient medical concepts are recoverable as linear directions in the representation space, and task probabilities are well calibrated. Collectively, these findings demonstrate that MiGHT-EHR representations support diverse prediction tasks while preserving clinically interpretable structure.
Anirudh Rayas, Yuan Wang, Pavan Turaga
Aug 9, 2026cs.LG

A Domain-Structured Ensemble Framework for Perioperative Outcome Prediction Using Electronic Health Record Data

Perioperative risk prediction models are often limited by narrow surgical populations, incomplete intraoperative data, poor calibration, and limited interpretability. We present a domain-structured ensemble framework for perioperative outcome prediction using routinely collected electronic health record (EHR) data. Predictors are organized into patient-related, surgery-related, and anesthetics-related domains. Domain-specific gradient boosting models generate independent risk estimates that are integrated through a logistic regression meta-learner. We demonstrate the framework using postoperative delirium (POD) in a case-control sample of 5,386 surgical encounters (2,693 cases, 2,693 controls) from a statewide health information exchange. POD required both delirium-related ICD codes and a positive Confusion Assessment Method screening within seven postoperative days; patients with preexisting dementia were excluded. The stacked meta-learner achieved AUROC 0.899 (95% CI: 0.891-0.906), precision-recall AUC 0.881, and Brier score 0.126, compared with AUROC 0.849 for the best single-stage model. Domain ablation showed improved discrimination and calibration over a surgery-only model (AUROC 0.879, Brier 0.140). Temporal validation on held-out post-2017 data yielded AUROC 0.915. Calibration was excellent, with intercept -0.006 (95% CI: -0.083 to 0.070) and slope 1.035 (95% CI: 0.982 to 1.088). Decision curve analysis, corrected for case-control sampling, showed positive net benefit across clinically plausible thresholds. The modular framework supports alternative outcomes, extension of predictor domains, and dynamic risk updating, providing a scalable foundation for interpretable, calibration-aware perioperative clinical decision support.
Shikhar Shukla, Cristina Barboi