Toward Complete Hospital Discharge Summarization with Abstract Meaning Representation
Organizations: Department of Computer Science University of Illinois Chicago Chicago, USA · College of Medicine University of Illinois Chicago Chicago, USA
Abstract
Discharge summaries are lengthy medical documents that summarize a hospital in-patient visit. Automatically generating them can reduce documentation burden and return clinician time to patient care. Whereas Large Language Model (LLMs) could be used for this task, their Achilles heel is hallucinations, which can have drastic consequences for clinical documentation. We present an evidence-driven alignment framework for discharge summarization at the clinical encounter level, that treats provenance as a first-class constraint, using semantic graphs and deep learning models. Each summary sentence is selected and organized via cross-document semantic alignment and is accompanied by explicit evidence links to its source spans. We show our results on two corpora: a publicly available corpus (MIMIC-III) and clinical notes written by physicians at the University of Illinois Hospital (UIC Health). Additionally, we make source code and trained models available.
Figures & tables
| Description | MIMIC-III | UICSDS |
|---|---|---|
| Average alignable in source | 827 | 1,228 |
| Average aligned in source | 570 | 975 |
| Average reentrancies in source | 17 | 30 |
| Average alignable in summary | 819 | 768 |
| Average aligned in summary | 482 | 632 |
| Average reentrancies in summary | 34 | 20 |
| MIMIC-III | UIC Health Summarization Dataset | |||||
| Section | Tr | Te | Va | Tr | Te | Va |
| no-section | 64K | 8K | 8K | 14K | 2K | 1K |
| Addendum | 68 | 6 | 9 | 555 | 66 | 57 |
| Assessment and plan | - | - | - | 84 | 5 | 44 |
| Chief complaint | - | - | - | 23 | 2 | 1 |
| Discharge condition | 147 | 21 | 17 | 8 | 1 | 1 |
| Metric | MIMIC-III | UICSDS |
|---|---|---|
| Weight F1 | 88.72 | 83.52 |
| Weight Precision | 88.99 | 84.23 |
| Weight Recall | 89.52 | 84.3 |
| Micro F1 | 89.52 | 84.3 |
| Micro Precision | 89.52 | 84.3 |
| Micro Recall | 89.52 | 84.3 |
| Category | MIMIC-III | UICSDS |
|---|---|---|
| Preference | 1 | 1 |
| Readability | 3.05 | 2.4 |
| Correctness | 5 | 5 |
| Complete | 1 | 1.6 |
| Sections | 1 | 1.6 |
Medical Report Generation
Medical report generation turns medical images, clinical records, or conversations into structured, clinically useful reports.
See all 82 papers