cs.CLNov 3, 2026

CardioVascBench:Prioritized Diagnosis Generation from Real-World Chinese Cardiovascular Records

Authors: Minghao Kong, Muyao Chen, Jianhao Wu, Yuqiang Zhang, Xiangbin Meng, Zirong Liu, Ting Cao, Kaida Ning, 

Organizations: School of Electronics and Communication Engineering, Sun Yat-sen University, Shenzhen Campus, Shenzhen, China · Department of Network Intelligence, Pengcheng Laboratory, Shenzhen, China

Abstract

Identifying the primary diagnosis alone does not fully characterize a model's diagnosis-generation performance. We introduce CardioVascBench, a retrospective benchmark for prioritized diagnosis generation from real-world Chinese cardiovascular inpatient records. It contains 3,262 de-identified cases, with 2,174 for training and 1,088 for evaluation, linking clinical narratives and textual ECG reports to expert-verified, ordered discharge diagnoses standardized to ICD-10. An English translation of the evaluation set supports aligned cross-lingual comparison. Our evaluation protocol combines terminology normalization and rank-aware scoring to separately assess primary-diagnosis identification, reference-diagnosis coverage, and list precision. Evaluation across 36 systems shows that higher primary-diagnosis accuracy does not necessarily imply higher list precision against discharge references. We also provide CardioKG-Agent, a knowledge-enhanced baseline combining entity normalization, constrained graph retrieval, and guideline evidence. In a staged comparison of three baseline models, supervised fine-tuning plus the agent achieves a 73.5% higher mean composite score than fine-tuning alone, representing a system-level gain. These results measure retrospective agreement with recorded diagnoses; agreement between metric rankings and physician judgments remains to be validated. CardioVascBench supports research on diagnosis prioritization and knowledge-enhanced generation.

Figures & tables

Appendix figures & tables14 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. CardioBench: A Real-World Data Benchmark for Evaluating Large Language Models in Clinically Authentic Cardiovascular Care Scenarios

    Jul 28, 2026Xiao Li, Mouxiao Bian, Zhaodi Wu +8HealthcareClinical Language Model Evaluation

  2. EarlyDx: An Admission-Anchored Benchmark for Open-Ended Generation of Evidence-Supported ED-Encounter Diagnoses

    Jul 30, 2026Jiahui Li, Ruili Fang, Zishuai Liu +5Medical DiagnosisClinical Prediction

  3. CardioLM: A multilingual suite of small language models for the cardiology domain

    Nov 5, 2026Manuela-Daniela Danu, Miguel Rodríguez-Ortega, Alberto Becerra-Tome +37Clinical NLPClinical Information Extraction