Radiology Report Evaluation

Overview

The field develops ways to score report-generation and report-review systems for clinical accuracy, completeness, and harmful errors—not just similarity to a reference report. Approaches include finding-level extraction and matching, clinical graphs, question answering and entailment, severity-aware LLM judges, and direct radiologist review. Benchmarks span chest X-rays, CT, PET, MRI, and longitudinal reports, with growing attention to spatial grounding, report-writing conventions, and whether findings are supported by images. A central tension is that fluent reports and high text-overlap scores can conceal omissions or unsupported claims, while more clinically aligned metrics still need to be transparent, consistent, and validated across settings.

Latest papers

CardsList

37 papers5 papers in the last four weeks, down 17% on the four weeks before. 0.0% of all new papers.

  1. TransXplainRRG: A Radiologist-Evaluated LVLM for Chest Radiograph Report Generation

    Nov 12, 2026Chayan Mondal, Duc-Son Pham, Tele Tan +4Radiology Report GenerationRadiology VLMs

  2. RadRef: A Reference-Free Metric for Radiology Report Generation

    Nov 9, 2026Shelly Schwartz, Alan Ropp, Michael B. Sneider +3Radiology Report EvaluationRadiology Report Generation

  3. A Clinical Evaluation of Conformal Prediction for Chest Radiograph Report Generation

    Nov 6, 2026Nikolaos Kontogeorgis, Pascal Krezer, Klaus-Rudolf Kladny +5Radiology Report GenerationRadiology Report Evaluation

  4. Adversarial Evaluation of Large Language Models for Patient-Friendly Radiology Report Summarization

    Nov 6, 2026Magdalini Paschali, Asad Aali, Arogya Koirala +6Clinical Language Model EvaluationAdversarial Robustness of Language Models

  5. Retrieval-Grounded Multi-View Reasoning for Clinically Reliable Radiology Report Generation

    Nov 3, 2026Wanshu Fan, Zeyu Wang, Zheng Tong +8Radiology Report GenerationRetrieval-Augmented Generation

  6. From Sampled Evidence to Radiology Reports: Objectives, Constraints, and Realization

    Oct 12, 2026Kun Zhao, Haoteng Tang, Chenghua Lin +1Radiology Report GenerationEvidence-Grounded Generation

  7. Unmentioned Checklist Findings Change How Reinforcement Learning Appears to Improve Chest Radiograph Report Checking

    Oct 4, 2026Ali Vosoughi, Akhil Kasturi, Chenliang Xu +1Radiology VLMsRadiology Report Evaluation

  8. Autonomous Structuring of Radiology Reports Across Modalities at Archive Scale Using an Open-Weight Large Language Model

    Oct 3, 2026Friedrich Puttkammer, Fabian Drexel, Marlene Fritzsche +19Medical Report GenerationRadiology Report Generation

  9. QureRadEmbed: Structuring Radiological Similarity through Attribute and Reasoning Supervision

    Sep 27, 2026Janhavi Prabhu, Sahil, Shivam Ashok Shukla +1Clinical NLPContrastive Learning

  10. Can Jev Judge Radiology Reports? Evaluating a System One Model for Clinical Factuality

    Sep 23, 2026Jiaju Huang, Hao Yang, Xinyu Ma +6Radiology Report GenerationLLM-as-a-Judge

  11. Reporting Practice Matters: The Impact of Reference Choice on Chest X-ray Report Evaluation

    Sep 16, 2026Daniel P. Jeong, Charles Q. Li, Hossein Hosseiny +5Radiology Report GenerationGenerative AI Evaluation

  12. Clinical Reasoning Under a Partially Observed Objective in Cone Beam CT Report Generation

    Sep 2, 2026Ajo Babu George, Govind Arun, Sidharth N Krishna +1CT Report GenerationRadiology Report Generation

  13. RadMatch: Auditable Radiology Report Evaluation via Finding-Level Matching

    Sep 1, 2026Charles Corbière, Léo Machado, Aubin Charley +3LLM-as-a-JudgeMedical Image Benchmarks

  14. A multicenter benchmark and clinically structured metric for coronary CTA report generation

    Sep 1, 2026Zhiyu Ye, Yue Sun, Limiao Zou +7VLM EvaluationRadiology Report Generation

  15. Error Detection for PET/CT Radiology Reports: Domain-Specific vs Large Language Models

    Aug 30, 2026Hermione Warr, Harry Anthony, Lilli J Freischem +3LLM EvaluationPET/CT Imaging

  16. Multi-Agent AI System for Radiology Report Structuring and Quality Assurance with Independent Radiologist Evaluation

    Aug 18, 2026Iryna Hartsock, Cesar Lam, Christopher Otteni +4Radiology Report EvaluationMulti-Agent Systems

  17. Beyond Fluency: A Clinical Benchmark and Anomaly-Enhanced Baseline for Spine MRI Report Generation

    Aug 7, 2026Bruno Palau, Franziska Vogt, Daria Laslo +4VLM EvaluationRadiology Report Generation

  18. Prospective clinical indication, post-hoc report leakage, and fusion design in multi-image chest radiograph classification: a patient-clustered evaluation

    Jul 15, 2026Kamran Shahid, Muhammad Munwar Iqballabel leakageData Leakage

  19. SHOVIR: A Benchmark for Evaluating Vision Shortcut Learning in Radiology Report Generation

    Jun 29, 2026Filippo Ruffini, Marco Salmé, Rosa Sicilia +2VLM EvaluationRadiology Report Generation

  20. Beyond Scalar Scores: Exploring LLM-based Metrics for Clinical Significance Evaluation in Radiology Reports

    Jun 17, 2026Qingyu Lu, Ruochen Li, Liang Ding +3Clinical Language Model EvaluationLanguage Model Robustness

  21. ReportQA: QA-Based Radiology Report Evaluation

    Jun 13, 2026Yiming Shi, Shaoshuai Yang, Xi Chen +10Radiology Report GenerationMedical VLMs

  22. RadOT-Eval: Auditable Structured-Evidence Transport for Radiology Report Evaluation

    Jun 7, 2026Weixin Liu, Juming Xiong, Yang Li +5Radiology Report GenerationAutomated Evaluation

  23. RadSEM: A Finding-by-Finding Metric for Clinical Consistency in Radiology Reports

    Jun 3, 2026Zhenhong Yang, Zhuoyun Liu, Jintao Fei +4Factual Consistency EvaluationAutomated Evaluation

  24. CT-FineBench: A Diagnostic Fidelity Benchmark for Fine-Grained Evaluation of CT Report Generation

    Apr 27, 2026Ruifeng Yuan, Wanxing Chang, Weiwei Cao +4Radiology Report EvaluationMedical Report Generation

  25. CXRMate-2: Structured Multimodal Temporal Embeddings and Tractable Reinforcement Learning for Clinically Acceptable Chest X-ray Radiology Report Generation

    Apr 21, 2026Aaron Nicolson, Elizabeth J. Cooper, Hwan-Jin Yoon +7Radiology Report GenerationRadiology VLMs

  26. Enhancing Fine-Grained Spatial Grounding in 3D CT Report Generation via Discriminative Guidance

    Apr 12, 2026Chenyu Wang, Weicheng Dai, Han Liu +2Radiology Report GenerationCT Report Generation

  27. Towards Better Aligned LLM Judges for Radiology Report Evaluation across Modalities and Anatomies

    Apr 3, 2026Federica Bologna, Jean-Philippe Corbeil, Matthew Wilkens +1LLM-as-a-JudgeRadiology Report Evaluation

  28. Blinded Radiologist and LLM-Based Evaluation of LLM-Generated Japanese Translations of Chest CT Reports: Comparative Study

    Apr 2, 2026Yosuke Yamagishi, Atsushi Takamatsu, Yasunori Hamaguchi +4Radiology Report EvaluationMT Evaluation