Healthcare

Follow this topic Ask about this topic

Healthcare AI uses patient records, medical images, signals, and conversations to support tasks such as diagnosis, risk prediction, treatment planning, and care coordination. Common approaches include supervised learning, multimodal foundation models, retrieval-augmented generation, knowledge graphs, and reinforcement learning. Systems are tested on resources such as MIMIC-IV, MedQA, and CheXpert, as well as through clinician studies and workflow evaluations. A central challenge is that strong benchmark results do not guarantee safe, fair, reliable performance with incomplete information, changing clinical settings, or real patients, so prospective validation and careful governance remain essential.

Latest papers

622 papers24 papers in the last four weeks, down 40% on the four weeks before. 0.1% of all new papers.

Health-ORSC-Bench: A Benchmark for Measuring Over-Refusal and Safety Completion in Health Context
Jan 25, 2026Zhihao Zhang, Liting Huang, Guanghao Wu +3LLM Safety Benchmarks Language Model Safety Evaluation
Macquarie University1 · UTS2 · MBZUAI3 +1
SycoEval-EM: Sycophancy Evaluation of Large Language Models in Simulated Clinical Encounters for Emergency Care
Jan 23, 2026Dongshen Peng, Yi Wang, Austin Schoeffler +5LLM Sycophancy Language Model Safety Evaluation
UNC Chapel Hill · University of Waterloo · Stanford University
Towards Reliable Medical LLMs: Benchmarking and Enhancing Confidence Estimation of Large Language Models in Medical Consultation
Jan 22, 2026Zhiyao Ren, Yibing Zhan, Siyuan Liang +3Healthcare Clinical Reasoning
Nanyang Technological University, Singapore, Singapore. · Wuhan University, Wuhan, China.
LifeAgentBench: Benchmarking LLMs for Long-Horizon, Cross-Dimensional Lifestyle Health Reasoning
Jan 20, 2026Ye Tian, Zihao Wang, Onat Gungor +2Healthcare Long-Horizon Agent Evaluation
University of California San Diego, La Jolla, CA, USA · Google Research, Mountain View, CA, USA
RubRIX: Rubric-Driven Risk Mitigation in Caregiver-AI Interactions
Jan 19, 2026Drishti Goel, Jeongah Lee, Qiuyue Joy Zhong +5Language Model Safety Evaluation LLM Safety Evaluation
University of Illinois Urbana-Champaign · University of Massachusetts Amherst · OSF HealthCare +1
Imaging-anchored multiomics in cardiovascular disease: integrating cardiac imaging, bulk, single-cell, and spatial transcriptomics
Jan 10, 2026Minh H. N. Le, Thanh-Huy Nguyen, Tao Li +7Multimodal Fusion Spatial Transcriptomics
International Ph.D. Program in Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan · AIBioMed Research Group, Taipei Medical University, Taipei, Taiwan · Computational Biology Department, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, USA +6
EpiQAL: Benchmarking Large Language Models in Epidemiological Question Answering and Reasoning
Jan 6, 2026Mingyang Wei, Dehai Min, Zewen Liu +8LLM Evaluation Healthcare
1Emory University · University of Illinois Chicago · 3Microsoft
MAPLE: Medical Aspect-Based Summarization with Phrase-Level Evidence
Jan 6, 2026Bohao Chu, Hendrik Damm, Tabea M. G. Pakull +5Healthcare Text Summarization
University of Duisburg-Essen · University of Applied Sciences and Arts Dortmund · University Hospital Essen +1
ELF: A Family of Encoder-Free ECG-Language Models
Jan 5, 2026William Han, Tony Chen, Chaojing Duan +6Healthcare Electrocardiography
Carnegie Mellon University, USA · Allegheny Health Network, USA · University of California, Los Angeles, USA +1
Safety boundary maintenance in consumer AI systems responding to pediatric health queries: a cross-platform benchmark evaluation under naturalistic and adversarially pressured conditions
Dec 26, 2025Vahideh Zolfaghari, Leila Mashhadi, Mitra Ahadi +2Healthcare LLM Safety
Medical Sciences Education Research Center, Mashhad University of Medical Sciences, Mashhad, Iran. · Student Research Committee, Department of Health Information Technology and Management, Medical Informatics, School of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran. · Department of Anesthesiology and Intensive Care, Mashhad University of Medical Sciences, Mashhad, Iran. +2
Context-Aware Classification and Grading of Sensitive Information in Online Conversational Health Data
Dec 25, 2025Yiwei Yan, Guanfeng LiuHealthcare Text Classification
School of Computing, Macquarie University, Australia
Ophiuchus: Incentivizing Tool-augmented "Think with Images" for Joint Medical Segmentation, Understanding and Reasoning
Dec 16, 2025Yankai Jiang, Yujie Zhang, Peng Zhang +5Image Segmentation Tool Use in VLMs
Zhejiang University · Shanghai Artificial Intelligence Laboratory · Shanghai Innovation Institute +5
An Agentic AI System for Multi-Framework Communication Coding
Dec 9, 2025Bohao Yang, Rui Yang, Joshua M. Biro +14Healthcare Clinical Information Extraction
Department of Biostatistics and Bioinformatics, Duke School of Medicine, Durham, NC, USA · Centre for Quantitative Medicine, Duke-NUS Medical School, Singapore, Singapore · Medstar Health National Center for Human Factors in Healthcare, Washington, DC, USA +5
CLARITY: Medical World Model for Guiding Treatment Decisions by Modeling Context-Aware Disease Trajectories in Latent Space
Dec 8, 2025Tianxingjian Ding, Yuanhao Zou, Chen Chen +2Disease Progression Modeling Healthcare
Institute of Artificial Intelligence, University of Central Florida
JEEVHITAA -- An HCAI Ecosystem to Support Collective Care
Dec 6, 2025Shyama Sastha Krishnamoorthy Srinivasan, Harsh Pala, Mohan Kumar +1Healthcare Clinical Decision Support
IIIT-Delhi New Delhi, India · RIT, NY Rochester, New York, US
Multilingual Medical Reasoning for Question Answering with Large Language Models
Dec 5, 2025Pietro Ferrazzi, Aitor Soroa, Rodrigo AgerriKnowledge Augmentation for Language Models Healthcare
Fondazione Bruno Kessler, Trento, Italy · HiTZ Center - Ixa, University of the Basque Country EHU, Spain
6 Fingers, 1 Kidney: Natural Adversarial Medical Images Reveal Critical Weaknesses of Vision-Language Models
Dec 3, 2025Leon Mayer, Piotr Kalinowski, Caroline Ebersbach +6VLM Evaluation VLM Robustness
German Cancer Research Center (DKFZ) Heidelberg, Division of Intelligent Medical Systems, Germany. · Medical Faculty, Heidelberg University, Germany. · Faculty of Mathematics and Computer Science, Heidelberg University, Germany. +9
First, do NOHARM: a medical safety benchmark and randomized study of physician and AI teaming on clinical consultations
Dec 1, 2025David Wu, Fateme Nateghi Haredasht, Saloni Kumar Maharaj +54Healthcare Clinical Decision Support
Generalised Medical Phrase Grounding
Nov 30, 2025Wenjun Zhang, Shekhar S. Chandra, Aaron NicolsonRadiology VLMs Healthcare
The University of Queensland, Brisbane, Australia · Australian e-Health Research Centre, CSIRO Health and Biosecurity, Australia
Auditable Context-Aware HFMD Forecasting with Structured LLM Agents
Nov 28, 2025Joongwon Chae, Runming Wang, Chen Xiong +5Epidemic Forecasting Explainable Time Series Forecasting
Institute of Biomedicine and Health Engineering, Tsinghua Shenzhen International Graduate School (SIGS), Tsinghua University, Shenzhen, China · The First Hospital of Hebei Medical University, Shijiazhuang, China · The Fifth Affiliated Hospital of Wenzhou Medical University, Lishui 323000, China +1
MedBayes-Lite: A Clinical Uncertainty Governance Layer for Risk-Aware Medical Decision Support
Nov 20, 2025Elias Hossain, Md Mehedi Hasan Nipu, Maleeha Sheikh +5Selective Prediction Healthcare
College of Engineering and Computer Science, University of Central Florida, Orlando, FL 32816, USA · Department of Computer Science and Engineering, North South University, Dhaka 1229, Bangladesh · Department of Electrical and Computer Engineering, Purdue University Fort Wayne, Fort Wayne, IN 46805, USA +4
MedGEN-Bench: A Contextually Entangled Benchmark for Open-ended Multimodal Medical Generation
Nov 17, 2025Junjie Yang, Yuhao Yan, Gang Wu +12Healthcare Multimodal Generation
South China University of Technology · Sun Yat-sen University · Hangzhou Dianzi University +10
Generative AI Purpose-built for Social and Mental Health: A Real-World Pilot
Nov 12, 2025Thomas D. Hull, Lizhe Zhang, Caitlin A. Stamatis +2Healthcare Mental Health
Slingshot AI · CREATIV Lab, Department of Psychiatry and Behavioral Sciences, University of Washington · Department of Psychiatry, NYU School of Medicine +1
Towards Cellular-Scale Interpretability in Pathology Foundation Models for Biomarker Assessment
Nov 7, 2025Jingsong Liu, Han Li, Zhengyang Xu +19Computational Pathology Healthcare
Institute of Pathology, Technical University of Munich, Munich, Germany · Munich Center for Machine Learning (MCML), Munich, Germany · Munich Data Science Institute (MDSI), Munich, Germany +6
AyurParam: A State-of-the-Art Bilingual Language Model for Ayurveda
Nov 4, 2025Sravan Gorugantu, Mohd Nauman, Vijay Devane +7Medical LLMs Healthcare
BharatGen Team
An Explanation-oriented Inquiry Dialogue Game for Expert Collaborative Recommendations
Nov 3, 2025Qurat-ul-ain Shaheen, Katarzyna Budzynska, Carles SierraExplainable Artificial Intelligence Healthcare
IIIA, CSIC, Barcelona, Spain · Software Competence Centre Hagenberg, Hagenberg, Austria · Laboratory of The New Ethos, Faculty of Administration and Social Sciences, Warsaw University of Technology, Warsaw, Poland
MedRECT: A Bilingual Medical Reasoning Benchmark for Error Correction in Clinical Texts
Nov 1, 2025Naoto Iwase, Hiroki Okuyama, Junichiro IwasawaMultilingual Language Model Evaluation Healthcare
Preferred Networks, Inc., Tokyo, Japan · School of Medicine, Nagoya University, Nagoya, Japan
MedForj: An open, large-scale foundational generative prior for high-resolution 3D brain MRI
Oct 29, 2025Samuel W. Remedios, Aaron Carass, Jerry L. Prince +1Flow Matching Healthcare
Image Analysis and Communications Laboratory, Johns Hopkins University · Department of Neurology, Johns Hopkins Hospital
Zoom In Disparities in Healthcare LLM Q&A
Oct 20, 2025Ipek Baris Schlicht, Burcu Sayin, Zhixue Zhao +5Multilingual Language Model Evaluation Knowledge Augmentation for Language Models
Universitat Politècnica de València, Valencia, Spain · University of Trento, Trento, Italy · University of Sheffield, Sheffield, UK +5
A global log for medical AI
Oct 5, 2025Ayush Noori, Aaron E. Boussina, Hai Ho Bich +48Algorithmic Auditing Healthcare

Jan 25, 2026J/K move · Enter open · S save

Health-ORSC-Bench: A Benchmark for Measuring Over-Refusal and Safety Completion in Health Context

Zhihao Zhang, Liting Huang, Guanghao Wu, Preslav Nakov+2

Macquarie University1 · UTS2 · MBZUAI3+1

LLM Safety Benchmarks Language Model Safety Evaluation Healthcare LLM Refusal LLM Refusal Behavior Over-Refusal+2

Open paper AskPDF arXiv

Safety alignment in Large Language Models is critical for healthcare; however, reliance on binary refusal boundaries often results in over-refusal of benign queries or unsafe compliance with harmful ones. While existing benchmarks measure these extremes, they fail to evaluate Safe Completion: the model's ability to maximise helpfulness on dual-use or borderline queries by providing safe, high-level guidance without crossing into actionable harm. We introduce Health-ORSC-Bench, the first large-scale benchmark designed to systematically measure Over-Refusal and Safe Completion quality in healthcare. Comprising 31,920 benign boundary prompts across seven health categories (e.g., self-harm, medical misinformation), our framework uses an automated pipeline with human validation to test models at varying levels of intent ambiguity. We evaluate 30 state-of-the-art LLMs, including GPT-5 and Claude-4, revealing a significant tension: safety-optimised models frequently refuse up to 80% of "Hard" benign prompts, while domain-specific models often sacrifice safety for utility. Our findings demonstrate that model family and size significantly influence calibration: larger frontier models (e.g., GPT-5, Llama-4) exhibit "safety-pessimism" and higher over-refusal than smaller or MoE-based counterparts (e.g., Qwen-3-Next), highlighting that current LLMs struggle to balance refusal and compliance. Health-ORSC-Bench provides a rigorous standard for calibrating the next generation of medical AI assistants toward nuanced, safe, and helpful completions. Furthermore, our benchmark facilitates reproducible evaluation, encourages safety calibration, and supports development of clinically reliable, context-aware, human-aligned medical AI systems. Our code and data are available at: https://github.com/ZhihaoZhang97/Health-ORSC-Bench. Warning: Some contents may include toxic or undesired contents.