Medical LLMs

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

26 papers in the last four weeks, up 160% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 238

All topics

Testing the Black Box: Structural Barriers to Independent Evaluation of Consumer-Facing Health LLMs
Jun 7, 2026Rahul Gorijavolu, Kaushik Madapati, Pritika Vig +7LLM Evaluation LLM Sycophancy
MIT Critical Data, Massachusetts Institute of Technology, Cambridge, MA, USA · School of Medicine, Johns Hopkins University, Baltimore, MD, USA · Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, USA +10
When Large Language Models Fail in Healthcare: Evaluating Sensitivity to Prompt Variations
Jun 5, 2026Mahdi AlkaeedPrompt Sensitivity Adversarial Attacks on LLMs
Department of Computer Science and Engineering, Doha, Qatar
What's in a Name? Morphological Shortcuts by LLMs in Pharmacology
Jun 4, 2026Kaijie Mo, Thomas Yang, Chantal Shaib +6Hallucination in Language Models Language Modeling
The University of Texas at Austin · Northeastern University · MD Anderson Cancer Center
Severity-Aware Curriculum Learning with Multi-Model Response Selection for Medical Text Generation
Jun 3, 2026Ahmed Alansary, Molham Mohamed, Ali HamdiMedical QA Curriculum Learning
Faculty of Computer Science MSA University Giza, Egypt
Ten Headache Specialists versus Artificial Intelligence for Clinical Literature Summarization: A Critical Evaluation and Comparison
Jun 3, 2026Alejandro Lozano, Keiko Ihara, Ping-Hao Yang +13Text Summarization RAG Evaluation
Stanford University, Palo Alto, CA, USA · Department of Neurology, Mayo Clinic, Rochester, MN, USA · Department of Neurology, Dalhousie University, Halifax, Canada +8
When Retrieval Doesn't Help: A Large-Scale Study of Biomedical RAG
Jun 2, 2026Erfan Nourbakhsh, Rocky Slavin, Ke Yang +1Retrieval-Augmented Generation LLM Grounding
The University of Texas at San Antonio
Gender-Dependent Diagnostic Substitution in LLM Medical Triage: Same Symptoms, Unequal Urgency
Jun 2, 2026Qi Han WongGender Bias in Language Models Clinical Triage
Selective Token-Level Cryptographic Redaction for Privacy-Preserving Clinical Deployment of Large Language Models
Jun 2, 2026Farhan Sheth, Ziyuan Yang, Yongying Lan +1Privacy-Preserving Language Models Medical LLMs
MedVisAI Lab, Singapore · Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore · Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, China
ClinicalMC: A Benchmark for Multi-Course Clinical Decision-Making with Large Language Models
Jun 2, 2026Ruihui Hou, Siyi Zhu, Ziyue Huai +4Clinical Decision-Making Clinical Language Model Evaluation
East China University of Science and Technology, Shanghai, China · Renji Hospital Affiliated to Shanghai Jiaotong University School of Medicine, Shanghai, China.
Large AI Models in Dental Healthcare: From General-Purpose Systems to Domain-Specific Foundation Models
Jun 1, 2026Sema Helali, Lina Abu Nada, Sausan Al Kawas +3Medical Imaging Foundation Models Medical VLMs
Department of Computer Science and Software Engineering, College of Information Technology, United Arab Emirates University, Al Ain, 15551, UAE · Department of Oral and Craniofacial Health Sciences, College of Dental Medicine, University of Sharjah, Sharjah, UAE · Weill Cornell Medicine-Qatar, Doha, Education City, Qatar +1
Towards Multidisciplinary Summarization of Hospital Stays: Efficient Sentence-Level Clinical Provenance Categorization
Jun 1, 2026Baris Karacan, Vaibhav Bhargava, Barbara Di Eugenio +21Data Provenance LLM Fine-Tuning
University of Illinois Chicago · University of Iowa · University of Missouri-Columbia
KliniskVestBERT: BERT Model Specialised to Norwegian Clinical Texts
Jun 1, 2026Christian Autenried, Cosimo PersiaLanguage Model Pretraining Domain-Adaptive Pretraining
Helse Vest ICT
Med-HEAL: Analyzing and Mitigating Hallucinations in Medical LLMs with Hallucination-Aware In-Context Learning
May 31, 2026Yiming Liao, Zeno Franco, Jose Eduardo Lizarraga Mazaba +1LLM Self-Correction LLM Hallucination Mitigation
University of Maryland, Baltimore County Baltimore, Maryland, USA · Concordia University Wisconsin · Medical College of Wisconsin Milwaukee, Wisconsin USA
HypothesisMed: Inference-Time Answer Fusion and Structured Hypothesis-Space Reporting for Biomedical Question Answering
May 31, 2026Md Motaleb Hossen Manik, Ge WangBiomedical QA LLM Uncertainty Estimation
Department of Computer Science Rensselaer Polytechnic Institute Troy, NY, USA · Department of Biomedical Engineering Rensselaer Polytechnic Institute Troy, NY, USA
Same Patient, Different Words, Different Diagnosis? Evaluating Semantic Stability in Clinical LLMs
May 28, 2026Mahdi Alkaeed, Adnan Qayyum, Nabeel Abo Kashreef +2Prompt Sensitivity Clinical Language Model Evaluation
Department of Computer Science and Engineering, College of Engineering, Qatar University, Doha, Qatar · College of Science and Engineering, Hamad Bin Khalifa University (HBKU), Doha, Qatar · Primary Health Care Corporation (PHCC), Doha, Qatar +1
OOD-GraphLLM: Graph Large Language Model for Out-of-Distribution Generalized Drug Synergy Prediction
May 28, 2026Xin Wang, Linxin Xiao, Yang Yao +1OOD Generalization Multimodal Graph Learning
DCST, BNRist, Tsinghua University · Beijing, China · DCST, Tsinghua University
Why Specialist Models Still Matter: A Heterogeneous Multi-Agent Paradigm for Medical Artificial Intelligence
May 28, 2026Yanan Wang, Shuaicong Hu, Jian Liu +3Multi-Agent LLM Systems Healthcare
Department of Biomedical Engineering, College of Biomedical Engineering, Fudan University, Shanghai 200433, China · Department of Cardiology, Xinghua City People’s Hospital affiliated to Yangzhou University, Jiangsu 225700, China.
Think Fast, Talk Smart: Partitioning Deterministic and Neural Computation for Structured Health Text Generation
May 28, 2026Kai-Chen Cheng, Haejun Han, David Q. SunHealthcare Neuro-Symbolic AI
Reverse Probing: Supervised Token-level Uncertainty Quantification for Large Language Models in Clinical Text
May 27, 2026Bushi Xiao, Sarvesh Soni, Daisy Zhe WangText Summarization LLM Uncertainty Estimation
University of Florida Gainesville, FL · U.S. National Library of Medicine Bethesda, MD
SafeMed-R1: Clinician-Audited Safety and Ethics Alignment for Medical Large Language Models
May 27, 2026Chao Ding, Mouxiao Bian, Tianbin Li +12Healthcare LLM Auditing
Shanghai Artificial Intelligence Laboratory, Shanghai, China · Joint Laboratory of Biomedical Artificial Intelligence, Shanghai East Hospital, Tongji University School of Medicine, Shanghai, China · School of Computer Science and Technology, Tongji University, Shanghai, China +5
C-MIG: Multi-view Information Gain-based Retrieval-Augmented Generation for Clinical Diagnosis Reasoning
May 27, 2026Yuwei Miao, Gen Li, Yunsheng Zeng +8Retrieval-Augmented Generation Healthcare
1Baidu Inc.
When Medical Safety Alignment Fails: A Benchmark for Evaluating LLMs on High-Risk Medical Queries
May 26, 2026Yige Li, Jun Sun, Wei Zhao +5LLM Safety Benchmarks Healthcare
Singapore Management University · Deakin University · The University of Melbourne +2
MedGuideX: Internalizing Decision Logic from Executable Guidelines into Large Language Models for Clinical Reasoning
May 26, 2026Yuhao Shen, Lang Cao, Simo Du +4Healthcare Clinical Decision Support
University of Illinois Urbana-Champaign · 2The Chinese University of Hong Kong, Shenzhen · 3Albert Einstein College of Medicine
The Daily Dose: Workflow-Integrated Large Language Model Automation for Clinical Summarization and Trial Identification in Radiation Oncology
May 25, 2026Jason Holmes, Federico Mastroleo, Mariana Borras-Osorio +17Healthcare Clinical Decision Support
Department of Radiation Oncology, Mayo Clinic, Phoenix, AZ, United States · Division of Radiation Oncology, IEO, European Institute of Oncology, IRCCS, Milan, Italy · Department of Oncology and Hemato-Oncology, University of Milan, Milan, Italy +2
Uncertainty Reasoning with Large Language Models for Explainable Disease Diagnosis
May 25, 2026Xiaoyang Fan, Yufan Cai, Zhe Hou +1Clinical Decision Support Clinical Reasoning
National University of Singapore · Griffith University
Towards end-to-end LLM-based censoring-aware survival analysis
May 25, 2026Yishu Wei, Hexin Dong, Yi Lin +3Survival Analysis Mortality Prediction
Department of Population Health Science, Weill Cornell Medicine, New York, 10065, US · Department of Medicine, Weill Cornell Medicine, New York, 10065, US
HiMed: Incentivizing Hindi Reasoning in Medical LLMs
May 23, 2026Dingfeng Jiang, Han Yan, Chenze Ma +12Multilingual Language Models Healthcare
1The Chinese University of Hong Kong, Shenzhen · 2Indian Institute of Technology (Banaras Hindu University) Varanasi · 3Tongji University +4
When Symptoms Are Not Enough: Evidence-Weighting Patterns in Large Language Model Psychiatric Screening
May 22, 2026Jianfeng Zhu, Megan Korhummel, Ruoming Jin +1Medical Diagnosis Mental Health
Departments of Computer Science1 and Psychological Science2 Kent State University Kent, OH USA
Automated ICD Classification of Psychiatric Diagnoses: From Classical NLP to Large Language Models
May 20, 2026Fernando Ortega, Raúl Lara-Cabrera, Jorge Dueñas-Lerín +3LLM Fine-Tuning Clinical Information Extraction
Department of Sistemas Informáticos, Universidad Politécnica de Madrid, Spain · KNODIS Research Group, Universidad Politécnica de Madrid, Spain · CIBERSAM ISCIII, Spain +8
Do No Harm? Hallucination and Actor-Level Abuse in Web-Deployed Medical Large Language Models
May 20, 2026Sunday Oyinlola Ogundoyin, Muhammad Ikram, Rahat MasoodLanguage Model Safety Evaluation Healthcare
Macquarie University, Sydney, Australia · The University of New South Wales, Sydney, Australia

Jun 7, 2026, cs.AIJ/K move · Enter open · S save

Testing the Black Box: Structural Barriers to Independent Evaluation of Consumer-Facing Health LLMs

Rahul Gorijavolu, Kaushik Madapati, Pritika Vig, Rawan Abulibdeh+6

MIT Critical Data, Massachusetts Institute of Technology, Cambridge, MA, USA · School of Medicine, Johns Hopkins University, Baltimore, MD, USA · Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, USA+10

LLM Evaluation LLM Sycophancy LLM Personalization LLM Auditing Medical LLMs

Open paper AskPDF arXiv

Background: Consumer-facing large language models are now a common source of health information, and they interpret and personalize responses rather than retrieve them. Whether their responses vary across users is a clinical, equity, and governance question, sharpened by evidence that sycophantic responses can alter judgment and increase trust. Objective: To evaluate response variation and sycophancy in consumer-facing health LLMs under conditions resembling ordinary patient use. Methods: We constructed simulated user profiles differing in geography, browsing context, expressed beliefs, and social determinants of health, drawing on literature linking social context to health attitudes. We adapted validated instruments, including the Vaccination Attitudes Examination scale and reproductive attitudes scales, into multi-turn prompts designed to elicit clinically meaningful variation across users. Results: The evaluation encountered five linked barriers. Factual prompts produced stable responses that masked sycophancy emerging over multi-turn conversation. Browser-based interfaces did not disclose which signals influence outputs and could not be reset to a clean baseline. Large-scale testing was restricted by terms of service, rate limits, and bot detection. Accuracy-based criteria could not capture tone, framing, or omission, and LLM-as-judge methods risked shared alignment bias. Models changed without traceable version identifiers, preventing reliable replication. Conclusions: No reliable independent evaluation framework yet exists for examining how consumer-facing health LLMs behave in ordinary use. Oversight requires disclosure of personalization signals, stable version identifiers, researcher safe harbor programs, and post-deployment monitoring of health-related outputs.

Momentum

Related topics

Latest papers 238