Medical LLMs

LLM: Large Language Model

Ask about this topic

Overview

Medical large language models are studied for tasks such as diagnosis, clinical coding, note summarization, triage, and patient communication. Common approaches include clinical pretraining and fine-tuning, retrieval-augmented generation with guidelines or knowledge graphs, tool-using agents, and multimodal models that combine text with images or structured records. Evaluation ranges from question-answering benchmarks to realistic consultations, EHR workflows, and clinician studies, with growing attention to calibration, privacy, bias, and evidence grounding. A central challenge is that strong scores on fixed tests do not ensure reliable behavior with incomplete or changing information, misleading patient input, or high-stakes decisions, so human oversight and real-world validation remain important.

Latest papers

CardsList

402 papers40 papers in the last four weeks, up 29% on the four weeks before. 0.2% of all new papers.

  1. Assessing the Effectiveness of LLMs in Delivering Cognitive Behavioral Therapy

    Mar 4, 2026Navdeep Singh Bedi, Ana-Maria Bucur, Noriko Kando +1Clinical Language Model EvaluationMedical LLMs

    Università della Svizzera italiana, Switzerland · National Institute of Informatics, Japan

  2. Benchmarking Motivational Interviewing Competence of Large Language Models

    Mar 4, 2026Aishwariya Jha, Prakrithi Shivaprakash, Lekhansh Shukla +3Clinical Language Model EvaluationMedical LLMs

    Centre for Addiction Medicine, Department of Psychiatry, National Institute of Mental Health and Neuro Sciences (NIMHANS), Bengaluru, India. · Department of Computer Science and Engineering, Indian Institute of Technology (IIT) Kharagpur, India. · Department of Psychiatry, National Institute of Mental Health and Neuro Sciences (NIMHANS), Bengaluru, India.

  3. RAG-X: Systematic Diagnosis of Retrieval-Augmented Generation for Medical Question Answering

    Mar 3, 2026Aswini Sivakumar, Vijayan Sugumaran, Yao QiangRetrieval-Augmented GenerationRAG Evaluation

    Oakland University, Rochester, MI, USA

  4. ClinConsensus: A Physician-Calibrated Benchmark for Evaluating Clinical Rubric Coverage in Chinese Medical LLMs

    Mar 2, 2026Xiang Zheng, Han Li, Wenjie Luo +15Clinical Language Model EvaluationMedical LLMs

    Alibaba Group, China

  5. Linking Knowledge to Care: Knowledge Graph-Augmented Medical Follow-Up Question Generation

    Mar 1, 2026Liwen Sun, Xiang Yu, Ming Tan +4Medical LLMsKnowledge Augmentation for Language Models

    Carnegie Mellon university · Amazon Health AI

  6. Conformal Prediction for Risk-Controlled Medical Entity Extraction Across Clinical Domains

    Mar 1, 2026Manil Shrestha, Edward KimNamed Entity RecognitionLanguage Model Calibration

    Department of Computer Science, Drexel University, Philadelphia, USA

  7. Silent Sabotage During Fine-Tuning: Few-Shot Rationale Poisoning of Compact Medical LLMs

    Feb 28, 2026Jingyuan Xie, Wenjie Wang, Ji Wu +1Adversarial Attacks on LLMsLLM Security

    Department of Electronics Engineering, Tsinghua University, Beijing, China · College of AI, Tsinghua University, Beijing, China · Beijing National Research Center for Information Science and Technology, Beijing, China

  8. MED-COPILOT: A Medical Assistant Powered by GraphRAG and Similar Patient Case Retrieval

    Feb 28, 2026Shuheng Chen, Namratha Patil, Haonan Pan +4Case-Based ReasoningClinical Decision Support

    University of Southern California

  9. Improving Automatic Summarization of Radiology Reports through Mid-Training of Large Language Models

    Feb 28, 2026Mengxian Lyu, Cheng Peng, Ziyi Chen +3Text SummarizationMedical LLMs

    Department of Health Outcomes and Biomedical Informatics, University of Florida, Gainesville, FL, USA · Department of Engineering Education, University of Florida, Gainesville, FL, USA · Department of Health Outcomes and Biomedical Informatics, Preston A. Wells, Jr. Center for Brain Tumor Therapy, University of Florida, Gainesville, FL, USA

  10. A medical coding language model trained on clinical narratives from a population-wide cohort of 1.8 million patients

    Feb 27, 2026Joakim Edin, Sedrah Butt Balaganeshan, Annike Kjølby Kristensen +3Automated Medical CodingMedical LLMs

    Section for Health Data Science and AI, Department of Public Health, University of Copenhagen, Denmark · Corti, Copenhagen, Denmark · Novo Nordisk Foundation Center for Protein Research, University of Copenhagen +1

  11. Toward Automatic Filling of Case Report Forms: A Case Study on Data from an Italian Emergency Department

    Feb 26, 2026Gabriela Anna Kaczmarek, Pietro Ferrazzi, Lorenzo Porta +2Clinical NLPClinical Information Extraction

    Fondazione Bruno Kessler, Povo, Trento, Italy · University of Padova, Padova, Italy · Emergency Medicine Unit, Fatebenefratelli Hospital, Milan, Italy +1

  12. An artificial intelligence framework for end-to-end rare disease phenotyping from clinical notes using large language models

    Feb 23, 2026Cathy Shyr, Yan Hu, Rory J. Tinker +8Clinical Information ExtractionRare Disease Diagnosis

    Department of Biomedical Informatics, Vanderbilt University Medical Center, 2525 West End Avenue, Nashville, 37203, TN, USA. · Department of Biostatistics, Vanderbilt University Medical Center, 2525 West End Avenue, Nashville, 37203, TN, USA. · Department of Pediatrics, Vanderbilt University Medical Center, 2200 Children’s Way, Nashville, 37232, TN, USA. +5

  13. Assessing Risks of Large Language Models in Mental Health Support: A Framework for Automated Clinical AI Red Teaming

    Feb 23, 2026Ian Steenstra, Paola Pedrelli, Weiyan Shi +2LLM Safety EvaluationClinical Language Model Evaluation

    Northeastern University Boston, MA, USA · Harvard Medical School Boston, MA, USA

  14. Small LLMs for Medical NLP: a Systematic Analysis of Few-Shot, Constraint Decoding, Fine-Tuning and Continual Pre-Training in Italian

    Feb 19, 2026Pietro Ferrazzi, Mattia Franzin, Alberto Lavelli +1Small Language ModelsClinical NLP

    Fondazione Bruno Kessler, Povo, Trento, Italy · University of Padova, Padova, Italy

  15. MedClarify: An information-seeking AI agent for medical diagnosis with case-specific follow-up questions

    Feb 19, 2026Hui Min Wong, Philip Heesen, Pascal Janetzky +2Information GainMedical LLMs

    LMU Munich, Munich, Germany · Munich Center for Machine Learning, Germany · Department of Neuroradiology, Heidelberg University, Heidelberg, Germany

  16. LiveClin: A Live Clinical Benchmark without Leakage

    Feb 18, 2026Xidong Wang, Shuqi Guo, Yue Shen +6Clinical Language Model EvaluationMedical LLMs

    The Chinese University of Hong Kong, ShenZhen · Ant Healthcare, Ant Group · The Ohio State University +1

  17. Assessing Large Language Models for Medical QA: Zero-Shot and LLM-as-a-Judge Evaluation

    Feb 16, 2026Shefayat E Shams Adib, Ahmed Alfey Sani, Ekramul Alam Esham +2Medical QAMedical LLMs

    Department of Computer Science and Engineering, Islamic University of Technology, Gazipur, Bangladesh

  18. An evidence-guided reinforcement learning method to improve psychiatric reasoning in small language models

    Feb 6, 2026Xinxin Lin, Guangxin Dai, Yi Zhong +25HealthcareMental Health

    The Chinese University of Hong Kong, Shatin, N.T., Hong Kong SAR, China · Shandong University, Jinan, China · Peking University Sixth Hospital, Beijing, China +6

  19. LingLanMedBench: A Unified Benchmark for Evaluating Large Language Models in Traditional Chinese Medicine

    Feb 2, 2026Rui Hua, Yu Wei, Zixin Shu +17Traditional Chinese MedicineMedical LLMs

    Department of Computer Science and Technology, Beijing Jiaotong University, Beijing, China · Tianjin Tasly Digital Chinese Medicine Technology Co., Ltd., Tianjin, China · Tasly Biopharmaceuticals Co., Ltd., Tianjin, China +11

  20. Health-SCORE: Towards Scalable Rubrics for Improving Health-LLMs

    Jan 26, 2026Zhichao Yang, Sepehr Janghorbani, Dongxu Zhang +6Rubric-Based EvaluationRubric-Guided Generation

    Optum AI

  21. SycoEval-EM: Sycophancy Evaluation of Large Language Models in Simulated Clinical Encounters for Emergency Care

    Jan 23, 2026Dongshen Peng, Yi Wang, Austin Schoeffler +5LLM SycophancyLanguage Model Safety Evaluation

    UNC Chapel Hill · University of Waterloo · Stanford University

  22. Towards Reliable Medical LLMs: Benchmarking and Enhancing Confidence Estimation of Large Language Models in Medical Consultation

    Jan 22, 2026Zhiyao Ren, Yibing Zhan, Siyuan Liang +3HealthcareClinical Reasoning

    Nanyang Technological University, Singapore, Singapore. · Wuhan University, Wuhan, China.

  23. Counterfactual Modeling with Fine-Tuned LLMs for Health Intervention Design and Sensor Data Augmentation

    Jan 21, 2026Shovito Barua Soumma, Asiful Arefeen, Stephanie M. Carpenter +2Counterfactual ExplanationsLLM Fine-Tuning

    College of Health Solutions, Arizona State University, Phoenix, AZ 85004, USA. · School of Computing and Augmented Intelligence, Arizona State University, Tempe, AZ 85281, USA. · School of Nutritional Sciences and Wellness, University of Arizona, Tucson, AZ 85721, USA.

  24. Dementia-R1: Reinforced Pretraining and Reasoning from Unstructured Clinical Notes for Real-World Dementia Prognosis

    Jan 6, 2026Choonghan Kim, Hyunmin Hwang, Hangeol Chang +4Clinical Outcome PredictionAlzheimer's Disease Progression Prediction

    Graduate School of AI, KAIST, Republic of Korea · Haeundae Paik Hospital, Inje University, Republic of Korea · Asan Medical Center, University of Ulsan College of Medicine, Republic of Korea

  25. Toward Global Large Language Models in Medicine

    Jan 5, 2026Rui Yang, Huitao Li, Weihao Xuan +47Medical LLMsMultilingual Language Model Evaluation

  26. Towards Explainable Conversational AI for Early Diagnosis with Large Language Models

    Dec 19, 2025Maliha Tabassum, M Shamim KaiserMedical DiagnosisConversational Agents

    Department of Information and Communication Technology Bangladesh University of Professionals Dhaka 1216, Bangladesh · Institute of Information Technology Jahangirnagar University Dhaka 1342, Bangaldesh

  27. Behavioral Coherence: A Method for Sensitive-Domain LLM Evaluation

    Dec 15, 2025Anika Sharma, Malavika Mampally, Chidaksh Ravuru +2Language Model Bias EvaluationDemographic Bias in Language Models

    Society-Centered AI Lab UNC Chapel Hill, USA · School of Nursing UNC Chapel Hill, USA

  28. Multilingual Medical Reasoning for Question Answering with Large Language Models

    Dec 5, 2025Pietro Ferrazzi, Aitor Soroa, Rodrigo AgerriKnowledge Augmentation for Language ModelsHealthcare

    Fondazione Bruno Kessler, Trento, Italy · HiTZ Center - Ixa, University of the Basque Country EHU, Spain

  29. Aligning LLMs with Biomedical Knowledge using Balanced Fine-Tuning

    Nov 26, 2025Zhenchao Tang, Fang Wang, Haohuai He +13LLM AlignmentLLM Fine-Tuning

    Tencent AI for Life Sciences Lab, Shenzhen, China. · Sun Yat-sen University, Shenzhen, China. · The Hong Kong Polytechnic University, Hong Kong SAR, China. +2

  30. MedBayes-Lite: A Clinical Uncertainty Governance Layer for Risk-Aware Medical Decision Support

    Nov 20, 2025Elias Hossain, Md Mehedi Hasan Nipu, Maleeha Sheikh +5Selective PredictionHealthcare

    College of Engineering and Computer Science, University of Central Florida, Orlando, FL 32816, USA · Department of Computer Science and Engineering, North South University, Dhaka 1229, Bangladesh · Department of Electrical and Computer Engineering, Purdue University Fort Wayne, Fort Wayne, IN 46805, USA +4