Medical LLMs

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

26 papers in the last four weeks, up 160% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 238

All topics

Employing General-Purpose and Biomedical Large Language Models with Advanced Prompt Engineering for Pharmacoepidemiologic Study Design
Apr 20, 2026Xinyao Zhang, Nicole Sonne Heckmann, Manuela Del Castillo Suero +2LLM Evaluation Healthcare
Department of Drug Design and Pharmacology, University of Copenhagen, Copenhagen, Denmark.
RePrompT: Recurrent Prompt Tuning for Integrating Structured EHR Encoders with Large Language Models
Apr 20, 2026Arya Hadizadeh Moghaddam, Drew Ross, Mohsen Nayebi Kerdabadi +2Representation Learning Prompt Tuning
University of Kansas, USA
PsychBench: Auditing Epidemiological Fidelity in Large Language Model Mental Health Simulations
Apr 19, 2026Patrick KeoughHealthcare LLM Auditing
Independent Researcher Bremerton, Washington, USA
Evaluating Multimodal LLMs for Inpatient Diagnosis: Real-World Performance, Safety, and Cost Across Ten Frontier Models
Apr 18, 2026Bruce A. Bassett, Amy Rouillard, Sitwala Mundia +8Language Model Safety Evaluation Healthcare
School of Computer Science and Applied Mathematics, University of the Witwatersrand, Johannesburg, South Africa · Wits MIND Institute, University of the Witwatersrand, Johannesburg, South Africa · Grai Labs, Cape Town, South Africa +3
Improving Heart-Focused Medical Question Answering in LLMs via Variance-Aware Rubric Rewards with GRPO
Apr 17, 2026Arash Ahmadi, Parisa Masnadi, Sarah Sharif +3RL for Language Models Healthcare
School of Electrical and Computer Engineering, University of Oklahoma, Norman, OK, USA · Intelligent Neuromorphic and Quantum Understanding for Innovative Research and Engineering (INQUIRE) Laboratory, University of Oklahoma, Norman, OK, USA · Data Science and Analytics Institute, University of Oklahoma, Norman, OK, USA +3
Blinded Multi-Rater Comparative Evaluation of a Large Language Model and Clinician-Authored Responses in CGM-Informed Diabetes Counseling
Apr 16, 2026Zhijun Guo, Alvina Lai, Emmanouil Korakas +6Clinical Decision Support RAG Evaluation
Institute of Health Informatics, University College London, London, United Kingdom · University College London Hospitals NHS Foundation Trust, London, United Kingdom · Dartford and Gravesham NHS Foundation Trust, Dartford, United Kingdom +1
Enhancing Mental Health Counseling Support in Bangladesh using Culturally-Grounded Knowledge
Apr 16, 2026Md Arid Hasan, Azhagu Meena SP, Aditya Khan +6Retrieval-Augmented Generation Mental Health Counseling
University of Toronto, Canada · mPower Social Enterprises Ltd, Bangladesh · National Institute of Mental Health, Bangladesh +2
Learning Diagnostic Reasoning for Decision Support in Toxicology
Mar 31, 2026Nico Oberländer, David Bani-Harouni, Tobias Zellner +3Clinical Decision Support RL for Language Model Reasoning
Computer Aided Medical Procedures, Technical University of Munich, Germany · Munich Center for Machine Learning (MCML), Germany · Department of Clinical Toxicology and Poison Control Center Munich, TUM Klinikum rechts der Isar, Germany
Beyond Idealized Patients: Evaluating LLMs under Challenging Patient Behaviors in Medical Consultations
Mar 31, 2026Yahan Li, Xinyi Jie, Wanjia Ruan +5Healthcare Clinical Reasoning
University of Southern California
Med-V1: Small Language Models for Zero-shot and Scalable Biomedical Evidence Attribution
Mar 5, 2026Qiao Jin, Yin Fang, Lauren He +12LLM Answer Verification Healthcare
Division of Intramural Research, National Library of Medicine, National Institutes of Health · Department of Computer Science, University of Virginia · Center for Cancer Research, National Cancer Institute, National Institutes of Health +3
An evidence-guided reinforcement learning method to improve psychiatric reasoning in small language models
Feb 6, 2026Xinxin Lin, Guangxin Dai, Yi Zhong +25Healthcare Mental Health
The Chinese University of Hong Kong, Shatin, N.T., Hong Kong SAR, China · Shandong University, Jinan, China · Peking University Sixth Hospital, Beijing, China +6
SycoEval-EM: Sycophancy Evaluation of Large Language Models in Simulated Clinical Encounters for Emergency Care
Jan 23, 2026Dongshen Peng, Yi Wang, Austin Schoeffler +5LLM Sycophancy Language Model Safety Evaluation
UNC Chapel Hill · University of Waterloo · Stanford University
Counterfactual Modeling with Fine-Tuned LLMs for Health Intervention Design and Sensor Data Augmentation
Jan 21, 2026Shovito Barua Soumma, Asiful Arefeen, Stephanie M. Carpenter +2Counterfactual Explanations LLM Fine-Tuning
College of Health Solutions, Arizona State University, Phoenix, AZ 85004, USA. · School of Computing and Augmented Intelligence, Arizona State University, Tempe, AZ 85281, USA. · School of Nutritional Sciences and Wellness, University of Arizona, Tucson, AZ 85721, USA.
Towards Explainable Conversational AI for Early Diagnosis with Large Language Models
Dec 19, 2025Maliha Tabassum, M Shamim KaiserMedical Diagnosis Conversational Agents
Department of Information and Communication Technology Bangladesh University of Professionals Dhaka 1216, Bangladesh · Institute of Information Technology Jahangirnagar University Dhaka 1342, Bangaldesh
Behavioral Coherence: A Method for Sensitive-Domain LLM Evaluation
Dec 15, 2025Anika Sharma, Malavika Mampally, Chidaksh Ravuru +2Language Model Bias Evaluation Demographic Bias in Language Models
Society-Centered AI Lab UNC Chapel Hill, USA · School of Nursing UNC Chapel Hill, USA
Multilingual Medical Reasoning for Question Answering with Large Language Models
Dec 5, 2025Pietro Ferrazzi, Aitor Soroa, Rodrigo AgerriKnowledge Augmentation for Language Models Healthcare
Fondazione Bruno Kessler, Trento, Italy · HiTZ Center - Ixa, University of the Basque Country EHU, Spain
Aligning LLMs with Biomedical Knowledge using Balanced Fine-Tuning
Nov 26, 2025Zhenchao Tang, Fang Wang, Haohuai He +13LLM Alignment LLM Fine-Tuning
Tencent AI for Life Sciences Lab, Shenzhen, China. · Sun Yat-sen University, Shenzhen, China. · The Hong Kong Polytechnic University, Hong Kong SAR, China. +2
MedBayes-Lite: A Clinical Uncertainty Governance Layer for Risk-Aware Medical Decision Support
Nov 20, 2025Elias Hossain, Md Mehedi Hasan Nipu, Maleeha Sheikh +5Selective Prediction Healthcare
College of Engineering and Computer Science, University of Central Florida, Orlando, FL 32816, USA · Department of Computer Science and Engineering, North South University, Dhaka 1229, Bangladesh · Department of Electrical and Computer Engineering, Purdue University Fort Wayne, Fort Wayne, IN 46805, USA +4
MedRECT: A Bilingual Medical Reasoning Benchmark for Error Correction in Clinical Texts
Nov 1, 2025Naoto Iwase, Hiroki Okuyama, Junichiro IwasawaMultilingual Language Model Evaluation Healthcare
Preferred Networks, Inc., Tokyo, Japan · School of Medicine, Nagoya University, Nagoya, Japan
Expert-guided Clinical Text Augmentation via Query-Based Model Collaboration
Sep 25, 2025Dongkyu Cho, Miao Zhang, Rumi ChunaraSynthetic Data Augmentation Data Augmentation
Department of Computer Science, New York University, New York, NY, United States · Department of Biostatistics, School of Global Public Health, New York University, New York, NY, United States
ProMed: Shapley Information Gain Guided Reinforcement Learning for Proactive Medical LLMs
Aug 19, 2025Hongxin Ding, Baixiang Huang, Yue Fang +8RL for Language Models Healthcare
National Engineering Research Center of Software Engineering, Peking University, China · School of Computing and Data Science, The University of Hong Kong · School of Computer Science, Peking University, Beijing, China +2
FedCoT: Communication-Efficient Federated Reasoning Enhancement for Large Language Models
Aug 7, 2025Chuan Li, Qianyi Zhao, Fengran Mo +1Communication-Efficient Distributed Training Medical LLMs
East China Normal University, China · University of Montreal, Canada
Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applications
Aug 1, 2025Zizhan Ma, Wenxuan Wang, Meidan Ding +7LLM Prompting RL for Language Model Reasoning
The Chinese University of Hong Kong · Renmin University of China · Shenzhen University +3
Addressing Benchmarking Gaps in Large Language Models for Health and Medicine with Dynamic Red-Teaming
Jul 30, 2025Jiazhen Pan, Bailiang Jian, Paul Hager +20LLM Safety Benchmarks Language Model Safety Evaluation
Cherise · School of Computation, Information and Technology, Technical University of Munich (TUM), Munich, Germany · Department of Engineering Science, University of Oxford, Oxford, United Kingdom +9
Learning Personalized Prompts for Healthcare Guidance
Dec 20, 2024Ruize Shi, Hong Huang, Wei Zhou +3Prompt Learning LLM Personalization
Huazhong University of Science and Technology, Wuhan, China · 1Huazhong University of Science and Technology, Wuhan, China · 2Tongji Medical College +1
Narrative Feature or Structured Feature? A Study of Large Language Models to Identify Cancer Patients at Risk of Heart Failure
Mar 18, 2024Ziyi Chen, Mengyuan Zhang, Mustafa Mohammed Ahmed +4Healthcare Oncology
Department of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, FL, USA · Division of Cardiovascular Medicine, Department of Medicine, College of Medicine, University of Florida, Gainesville, FL, USA · Division of Hematology & Oncology, Department of Medicine, College of Medicine, University of Florida, Gainesville, FL, USA
Towards Reliable Medical LLMs: Benchmarking and Enhancing Confidence Estimation of Large Language Models in Medical Consultation
Date pendingZhiyao Ren, Yibing Zhan, Siyuan Liang +3Healthcare Clinical Reasoning
Nanyang Technological University, Singapore, Singapore. · Wuhan University, Wuhan, China.
VeriSim: A Configurable Framework for Stress-Testing Medical AI Under Patient Communication Noise
Date pendingSina Mansouri, Mohit Marvania, Vibhavari Ashok Shihorkar +5Healthcare LLM Reliability
Department of Computer Science, George Mason University · Department of Health Administration and Policy, College of Public Health, George Mason University · Department of Science, George Mason University

Apr 20, 2026, cs.CLJ/K move · Enter open · S save

Employing General-Purpose and Biomedical Large Language Models with Advanced Prompt Engineering for Pharmacoepidemiologic Study Design

Xinyao Zhang, Nicole Sonne Heckmann, Manuela Del Castillo Suero, Francesco Paolo Speca+1

Department of Drug Design and Pharmacology, University of Copenhagen, Copenhagen, Denmark.

LLM Evaluation Healthcare LLM Prompting Medical LLMs

Open paper AskPDF arXiv

Background: The potential of large language models (LLMs) to automate and support pharmacoepidemiologic study design is an emerging area of interest, yet their reliability remains insufficiently characterized. General-purpose LLMs often display inaccuracies, while the comparative performance of specialized biomedical LLMs in this domain remains unknown. Methods: This study evaluated general-purpose LLMs (GPT-4o and DeepSeek-R1) versus biomedically fine-tuned LLMs (QuantFactory/Bio-Medical-Llama-3-8B-GGUF and Irathernotsay/qwen2-1.5B-medical_qa-Finetune) using 46 protocols (2018-2024) from the HMA-EMA Catalogue and Sentinel System. Performance was assessed across relevance, logic of justification, and ontology-code agreement across multiple coding systems using Least-to-Most (LTM) and Active Prompting strategies. Results: GPT-4o and DeepSeek-R1 paired with LTM prompting achieved the highest relevance and logic of justification scores, with GPT-4o-LTM reaching a median relevance score of 4 in 8 of 9 questions for HMA-EMA protocols. Biomedical LLMs showed lower relevance overall and frequently generated insufficient justification. All LLMs demonstrated limited proficiency in ontology-code mapping, although LTM provided the most consistent improvements in reasoning stability. Conclusion: Off-the-shelf general-purpose LLMs currently offer superior support for pharmacoepidemiologic design compared to biomedical LLMs. Prompt strategy strongly influenced LLM performance.

Momentum

Related topics

Latest papers 238