cs.CLMar 17, 2026

Medical Reasoning with Large Language Models: A Survey and MR-Bench

Authors: Xiaohan Ren, Chenxiao Fan, Wenyin Ma, Hongliang He, Chongming Gao, Xiaoyan Zhao, Fuli Feng

Organizations: School of Cyber Science and Technology, University of Science and Technology of China, Anhui, China · School of Artificial Intelligence and Data Science, University of Science and Technology of China, Anhui, China · Department of Infectious Disease, The First Affiliated Hospital of USTC, Anhui, China · School of Information Science and Technology, University of Science and Technology of China, Anhui, China · School of Computing, National University of Singapore, Singapore

Abstract

Large language models (LLMs) have achieved strong performance on medical exam-style tasks, motivating growing interest in their deployment in real-world clinical settings. However, clinical decision-making is inherently safety-critical, context-dependent, and conducted under evolving evidence. In such situations, reliable LLM performance depends not on factual recall alone, but on robust medical reasoning. In this work, we present a comprehensive review of medical reasoning with LLMs. Grounded in cognitive theories of clinical reasoning, we conceptualize medical reasoning as an iterative process of abduction, deduction, and induction, and organize existing methods into seven major technical routes spanning training-based and training-free approaches. We further conduct a unified cross-benchmark evaluation of representative medical reasoning models under a consistent experimental setting, enabling a more systematic and comparable assessment of the empirical impact of existing methods. To better assess clinically grounded reasoning, we introduce MR-Bench, a benchmark derived from real-world hospital data. Evaluations on MR-Bench expose a pronounced gap between exam-level performance and accuracy on authentic clinical decision tasks. Overall, this survey provides a unified view of existing medical reasoning methods, benchmarks, and evaluation practices, and highlights key gaps between current model performance and the requirements of real-world clinical reasoning.

Figures & tables

Explore similar work

CardsList
  1. Aligning Clinical Needs and AI Capabilities: A Survey on LLMs for Medical Reasoning

    Jul 8, 2026Qi Peng, Jiatong Li, Sirui Huang +10Clinical ReasoningClinical Language Model Evaluation

  2. Medmarks: A Comprehensive Open-Source LLM Benchmark Suite for Medical Tasks

    May 2, 2026Benjamin Warner, Ratna Sagari Grandhi, Max Kieffer +32LLM EvaluationHealthcare