cs.AINov 9, 2026

Decisions by Discrimination: Differential Evidence for Medical Reasoning

Authors: Yunpeng Xiao, Yuzhang Xie, Junhao Huang, Carl Yang, Xiao Hu, Kai Shu

Organizations: Department of Computer Science, Emory University · Nell Hodgson Woodruff School of Nursing, Emory University

Abstract

Large language models (LLMs) are increasingly studied for clinical decision support, and medical question answering provides a testbed for evaluating this capability. In particular, medical multiple-choice questions (MCQs) reflect a core challenge in clinical decision-making: plausible options often share overlapping evidence, while only a few decisive factors distinguish the correct option from incorrect ones. However, existing retrieval-based and reasoning-oriented methods mainly focus on supplying broadly relevant knowledge or eliciting reasoning paths, rather than identifying the compact differential evidence that separates confusing alternatives. In this work, we present a retrieval-grounded differential evidence framework for medical MCQs. Our method extracts option-specific pieces of differential evidence and organizes them into concise evidence prompts for answer selection. This design better aligns external knowledge with differential reasoning while reducing irrelevant context. Experiments show consistent accuracy gains across multiple datasets and target LLMs. Ablation studies further show that our framework outperforms both directly using retrieved evidence chunks and closed-source LLM-generated general hints, and that its improvements are not solely explained by answer-proximal guidance, but are consistent with differential evidence serving as a compact aid for reasoning over competing alternatives. Our findings also offer insights for medical reasoning and other decision-making settings with multiple possible choices.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. MedJudgeRAG: Option-Wise Evidence Judgment with Dynamic Knowledge Graphs for Medical MCQA

    Jul 24, 2026Seongwon Seo, Seung Hwan Cho, Young-Min KimGraph Retrieval-Augmented GenerationMedical QA

  2. Medical Reasoning with Large Language Models: A Survey and MR-Bench

    Mar 17, 2026Xiaohan Ren, Chenxiao Fan, Wenyin Ma +4Medical ReasoningClinical Reasoning

  3. Few shot chain-of-thought driven reasoning to prompt LLMs for open ended medical question answering

    Mar 7, 2024Saeel Sandeep Nachane, Ojas Gramopadhye, Prateek Chanda +5HealthcareMedical Diagnosis