cs.AIAug 25, 2026

EviDx: Evidence-Aware Active Diagnosis with Scaffolded LLM Agents

Authors: Lihang Zeng, Shaoting Zhang, Xiaofan Zhang

Organizations: Shanghai Jiao Tong University · Shanghai Innovation Institute

Abstract

Clinical diagnosis is an active evidence-seeking process in which clinicians acquire evidence, update competing hypotheses, and decide when the available evidence is sufficient for diagnosis. Yet many medical diagnosis systems built around large language models (LLMs) still formulate diagnosis as static case-to-answer prediction, with limited support for evidence acquisition. Agentic LLMs offer a dynamic alternative through tool use and intermediate diagnostic trajectories, but existing systems often under-specify how patient evidence should be exposed, scaffolded, and controlled at runtime. We introduce EviDx, an evidence-aware active diagnosis framework that pairs patient-specific diagnostic environments with a clinical diagnostic scaffold and an observer-guided runtime harness. In EviDx, E\mathcal{E}-Synthesis constructs interactive environments from raw clinical cases; the scaffold organizes role-specialized agents, evidence tools, and evolving evidence states; and the harness regulates diagnostic termination by tracking uncertainty and evidence coverage. A 3-level evaluation pyramid assesses execution robustness, reasoning dynamics, and diagnostic outcomes. Experiments show that EviDx improves diagnostic performance and process stability while revealing model-dependent capability boundaries.

Explore similar work

CardsList
  1. Can LLMs Value the Right Evidence? Evidence-Value Misalignment in Dynamic Medical Diagnosis

    Sep 28, 2026Kehua Feng, Yunsheng Lu, Yitong Qiao +5LLM EvaluationEvidence-Grounded Reasoning

  2. MedAction: Towards Active Multi-turn Clinical Diagnostic LLMs

    May 8, 2026Hsin-Ling Hsu, Zizheng Wang, Donghua Zhang +9HealthcareMedical Diagnosis

  3. Reinforcement Learning for Evidence-Seeking Diagnostic Reasoning with Large Language Models

    Jul 3, 2026Shengyi Hua, Kangzhe Hu, Conghui He +2Medical DiagnosisRL for Language Model Reasoning