cs.CVNov 3, 2026

GroundSeek-CXR: Retrospective Evaluation-Guided Active Observation Framework for Multi-Label Chest Radiography Diagnosis

Authors: Yihang Fu, Xinyu Liu, Qing Xu, Xiaofeng Yang, Zhen Chen

Organizations: Yale University · A*STAR · University of Nottingham · University of Chicago · 

Abstract

Chest radiography (CXR) diagnosis is critical for thoracic disease assessment, yet challenged by the need to identify subtle lesions and co-occurring abnormalities across regions. While recent vision-language models can actively observe local regions, existing preference-based methods supervise each observation by its immediate effect on the current diagnosis, failing to capture how each observation and stopping decision contributes to the final diagnosis. To address this issue, we propose GroundSeek-CXR, an active CXR diagnosis framework that learns observation and stopping decisions by retrospectively evaluating them with the final diagnosis. Specifically, we first devise a Retrospective Diagnostic Evaluation (RDE) that scores observation and stop candidates from offline Monte Carlo tree search through independent continuations. Moreover, we design a Retrospective Gap-weighted Preference Optimization (RGPO) that learns from retrospective-score preferences weighted by their score gaps, prioritizing actions that improve diagnostic accuracy. Extensive experiments demonstrate that our GroundSeek-CXR framework outperforms state-of-the-art methods, and improves abnormal-image sample-F1 by 4.48% over immediate-score preference learning.

Figures & tables

Explore similar work

CardsList
  1. Seeing Like Radiologists: Context- and Gaze-Guided Vision-Language Pretraining for Chest X-rays

    Mar 27, 2026Kang Liu, Zhuoqi Ma, Siyu Liang +5Radiology VLMsMedical VLMs

  2. A Reasoning-Enabled Vision-Language Foundation Model for Chest X-ray Interpretation

    Apr 1, 2026Yabin Zhang, Chong Wang, Yunhe Gao +19Radiology VLMsVLM Reasoning

  3. APED-CXR: Adaptive Privileged Evidence Distillation for Chest X-Ray Grounding with Image-Only Inference

    Oct 21, 2026Md Shihabul Islam Shovo, Nishi Kanta Paul, Jamil FayyadMedical Image GroundingAdaptive Knowledge Distillation