ReVision3D: Attribution-Guided Recursive Self-Improvement for 3D Medical Perception
Organizations: Vanderbilt University · University of California, Santa Cruz · University of California, San Francisco · Zhejiang University ·
Abstract
Recursive self-improvement (RSI) offers a promising path for overcoming the limited visual capability of current medical imaging agents. Yet applying RSI to volumetric imaging remains difficult: failures can arise from acquisition, perception, training recipe, or downstream inference, while self-generated feedback and logged trajectories provide little guidance on which component should change. We introduce ReVision3D, an RSI system that leverages 3D volumes with spatially grounded annotations to determine where visual evidence is lost and recursively improve the corresponding visual capability. A frozen language-model designer proposes revisions to acquisition, perception, training, or inference, while the verifier and system-level objective remain fixed. Our key insight is that an annotated volume forms an exact replay world for view rendering and spatial verification: unvisited views can be rendered on demand, and localized predictions can be checked directly against reference masks. This grounded feedback directs targeted revision, while only changes that improve beyond measured seed noise are retained. Each accepted change triggers renewed attribution, allowing the dominant bottleneck to shift across rounds. On abdominal CT, attribution identifies perception as the dominant remaining limitation. Revising that level enables ReVision3D to achieve 79% liver recall and 83% kidney recall at under 0.4 false positives per patient, outperforming the evaluated frozen multimodal foundation models, with the largest gains on small lesions. Our framework is public available with interactive demo in this project page: https://leeh43.github.io/ReVision3D/
Figures & tables
Appendix figures & tables6 assets
Supplementary material from the paper’s appendix.
Appendix
| Trial | Recipe by | vs. start | Never detected | |
| seed | seed recipe | 0.567 | 0.27 | |
| seed | seed recipe | 0.546 | 0.32 | |
| seed | seed recipe | 0.525 | 0.23 | |
| p01 | designer | 0.583 | 0.37 | |
| p02 | designer | 0.533 | 0.38 | |
| p03 | designer | 0.554 | 0.27 |
Medical Image Analysis
Medical image analysis uses computational methods to interpret clinical images, measure anatomy and disease, and support diagnosis and treatment.
See all 292 papersRegulating Anatomy-Aware Rewards via Trajectory-Integral Feedback for Volumetric Computed Tomography Analysis
*Evaluation Hallucinations*'', where models optimize linguistic fluency rather than factual clinical correctness, leading to diagnostically critical errors. To bridge this gap, we introduce the **Clinical Abnormality Benchmarking Substrate (CABS)**, a structured system that decomposes radiology reports into verifiable clinical semantic units. Using CABS, we identify a Mechanistic Divergence'' in standard RL, where surface-similarity rewards drive policy gradients to bypass medical facts. We therefore propose Trajectory-Integral Feedback GRPO (TIF-GRPO), a novel framework integrating control-theoretic principles into policy optimization. By formulating clinical reasoning as a pseudo-temporal trajectory for anomaly discovery, TIF-GRPO regulates anatomy-aware rewards via an integral feedback loop that penalizes persistent omissions as cumulative state errors and suppresses hallucinations as excessive control effort. Experiments on 3D CT benchmarks demonstrate that our approach significantly enhances abnormality detection and clinical faithfulness, establishing a new paradigm for fine-grained regulation in medical VLMs. Our project is available at GitHub.