cs.CVApr 13, 2026

Test-time Scaling over Perception: Resolving the Grounding Paradox in Thinking with Images

Authors: Zheng Jiang, Yiming Chen, Nan He, Jiahui Chen, Chaoyang Li, Houde Qian, Lifeng Sun

Organizations: Tsinghua University, Beijing, China · Beijing University of Technology, Beijing, China

Abstract

Recent multimodal large language models (MLLMs) support Thinking with Images, invoking visual tools such as zooming and cropping to inspect image regions during inference. Yet these systems remain brittle in fine-grained reasoning: to acquire a decisive detail, a model must ground its attention on the correct region, but knowing which region is correct presupposes having already observed that detail. We identify this circular dependency as the grounding paradox, show that grounding errors are rarely self-corrected within a single trajectory---once a misleading region is inspected, all subsequent reasoning conditions on that observation and the error propagates to the final answer---and observe that because each trajectory constructs its own evidence, answer-level aggregation discards the very information that distinguishes trajectories. We propose Test-Time Scaling over Perception (TTSP), a closed-loop framework that treats perception as the unit of scalable inference and allocates compute along two axes: Entropy-Gated Perceptual Exploration samples diverse trajectories and uses critical-token entropy to withhold evidence the model cannot commit to, while Evidence-Guided Iterative Refinement distills validated observations into a correctable Evidence Ledger that steers later rounds to re-inspect unresolved regions. Across high-resolution and general multimodal benchmarks, TTSP consistently outperforms strong test-time scaling baselines, while improving grounding quality with favorable token efficiency.

Figures & tables

Appendix figures & tables11 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Token-Disentangled Latent Test-Time Scaling for Vision-Language Reasoning

    Sep 28, 2026Hao-Xuan Ma, Yihao Liu, Yutao Sun +8Test-Time Scaling for VLMsTest-Time Scaling

  2. Focus When Necessary: Adaptive Routing and Collaborative Grounding for Training-Free Visual Grounding

    Jun 15, 2026Yifan Wang, Peiming Li, Shiyu Li +5Efficient VLM InferenceLarge Vision-Language Models

  3. Think with Structured Grounding: Perceptual Reinforcement Learning for Chart and Visual-Tabular Understanding

    Aug 23, 2026Changjiang Jiang, Qiannian Zhao, Lei Xin +3Visually Grounded ReasoningFine-Grained Visual Perception