Visually Grounded Reasoning

Overview

Visually grounded reasoning studies how models use images, video, diagrams, and other visual inputs to support conclusions and actions with relevant evidence. Common approaches include locating regions or pixels, building scene graphs and symbolic programs, interleaving visual inspection with language reasoning, and using active perception to seek additional views or details. Benchmarks test settings such as spatial and compositional questions, charts and diagrams, video events, and embodied planning, increasingly scoring evidence alignment as well as answer accuracy. A central challenge is that better perception does not guarantee that evidence will guide later reasoning: language priors and long reasoning traces can override visual details, while extra inspection or computation can be costly or ineffective.

Latest papers

CardsList

352 papers10 papers in the last four weeks, down 66% on the four weeks before. 0.1% of all new papers.

  1. Keep the Image in Mind: A Visual Board for Multimodal Agents

    Nov 18, 2026Haiming Zhu, Zhiwei Chen, Ding Cao +1Multimodal AgentsVisually Grounded Reasoning

  2. Learning Grounded Reasoning from Human Gaze

    Nov 17, 2026Gabriel Sarch, Declan Campbell, Nicholas Budny +5Reasoning for VLMsVisual Reasoning

  3. Pothole Risk Assessment with Geometrically Grounded Vision Language Models

    Nov 11, 2026Abdalmalek Aburaddaha, Zaid A. El Shair, Ali Al-Bustami +1Visually Grounded Reasoning

  4. Where and Why is Grounded Reasoning Useful?

    Nov 5, 2026David Yan, Le Xue, Forrest Huang +4Visually Grounded ReasoningVisual Reasoning

  5. Trace4D: Grounded Spatiotemporal Reasoning via 4D State Sequences

    Nov 2, 2026Wooseok Jang, Seungryong Kim, Yan Lu +1Spatiotemporal ReasoningTemporal Reasoning in VLMs

  6. GRIT: Gradient Masking for Visually Misgrounded Tokens in Text-Rich Reasoning

    Oct 30, 2026Chanseul Cho, Noori Bae, Dongheon Lee +1VLM ReasoningVisually Grounded Reasoning

  7. Diagnosing the Reference Gap: What Visual Scaffolds Can and Cannot Fix in Multimodal Reasoning

    Oct 29, 2026Guizhen Chen, Weiwen Xu, Wotao Yin +2Multimodal ReasoningVisually Grounded Reasoning

  8. AdaGround: Token-Normalized Adaptive Zooming with Verifier-in-the-Loop Refinement for GUI Grounding

    Oct 27, 2026Bingchao Wang, Yongcheng Jing, Chengyu Wang +4GUI GroundingVisual Grounding

  9. Latent Visual Contrastive Reasoning with Multi-Branch Exploration

    Oct 27, 2026Kegeng Tang, Jingbo Wang, Yangming Zhang +3MLLM ReasoningLatent Visual Reasoning

  10. DecoyCount: Evaluating Visual-Reasoning Misalignment in Counting

    Oct 26, 2026Qiuyi, Zhang, Zhen Xu +14Visual CountingCounting in VLMs

  11. Game2Real-Bench: Do Toy Games Reveal and Transfer to Real-World Visual Reasoning?

    Oct 13, 2026Qingan Liu, Juntong Feng, Yue Zhu +6VLM EvaluationVisually Grounded Reasoning

  12. Genesis: Visual Augmentation Primitives for Multimodal Chain-of-Thought Reasoning

    Oct 11, 2026Fan Yang, Lifeng Chen, Yipu Wang +14VLM ReasoningMultimodal CoT Reasoning

  13. VC-OPD: Visual Counterfactual On-Policy Distillation for Grounded Vision-Language Reasoning

    Oct 10, 2026Jiahe FengVLM DistillationVisually Grounded Reasoning

  14. VisualCoding: Learning Executable Skills for Reliable Visual Reasoning

    Oct 9, 2026Jiaqi Liu, Ruinan Jin, Xiaoxiao LiVisual Program SynthesisVisually Grounded Reasoning

  15. Thinking with Images without Coordinates

    Oct 9, 2026Meng Cao, Haoze Zhao, Yi Wang +2VLM ReasoningVisually Grounded Reasoning

  16. MathVis: Can AI Reason through Drawing? A Benchmark for Mathematical Figure Generation

    Oct 9, 2026Jingjing Wei, Hao Zhao, Xinke Li +3Mathematical Reasoning BenchmarksLLM Mathematical Reasoning

  17. CaptchaAgent: Verifiable Visual Reasoning for CAPTCHA Solving

    Oct 9, 2026Shangquan Sun, Ruoyu Chen, Zhirui Liu +4CAPTCHA SolvingTool-Using Vision-Language Agents

  18. When Charts Deceive Web Agents: A Paired Benchmark for Misleading Visualization-Grounded Tasks

    Oct 9, 2026Yisheng Li, Dongming Han, Hongkun Pan +5Web AgentsAI Agent Reliability

  19. Humanity's Sixth Sense: Benchmarking Intuitive Visual Reasoning in Multimodal Models

    Oct 6, 2026Xingang Guo, Jing Gu, Brian Jang +26Visual ReasoningMultimodal Model Evaluation

  20. CVIF: A Criticality-Driven Visual Intervention Framework for Geometric Diagram Understanding in MLLMs

    Oct 5, 2026Jiahui Kang, Bifan Wei, Lingling Zhang +4Test-Time Adaptation of VLMsVisual Reasoning

  21. ReMAP: Restoring the Perceptual Cycle with Reasoning-Time Latent Visual Memory

    Oct 4, 2026Hao Jiang, Zhanyu Guo, Chenwei Wu +11Memory-Augmented VLMsEfficient Multimodal Inference

  22. SLVR: Structured Latent Visual Reasoning via Human-like Reasoning Flows

    Oct 1, 2026Albert Gao, Bing Xue, Andrea ZanetteVisual ReasoningLatent Visual Reasoning

  23. Hob-VL: A Benchmark for Visually Grounded Boolean Reasoning

    Oct 1, 2026Yuzhou Wang, Emile Anand, Ijay NarangVLM EvaluationVisual Question Answering

  24. MG-Thinker: Bi-Axial Self-Reflection for Multi-Image Reasoning Grounding

    Sep 29, 2026Heyu Huang, Chi Chen, Zonghao Guo +3Multimodal GroundingMultimodal CoT Reasoning

  25. On-Policy Visual Evidence Distillation

    Sep 29, 2026Shaohang Wei, Feifan Song, Guangyue Peng +9VLM DistillationVisually Grounded Reasoning

  26. FigAct: Turning Scientific Figures into Active Canvases for Explanation

    Sep 28, 2026Shishi Xiao, Zichao Wang, Alexa Siu +2Scientific VisualizationVisually Grounded Reasoning