Visually Grounded Reasoning

Follow this topic Ask about this topic

Momentum

17 papers in the last four weeks, up 183% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 285

All topics

GeoWeaver: Grounding Visual Tokens with Geometric Evidence before Scene Reasoning
May 21, 2026Deshui Miao, Xingsen Huang, Yameng Gu +3Visual Spatial Reasoning Spatiotemporal Reasoning
Harbin Institute of Technology, Shenzhen · Hainan University · Pengcheng Laboratory +2
Faithful-MR1: Faithful Multimodal Reasoning via Anchoring and Reinforcing Visual Attention
May 21, 2026Changyuan Tian, Zhicong Lu, Huaxing Liu +7Multimodal Large Language Models Multimodal Reasoning
AMAP, Alibaba Group · University of Chinese Academy of Sciences · Tsinghua University +1
Visual-Advantage On-Policy Distillation for Vision-Language Models
May 21, 2026Ruiqi Liu, Xiaolei Lv, Gengsheng Li +8Vision-Language Models VLM Distillation
Institute of Automation, CAS · School of Advanced Interdisciplinary Sciences, UCAS · 3Hello +1
MM-Conv: A Multimodal Dataset and Benchmark for Context-Aware Grounding in 3D Dialogue
May 20, 2026Anna Deichler, Jim O'Regan, Fethiye Irmak Dogan +4Query Reformulation Visually Grounded Reasoning
KTH Royal Institute of Technology, Stockholm, Sweden
SceneGraphGrounder: Zero-Shot 3D Visual Grounding via Structured Scene Graph Matching
May 20, 2026Xuefei Sun, Xujia Zhang, Brendan Crowe +23D SGG Visually Grounded Reasoning
University of Colorado Boulder
VISTAQA: Benchmarking Joint Visual Question Answering and Pixel-Level Evidence
May 20, 2026Mozhgan Nasr Azadani, Yimu Wang, Yongpeng Zhu +5VLM Evaluation Visual Question Answering
University of Waterloo · Stanford University · NVIDIA
Do Vision-Language Models Understand 3D Scenes or Just Catalogue Objects?
May 19, 2026Animesh Maheshwari, Divyansh Sahu, Nishit VermaVLM Evaluation Spatial Reasoning Benchmarks
Deccan AI
From Seeing to Thinking: Decoupling Perception and Reasoning Improves Post-Training of Vision-Language Models
May 19, 2026Juncheng Wu, Hardy Chen, Haoqin Tu +6Vision-Language Models VLM Reasoning
Amazon · UC Santa Cruz · University of Waterloo +1
GeoX: Mastering Geospatial Reasoning Through Self-Play and Verifiable Rewards
May 19, 2026Kyeongjin Ahn, Seungeon Lee, Krishna P. Gummadi +1Self-Play RL Geospatial Reasoning
KAIST · MPI-SWS · MPI-SP
EgoCoT-Bench: Benchmarking Grounded and Verifiable Operation-Centric Chain of Thought Reasoning for MLLMs
May 19, 2026Yang Dai, Dian Jiao, Tianwei Lin +1Egocentric Video QA CoT Reasoning
Zhejiang University · Hangzhou, Zhejiang, China
Leveraging Latent Visual Reasoning in Silence
May 18, 2026Dongyao Zhu, Zhen Wang, Xi Xiao +7Visual Spatial Reasoning Latent Visual Reasoning
North Carolina State University · UC, San Diego · University of Alabama at Birmingham +4
AtlasVA: Self-Evolving Visual Skill Memory for Teacher-Free VLM Agents
May 18, 2026Pan Wang, Yihao Hu, Xiujin Liu +3Memory-Augmented VLMs Reward Shaping
Ant Group · University of Science and Technology of China · Westlake University +2
CounterCount: A Diagnostic Framework for Counting Bias in Vision Language Models
May 18, 2026Reem Alzahrani, Hassan Alshanqiti, Bushra Bin Hemid +3VLM Evaluation Vision-Language Models
King Abdullah University of Science and Technology, Thuwal, Saudi Arabia. · University of Edinburgh · KAUST
GeoWorld-VLM: Geometry from World Models for Vision-Language Models
May 15, 2026Renjie Gu, Kaichen Zhou, Yan Luo +1Visual Spatial Reasoning VLM Adaptation
Harvard AI and Robotics Lab · Kempner Institute for the Study of Natural and Artificial Intelligence · Harvard University
Are VLMs Seeing or Just Saying? Uncovering the Illusion of Visual Re-examination
May 15, 2026Chufan Shi, Cheng Yang, Yaokang Wu +4VLM Evaluation VLM Robustness
University of Southern California · University of California San Diego · Carnegie Mellon Univer +1
Minerva-Ego: Spatiotemporal Hints for Egocentric Video Understanding
May 14, 2026Arsha Nagrani, Jasper Uijilings, Shyamal Buch +6Egocentric Video QA Egocentric Video Understanding
Google DeepMind
MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memory
May 14, 2026Minghao Guo, Qingyue Jiao, Zeru Shi +14Multimodal Memory AI Agent Evaluation
Rutgers · Notre Dame · Princeton +1
GeoVista: Visually Grounded Active Perception for Vision-Language Understanding of Ultra-High-Resolution Remote Sensing Images
May 14, 2026Jiashun Zhu, Ronghao Fu, Jiasen Hu +3Remote Sensing Image Understanding Remote Sensing VQA
College of Computer Science and Technology, Jilin University, Changchun 130021, China · Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Changchun 130021, China · Institute of Information Engineering, Chinese Academy of Sciences, Beijing 100000, China +1
CurveBench: A Benchmark for Exact Topological Reasoning over Nested Jordan Curves
May 13, 2026Amirreza Mohseni, Mona Mohammadi, Morteza Saghafian +1VLM Evaluation Spatial Reasoning Benchmarks
Maastricht University · Cornell University · TU Wien +1
Bad Seeing or Bad Thinking? Rewarding Perception for Multimodal Reasoning
May 13, 2026Haozhe Wang, Qixin Xu, Changpeng Wang +4Multimodal Reasoning VLM Reasoning
1Hong Kong University of Science and Technology (HKUST) · 2Tsinghua University · 3Zhejiang University +2
CAVE: A Structured Credit Assignment Approach for Fragmented Visual Evidence Reasoning
May 13, 2026Tengda Guo, Jie Leng, Hanlei Li +6Process Reward Models Visual Reasoning
Tsinghua University · Peking University · Zhejiang University of Technology
Guide, Think, Act: Interactive Embodied Reasoning in Vision-Language-Action Models
May 13, 2026Yiran Ling, Qing Lian, Jinghang Li +6Robotic Control Robot Policy Learning
Faculty of Computing, Harbin Institute of Technology · International Digital Economy Academy (IDEA) · National Key Laboratory of Smart Farm Technologies and Systems +4
PDCR: Perception-Decomposed Confidence Reward for Vision-Language Reasoning
May 13, 2026Hee Suk Yoon, Eunseop Yoon, Ji Woo Hong +6VLM Reasoning Reinforcement Learning with Verifiable Rewards
Korea Advanced Institute of Science and Technology (KAIST) · Microsoft Research Asia (MSRA) · University of Illinois at Urbana-Champaign (UIUC)
3D Primitives are a Spatial Language for VLMs
May 12, 2026Junze Liu, Kun Qian, Florian Dubost +8Spatial Reasoning Benchmarks 3D Spatial Reasoning
Unity Technologies
Beyond Localization: A Comprehensive Benchmark of Perspective-Conditioned Spatial Reasoning in MLLMs from Omnidirectional Images
May 12, 2026Yuangong Chen, Wai Keung Wong, Jiaxing Li +2Spatial Reasoning Benchmarks Visual Spatial Reasoning
The Hong Kong Polytechnic University Hong Kong, China · Guangzhou University Guangzhou, China · Queen Mary, University of London London, United Kingdom +1
UHR-Micro: Diagnosing and Mitigating the Resolution Illusion in Earth Observation VLMs
May 12, 2026Shuo Ni, Tong Wang, Jing Zhang +5VLM Evaluation Remote Sensing Image Understanding
National Key Laboratory of Science and Technology on Space-Born Intelligent Information Processing, Beijing Institute of Technology, Beijing, China · Zhongguancun Academy, Beijing, China · School of Computer Science, Wuhan University, Wuhan, China +2
Self-Consistent Latent Reasoning: Long Latent Sequence Reasoning for Vision-Language Model
May 12, 2026Chenfeng Wang, Wei He, Xuhan Zhu +10Visual Reasoning Latent Visual Reasoning
University of Science and Technology of China · Li Auto Inc.
UniVLR: Unifying Text and Vision in Visual Latent Reasoning for Multimodal LLMs
May 12, 2026Houcheng Jiang, Jiajun Fu, Junfeng Fang +4Efficient Multimodal Inference Multimodal Large Language Models
University of Science and Technology of China · Zhongguancun Academy · National University of Singapore +1
Allegory of the Cave: Measurement-Grounded Vision-Language Learning
May 12, 2026Kepeng Xu, Li Xu, Gang He +1Large Vision-Language Models Vision-Language Grounding
Xidian University · Southwest University of Science and Technology
Grounding by Remembering: Cross-Scene and In-Scene Memory for 3D Functional Affordances
May 12, 2026Qirui Wang, Jingyi He, Yining Pan +2Visually Grounded Reasoning Memory-Augmented Agents
TUM · A*STAR

May 21, 2026, cs.CVJ/K move · Enter open · S save

GeoWeaver: Grounding Visual Tokens with Geometric Evidence before Scene Reasoning

Deshui Miao, Xingsen Huang, Yameng Gu, Xin Li+2

Harbin Institute of Technology, Shenzhen · Hainan University · Pengcheng Laboratory+2

Visual Spatial Reasoning Spatiotemporal Reasoning VLM Reasoning Visually Grounded Reasoning

Open paper AskPDF arXiv

Spatio-temporal reasoning in vision-language models requires visual representations that preserve physical geometry rather than merely semantic appearance. Recent multimodal models incorporate geometric information through structural branches, 3D-aware supervision, reasoning-stage fusion, or long-horizon memory. While these approaches demonstrate the importance of geometry for spatial intelligence, they typically treat geometric cues as a shared signal across all visual tokens. We note that this overlooks a finer-grained challenge: different visual tokens require different geometric evidence depending on their spatial roles. To address this limitation, we introduce GeoWeaver, a pre-reasoning geometric grounding framework that treats geometry as a representational prerequisite for spatio-temporal reasoning. GeoWeaver constructs a multi-level geometry bank from a frozen geometry encoder and performs token-adaptive geometric evidence allocation, enabling each visual token to retrieve the most relevant geometric abstractions. The selected evidence is incorporated into visual tokens via a residual grounding operation prior to language modeling, yielding geometry-grounded representations for downstream reasoning. Extensive evaluations on spatial reasoning benchmarks demonstrate that GeoWeaver consistently enhances geometry-aware reasoning while retaining general multimodal capabilities. This indicates that geometric information yields the greatest benefit not as a late-fusion auxiliary signal but as a fundamental prerequisite that shapes the representational foundation on which large language models perform reasoning. All source code and models will be released at https://github.com/yahooo-m/GeoWeaver .

Momentum

Related topics

Latest papers 285