Spatial Reasoning Benchmarks

Follow this topic Ask about this topic

Momentum

15 papers in the last four weeks, up 200% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 83

All topics

SpatialQuery: Benchmarking Geometry-Grounded Multi-Instance Spatial Reasoning in Vision-Language Models
Aug 3, 2026Hai Nguyen, Tung Vu, Cong TranSpatial Reasoning Benchmarks 3D Spatial Reasoning
Posts and Telecommunications Institute of Technology, Hanoi, Vietnam
JigShape: Evaluating Visual-Geometric Reasoning in VLMs through Jigsaw Puzzles
Jul 30, 2026Shawn Li, Wei Yang, Jike Zhong +11VLM Evaluation Spatial Reasoning Benchmarks
University of Southern California · National University of Singapore · Adobe Research +3
Visual Credit Audit for Multimodal Spatial Reasoning
Jul 29, 2026Feixiang Liu, Qiang Qiu, Lanbo Sun +3VLM Evaluation Spatial Reasoning Benchmarks
State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences · University of Chinese Academy of Sciences
Spatial-IQ: Deconstructing Spatial Intelligence via Hierarchical Capability Tests
Jul 24, 2026Patrick Rim, Tom Long, Ekta Prashnani +6Spatial Reasoning Benchmarks Visual Spatial Reasoning
1NVIDIA Research · 2Yale University
Show, Don't Tell: Evaluating Spatial Cognition in Generative Pixels Rather Than LLM Text
Jul 23, 2026Xu Wang, Kaixiang Yao, Miao Pan +4Spatial Reasoning Benchmarks Visual Spatial Reasoning
OmniAI Group of ZJU ACES Lab
ViSTR-Bench: Can MLLMs Reason from Continuous Visual Cues in Dynamic Scenes?
Jul 23, 2026Han Li, Si Liu, Zehao Huang +6VLM Evaluation Spatial Reasoning Benchmarks
School of Artificial Intelligence, Beihang University, Beijing 100191, China · Zhongguancun Academy, Beijing 100094, China · School of Engineering, Westlake University, Hangzhou 310030, China
Do Maps Still Matter for Machines: Revisiting the Role of Choropleth Maps in Foundation Model Spatial Understanding
Jul 20, 2026Zhiwei Wei, Yonghe Sun, Zhenjia Liu +5Data Visualization Spatial Reasoning Benchmarks
aSchool of Geographic Sciences, Hunan Normal University, Changsha, China · bHunan Key Laboratory of Geospatial Big Data Mining and Application, Changsha, China · cSchool of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing, China +3
TerraLogic: A Benchmark for Hierarchical Geospatial Reasoning in Earth Observation
Jul 14, 2026Yuhang Yan, Linchao Mou, Bokang Yang +1Spatial Reasoning Benchmarks Hierarchical Planning
The Chinese University of Hong Kong (Shenzhen) China · Technical University of Munich Germany
IDEAL-Bench: Indoor Dataset and Evaluation suite for Analyzing 3D Layout reasoning
Jul 3, 2026Yuening Cai, Junwei Zhou, Youran Qu +1VLM Evaluation Spatial Reasoning Benchmarks
Department of Computer Science Dartmouth College
R3D: Quantitative 3D Spatial Reasoning for Egocentric Wearables
Jul 3, 2026Maxwell Horton, Wei Lu, Quan Tran +6Spatial Reasoning Benchmarks 3D Spatial Reasoning
Meta Reality Labs
MindEdit-Bench: Benchmarking Object-Level Counterfactual Spatial Reasoning in VLMs from In-the-Wild Photos
Jul 1, 2026Leyuan Yu, Xiao Tang, Minghao Liu +6VLM Evaluation Spatial Reasoning Benchmarks
ZODA · Tongji University · Zhejiang University +1
HumanMoveVQA: Can Video MLLMs reason about human movement in videos?
Jun 26, 2026Pulkit Gera, Faegheh Sardari, Asmar Nadeem +4VLM Evaluation Spatial Reasoning Benchmarks
CVSSP, University of Surrey, Guildford, UK · Tesco, UK
From Hallucination to Grounding: Diagnosing Visual Spatial Intelligence via CRISP
Jun 25, 2026Zhixing Li, Yinan YuVLM Evaluation Spatial Reasoning Benchmarks
Chalmers University of Technology, Gothenburg, Sweden
TriViewBench: Controlled Complexity Scaling for Multi-View Structural Reasoning in MLLMs
Jun 24, 2026Yu-Yang Chen, Lan-Zhe GuoSpatial Reasoning Benchmarks Visual Reasoning
School of Intelligence Science and Technology, Nanjing University, China · National Key Laboratory for Novel Software Technology, Nanjing University, China
MapReason-OSM: Can Vision-Language Models Make Graph-Verifiable Mobility Decisions from Street Maps ?
Jun 21, 2026Srinivas Venkatanarayanan, Clement Pakkam IsaacVLM Evaluation Spatial Reasoning Benchmarks
NVIDIA · University of Central Florida · University of South Florida
CVSBench: A Comprehensive Benchmark for Cross-view Spatial Reasoning and Dreaming
Jun 21, 2026Ruixun Liu, Lingyu Zhang, Lanxuan Xue +3VLM Evaluation Spatial Reasoning Benchmarks
Faculty of Electronic and Information Engineering, Xi’an Jiaotong University · Ministry of Education Key Laboratory of Intelligent Networks and Network Security
Keep It in Mind: User Centric Continual Spatial Intelligence Reasoning in Egocentric Video Streams
Jun 13, 2026Yun Wang, Junbin Xiao, Han Lyu +6Spatial Reasoning Benchmarks Streaming Video Understanding
Department of Computer Science, City University of Hong Kong · University of Science and Technology of China · National University of Singapore +4
Embodied-BenchClaw: An Autonomous Multi-Agent System for Embodied Spatial Intelligence Benchmark Construction
Jun 10, 2026Baoyang Jiang, Fengchun Zhang, Leyuan Wang +7Spatial Reasoning Benchmarks Synthetic Benchmark Generation
QiYuan Lab · School of Information and Software Engineering, University of Electronic Science and Technology of China · Beijing University of Posts and Telecommunications +2
SpatialWorld: Benchmarking Interactive Spatial Reasoning of Multimodal Agents in Real-World Tasks
Jun 8, 2026Hongcheng Gao, Hailong Qu, Jingyi Tang +18Spatial Reasoning Benchmarks Visual Spatial Reasoning
Tsinghua University · Chongqing University · Peking University +6
PlanBench-V: A Spatial Planning Map Benchmark for Vision-Language Models
Jun 4, 2026Minxin Chen, He Zhu, Junyou Su +3VLM Evaluation Spatial Reasoning Benchmarks
1Behavioral and Spatial AI Lab, Tongji University · 2Behavioral and Spatial AI Lab, Peking University · College of Architecture and Urban Planning, Tongji University
From Symbolic to Geometric: Enabling Spatial Reasoning in Large Language Models
Jun 3, 2026Chen Chu, Bita Azarijoo, Li Xiong +2Spatial Reasoning Benchmarks Multimodal Large Language Models
University of Southern California Los Angeles, CA, USA · Emory University Atlanta, GA, USA · Novateur Research Solutions Ashburn, Virginia, USA
OVO-S-Bench: A Hierarchical Benchmark for Streaming Spatial Intelligence in Multimodal LLMs
Jun 2, 2026Yifei Li, Pengyiang Liu, Yuhang Zang +4Spatial Reasoning Benchmarks Spatiotemporal Reasoning
Tsinghua University · Shanghai AI Laboratory · Beihang University
Eliciting Complex Spatial Reasoning in MLLMs through Wide-Baseline Matching
Jun 2, 2026Hao Zhong, Muzhi Zhu, Shenyan Zeng +8VLM Evaluation Spatial Reasoning Benchmarks
State Key Laboratory of CAD & CG, Zhejiang University · Ant Group · Westlake University
Consistent Yet Wrong: Evidence Insensitivity in Spatial Vision-Language Models
Jun 1, 2026S Divakar Bhat, Toshihiko YamasakiVLM Evaluation Multi-View Consistency
The University of Tokyo, Japan
PlanarBench: Evaluating LLM Spatial Reasoning via Planar Graph Drawing
Jun 1, 2026Oleksandr Nikitin, Anna KravchenkoSpatial Reasoning Benchmarks LLM Evaluation
ERGeoBench:A Comprehensive Benchmark for Embodied Reasoning and Geo-localization in Multimodal Large Language Models
May 29, 2026Kaiwen Xue, Tao Wei, Guoxin Zhang +5Spatial Reasoning Benchmarks Visual Spatial Reasoning
Beijing University of Posts and Telecommunications, Beijing, China · State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing, China · School of Materials Science and Engineering, Shanghai Jiao Tong University, Shanghai, China +2
SpatialAct: Probing Spatial Reasoning-to-Action Capabilities of VLM Agents in 3D Scenes
May 29, 2026Tianhui Liu, Jie Feng, Zhiheng Zheng +6Spatial Reasoning Benchmarks Visual Spatial Reasoning
1The Hong Kong University of Science and Technology (Guangzhou) · 2Zhongguancun Academy · 3Tsinghua University +1
Seeing Isn't Knowing: Do VLMs Know When Not to Answer Spatial Questions (and Why)?
May 28, 2026Yue Zhang, Zun Wang, Han Lin +3VLM Evaluation Spatial Reasoning Benchmarks
UNC Chapel Hill · Google Research
Why Far Looks Up: Probing Spatial Representation in Vision-Language Models
May 28, 2026Cheolhong Min, Jaeyun Jung, Daeun Lee +5VLM Evaluation Spatial Reasoning Benchmarks
Seoul National University · The Ohio State University · NVIDIA
Embodied3DBench: Benchmarking Low-Level Embodied Spatial Intelligence of Vision Language Models
May 27, 2026Jiyao Zhang, Mingxu Zhang, Yitong Peng +8VLM Evaluation Spatial Reasoning Benchmarks

Aug 3, 2026, cs.CVJ/K move · Enter open · S save

SpatialQuery: Benchmarking Geometry-Grounded Multi-Instance Spatial Reasoning in Vision-Language Models

Hai Nguyen, Tung Vu, Cong Tran

Posts and Telecommunications Institute of Technology, Hanoi, Vietnam

Spatial Reasoning Benchmarks 3D Spatial Reasoning VLM Reasoning Spatial Reasoning

Open paper AskPDF arXiv

Vision-language models (VLMs) achieve strong semantic understanding but remain unreliable in metric spatial reasoning, particularly when queries require comparing multiple instances of the same object category. We study this problem through the Closest-Instance Distance Query (CIDQ), where a model must identify the nearest visible candidate to a unique reference object and estimate their gravity-aligned floor-plane distance. We introduce SPATIALQUERY, a training- free framework for CIDQ reasoning from a single RGB image, together with SPATIALQUERY-1M, a benchmark containing over one million RGB-only question-answer pairs from 200 indoor scenes. SPATIALQUERY recovers instance-level metric geometry and transforms it into a canonical Bird's-Eye View through Scene Cubifying, which represents objects as uniformly sized, category-coded blocks to emphasize their relative floor- plane locations. We further propose Uncertainty-Aware Chain-of-Thought (UA-CoT) prompting, which incorporates geometry- derived per-instance uncertainty into the VLM reasoning process. Without task-specific fine-tuning or architectural modification, SPATIALQUERY with Qwen3-VL-8B achieves a Floor-MAE of 0.259 m, an [email protected] m of 90.5%, and a proximity-decision accuracy of 84.18%, outperforming fine-tuned spatial specialists, general-purpose VLMs, and closed-source frontier models. Code, benchmark resources, and an interactive demo are available at https://namhai1810.github.io/SpatialQuery/.

Momentum

Related topics

Latest papers 83