Spatial Reasoning Benchmarks

Overview

These benchmarks measure whether AI systems can go beyond recognizing objects to reason about geometry, direction, topology, perspective, and how scenes change over time. They use controlled synthetic puzzles, annotated images and videos, maps, and simulated or real embodied tasks, often with hierarchical tests and executable checks for precise answers or actions. Current models can handle some local relations but often fail at multi-step composition, consistent spatial maps across viewpoints, metric judgments, and long-horizon navigation. Structured representations, tools, active exploration, and targeted training can help, but reliable grounding in visual evidence and fair, standardized evaluation remain open challenges.

Latest papers

CardsList

162 papers35 papers in the last four weeks, up 150% on the four weeks before. 0.2% of all new papers.

  1. Mind the Gap Between Spatial Reasoning and Acting! Step-by-Step Evaluation of Agents With Spatial-Gym

    Apr 10, 2026Lars Benedikt Kaesberg, Tianyu Yang, Niklas Bauer +3Spatial Reasoning BenchmarksSpatial Reasoning

  2. PinpointQA: A Benchmark for Small Object-Centric Spatial Understanding in Indoor Videos

    Apr 10, 2026Zhiyu Zhou, Peilin Liu, Ruoxuan Zhang +4Spatial Reasoning BenchmarksVisual Spatial Reasoning

  3. How Far Are Large Multimodal Models from Human-Level Spatial Action? A Benchmark for Goal-Oriented Embodied Navigation in Urban Airspace

    Apr 9, 2026Baining Zhao, Ziyou Wang, Jianjie Fang +8Embodied NavigationSpatial Reasoning Benchmarks

  4. Enabling Intrinsic Reasoning over Dense Geospatial Embeddings with DFR-Gemma

    Apr 8, 2026Xuechen Zhang, Aviv Slobodkin, Joydeep Paul +4Geospatial ReasoningLLM Grounding

  5. TableVision: A Large-Scale Benchmark for Spatially Grounded Reasoning over Complex Hierarchical Tables

    Apr 4, 2026Xiaoyu Chen, Lu Dai, Hanqing Wang +6Table ReasoningSpatial Reasoning Benchmarks

  6. STAR: Mitigating Cascading Errors in Spatial Reasoning via Turn-point Alignment and Segment-level DPO

    Apr 1, 2026Pukun Zhao, Longxiang Wang, Chen Chen +4Spatial Reasoning in Language ModelsSpatial Reasoning

  7. OmniSch: A Multimodal PCB Schematic Benchmark For Structured Diagram Visual Reasoning

    Mar 31, 2026Taiting Lu, Kaiyuan Lin, Yuxin Tian +13Spatial Reasoning BenchmarksMultimodal Model Evaluation

  8. See, Remember, Explore: A Benchmark and Baselines for Streaming Spatial Reasoning

    Mar 25, 2026Yuxi Wei, Wei Huang, Qirui Chen +2Spatial Reasoning BenchmarksVisual Spatial Reasoning

  9. Mind over Space: Can Multimodal Large Language Models Mentally Navigate?

    Mar 23, 2026Qihui Zhu, Shouwei Ruan, Xiao Yang +6Multimodal Large Language ModelsVisual Spatial Reasoning

  10. CVT-Bench: Probing Spatial-State Integrity through Counterfactual Viewpoint Transformations

    Mar 22, 2026Shanmukha Vellamcheti, Uday Kiran Kothapalli, Disharee Bhowmick +1Spatial Reasoning BenchmarksMulti-View Consistency

  11. Attention in Space: Functional Roles of VLM Heads for Spatial Reasoning

    Mar 21, 2026Xueqi Ma, Shuo Yang, Yanbei Jiang +6Visual Spatial ReasoningAttention Head Analysis

  12. MultihopSpatial: Multi-hop Compositional Spatial Reasoning Benchmark for Vision-Language Model

    Mar 19, 2026Youngwan Lee, Soojin Jang, Yoorhim Cho +3Spatial Reasoning BenchmarksSpatial Reasoning

  13. VIEW2SPACE: Studying Multi-View Visual Reasoning from Sparse Observations

    Mar 17, 2026Fucai Ke, Zhixi Cai, Boying Li +6Visual ReasoningSpatial Reasoning Benchmarks

  14. ESPIRE: A Diagnostic Benchmark for Embodied Spatial Reasoning of Vision-Language Models

    Mar 13, 2026Yanpeng Zhao, Wentao Ding, Hongtao Li +2Embodied Spatial ReasoningSpatial Reasoning Benchmarks

  15. Spatial Reasoning is Not a Free Lunch: A Controlled Study on LLaVA

    Mar 13, 2026Nahid Alam, Leema Krishna Murali, Siddhant Bharadwaj +7Spatial Reasoning in Language ModelsVisual Spatial Reasoning

  16. TopoBench: Benchmarking LLMs on Hard Topological Reasoning

    Mar 12, 2026Mayug Maniparambil, Nils Hoehing, Janak Kapuriya +5Constraint-Guided Reasoning in Language ModelsSpatial Reasoning Benchmarks

  17. Seeing Isn't Orienting: A Cognitively Grounded Benchmark Reveals Systematic Orientation Failures in MLLMs Supplementary

    Mar 12, 2026Nazia Tasnim, Keanu Nichols, Yuting Yang +4VLM ReasoningVLM Evaluation

  18. Stepping VLMs onto the Court: Benchmarking Spatial Intelligence in Sports

    Mar 10, 2026Yuchen Yang, Yuqing Shao, Duxiu Huang +11Sports AnalyticsSpatial Reasoning

  19. Quantifying and extending the coverage of spatial categorization data sets

    Mar 10, 2026Wanchun Li, Alexandra Carstensen, Yang Xu +2Spatial Reasoning BenchmarksLLM-Assisted Annotation

  20. Do 3D Large Language Models Really Understand 3D Spatial Relationships?

    Mar 6, 2026Xianzheng Ma, Tao Sun, Shuai Chen +73D Spatial Reasoning3D VQA

  21. Spatial Competence Benchmark

    Mar 5, 2026Jash Vira, Ashley HarrisSpatial Reasoning BenchmarksSpatial Reasoning

  22. SCP: Spatial Causal Prediction in Video

    Mar 4, 2026Yanguang Zhao, Jie Yang, Shengqiong Wu +9Spatiotemporal ReasoningCausal Reasoning in Videos

  23. SpatialText: A Pure-Text Cognitive Benchmark for Spatial Understanding in Large Language Models

    Mar 3, 2026Peiyao Jiang, Zequn Qin, Xi LiSpatial Reasoning in Language ModelsSpatial Reasoning