Overview

The field studies how AI can recover the structure of 3D scenes, track objects across viewpoints, and reason about distance, direction, movement, and possible actions. Common approaches add depth and camera cues to vision-language models, build explicit maps or scene graphs, or use geometric tools and active multi-view exploration; others train structured reasoning with supervised data or reinforcement learning. These methods support tasks such as visual grounding, navigation, scene editing, and robotic manipulation, and are tested on image, video, point-cloud, and embodied benchmarks. A central challenge is that strong question-answering scores can hide reliance on 2D or linguistic shortcuts: models still struggle with occlusion, changing viewpoints, metric accuracy, and carrying spatial beliefs reliably into action.

Latest papers

CardsList

202 papers25 papers in the last four weeks, up 47% on the four weeks before. 0.1% of all new papers.

  1. Running the Gauntlet: Hard Agentic Tasks

    Jun 12, 2026Mykola Vysotskyi, Runqi Lin, Grzegorz Biziel +203D Spatial ReasoningWeb Agent Benchmarks

  2. SpatialClaw: Rethinking Action Interface for Agentic Spatial Reasoning

    Jun 11, 2026Seokju Cho, Ryo Hachiuma, Abhishek Badki +8Tool Use in VLMs3D Spatial Reasoning

  3. The Art of Interrogation: Consistency Amplifies Factuality in Spatial Reasoning

    Jun 10, 2026Theo Uscidda, Marta Tintore Gazulla, Maks Ovsjanikov +2Reinforcement Learning3D Spatial Reasoning

  4. Ouroboros-Spatial: Closing the Data-Model Loop for Spatial Reasoning

    Jun 10, 2026Enhan Zhao, Wei Wu, Yuanrui Zhang +23D Spatial ReasoningSynthetic Data Generation

  5. Reason, Then Re-reason: Cross-view Revisiting Improves Spatial Reasoning

    Jun 10, 2026Chaofan Ma, Zhenjie Mao, Yuhuan Yang +5Visual Spatial Reasoning3D Spatial Reasoning

  6. Skill-3D: Evolving Scene-Aware Skills for Agentic 3D Spatial Reasoning

    Jun 5, 2026Haoyuan Li, Zhengdong Hu, Jun Wang +23D Spatial ReasoningTool-Using Vision-Language Agents

  7. Stream3D-VLM: Online 3D Spatial Understanding with Incremental Geometry Priors

    Jun 5, 2026Hanxun Yu, Xuan Qu, Lei Ke +43D Spatial Reasoning3D VQA

  8. 3DThinkVLA: Endowing Vision-Language-Action Models with Latent 3D Priors via 3D-Thinking-Guided Co-training

    Jun 3, 2026Jiaxin Shi, Xidong Zhang, Fucai Zhu +33D Spatial ReasoningRobotic Manipulation

  9. Distilling Neuro-Symbolic Programs into 3D Multi-modal LLMs

    May 31, 2026Wentao Mo, Yang LiuCoT Distillation3D Spatial Reasoning

  10. Reasmory: 3D Reconstruction as Explicit Memory for VLMs Spatial Reasoning

    May 31, 2026Jixuan He, Xueting Li, Chieh Hubert Lin +13D Spatial ReasoningVLM Reasoning

  11. SpatialAct: Probing Spatial Reasoning-to-Action Capabilities of VLM Agents in 3D Scenes

    May 29, 2026Tianhui Liu, Jie Feng, Zhiheng Zheng +6Vision-Language AgentsVisual Spatial Reasoning

  12. Grounded 3D-Aware Spatial Vision-Language Modeling

    May 28, 2026An-Chieh Cheng, Yang Fu, Yatai Ji +12Visually Grounded Reasoning3D Spatial Reasoning

  13. DGSG-Mind: Dynamic 3D Gaussian Scene Graphs for Long-Term Scene Understanding and Grounding

    May 28, 2026Luzhou Ge, Xiangyu Zhu, Jinyan Liu +13D Gaussian SplattingOpen-Vocabulary 3D Segmentation

  14. 3DVLA: Enhancing Vision-Language-Action Models via 3D Spatial and Instance Understanding

    May 28, 2026Zhongyu Xia, Yousen Tang, Bingqing Wei +13D Spatial ReasoningRobotic Manipulation

  15. Embodied3DBench: Benchmarking Low-Level Embodied Spatial Intelligence of Vision Language Models

    May 27, 2026Jiyao Zhang, Mingxu Zhang, Yitong Peng +8VLM EvaluationSpatial Reasoning Benchmarks

  16. SSR3D-LLM: Structured Spatial Reasoning via Latent Steps for Fine-Grained Grounding in Unified 3D-LLMs

    May 27, 2026Jiawei Li, Ziyi Liu, Weijie Shi +33D Spatial ReasoningLatent Visual Reasoning

  17. Q-GeoMem: Question-Guided Geometric Memory for Video Spatial Reasoning

    May 26, 2026Xianqiang Gao, Qizhi Chen, Delin Qu +53D Spatial ReasoningVideo Reasoning

  18. Bridging the 2D-3D Gap: A Hierarchical Semantic-Geometric Map for Vision Language Navigation

    May 25, 2026Kailing Li, Tianwen Qian, Lijin Yang +4VLN Benchmarks3D Spatial Reasoning

  19. Dual-Pathway Geometry-Aware MLLM for Spatial Intelligence

    May 25, 2026Yufei Zheng, Xuhan Zhu, Zide Liu +9Visual Spatial ReasoningMetric Depth Estimation

  20. Perceive-then-Plan: Layout-as-Policy for Monocular 3D Scene Layout Estimation

    May 25, 2026Junwei Zhou, Yu-Wing Tai3D Spatial Reasoning3D Scene Layout Generation

  21. EgoProx: Evaluating MLLMs on Egocentric 3D Proximity Reasoning Across a Cognitive Hierarchy

    May 23, 2026Jinzhao Li, Yinuo Chen, Dongxu Piao +9Embodied ReasoningLLM Evaluation

  22. Humanoid Whole-Body Manipulation via Active Spatial Brain and Generalizable Action Cerebellum

    May 20, 2026Zhizhao Liang, Yi-Lin Wei, Xuhang Chen +6Humanoid Loco-ManipulationLarge Language Model-Based Robot Planning

  23. CaMo: Camera Motion Grounded Evaluation and Training for Vision-Language Models

    May 19, 2026Hsiang-Wei Huang, Junbin Lu, Kuang-Ming Chen +3VLM EvaluationCamera Motion Understanding

  24. ESI-Bench: Towards Embodied Spatial Intelligence that Closes the Perception-Action Loop

    May 18, 2026Yining Hong, Jiageng Liu, Han Yin +5Active PerceptionSpatial Reasoning Benchmarks

  25. SPATIOROUTE: Dynamic Prompt Routing for Zero-Shot Spatial Reasoning

    May 18, 2026Pawat Chunhachatrachai, Gueter Josmy Faure, Hung-Ting Su +1Geospatial QAVisual Spatial Reasoning

  26. 3D Segmentation Using Viewpoint-Dependent Spatial Relationships

    May 15, 2026Ayaka Nanri, Klara Reichard, Mert Kiray +33D Spatial Reasoning3D Referring Segmentation