Overview

The field studies how AI can recover the structure of 3D scenes, track objects across viewpoints, and reason about distance, direction, movement, and possible actions. Common approaches add depth and camera cues to vision-language models, build explicit maps or scene graphs, or use geometric tools and active multi-view exploration; others train structured reasoning with supervised data or reinforcement learning. These methods support tasks such as visual grounding, navigation, scene editing, and robotic manipulation, and are tested on image, video, point-cloud, and embodied benchmarks. A central challenge is that strong question-answering scores can hide reliance on 2D or linguistic shortcuts: models still struggle with occlusion, changing viewpoints, metric accuracy, and carrying spatial beliefs reliably into action.

Latest papers

CardsList

201 papers25 papers in the last four weeks, up 47% on the four weeks before. 0.1% of all new papers.

  1. PanoWorld: Towards Spatial Supersensing in 360∘^\circ Panorama World

    May 13, 2026Changpeng Wang, Xin Lin, Junhan Liu +53D Spatial Reasoning3D Scene Understanding

  2. 3D Primitives are a Spatial Language for VLMs

    May 12, 2026Junze Liu, Kun Qian, Florian Dubost +8Visually Grounded Reasoning3D Spatial Reasoning

  3. SpatialForge: Bootstrapping 3D-Aware Spatial Reasoning from Open-World 2D Images

    May 12, 2026Zishan Liu, Ruoxi Zang, Yanglin Zhang +5Geospatial QAVisual Spatial Reasoning

  4. VEGA: Visual Encoder Grounding Alignment for Spatially-Aware Vision-Language-Action Models

    May 11, 2026Hao Wang, Xiaobao Wei, Jingyang He +103D Spatial ReasoningSpatial Grounding for VLA Models

  5. Beyond Spatial Compression: Interface-Centric Generative States for Open-World 3D Structure

    May 11, 2026Xiang Chen, Alexander Binder3D Asset Generation3D Spatial Reasoning

  6. ViSRA: A Video-based Spatial Reasoning Agent for Multi-modal Large Language Models

    May 11, 2026Tingshu Mou, Jiabo He, Renying Wang +5Visual Spatial Reasoning3D Spatial Reasoning

  7. Distilling 3D Spatial Reasoning into a Lightweight Vision-Language Model with CoT

    May 10, 2026Alaa Asfour, Christopher Indris, Leihan Chen +2Cross-Modal Knowledge Distillation3D Spatial Reasoning

  8. Do multimodal models imagine electric sheep?

    May 10, 2026Santhosh Kumar Ramakrishnan, Carl Vondrick, Raja Giryes +2Visual Spatial ReasoningWorld Model Learning

  9. SpaceMind++: Toward Allocentric Cognitive Maps for Spatially Grounded Video MLLMs

    May 10, 2026Bo Gu, Zhikang Zhang, Zizhuang Wei +33D Spatial ReasoningVLM Reasoning

  10. Flame3D: Zero-shot Compositional Reasoning of 3D Scenes with Agentic Language Models

    May 9, 2026Sagar Bharadwaj, Ziyong Ma, Anurag Ghosh +2Tool Use in VLMs3D Spatial Reasoning

  11. Lost in Volume: The CT-SpatialVQA Benchmark for Evaluating Semantic-Spatial Understanding of 3D Medical Vision-Language Models

    May 9, 2026Mashrafi Monon, Umaima Rahman, Asif Hanif +2VLM Evaluation3D Spatial Reasoning

  12. Proxy3D: Efficient 3D Representations for Vision-Language Models via Semantic Clustering and Alignment

    May 8, 2026Jerry Jiang, Haowen Sun, Denis Gudovskiy +43D Spatial Reasoning3D Representation Learning

  13. 2.5-D Decomposition for LLM-Based Spatial Construction

    May 8, 2026Paul Whitten, Li-Jen Chen, Sharath BaddamLLM Planning3D Spatial Reasoning

  14. R3^3L: Reasoning 3D Layouts from Relative Spatial Relations

    May 7, 2026Zhifeng Gu, Yuqi Wang, Bing Wang3D Spatial Reasoning3D Scene Generation

  15. ConsisVLA-4D: Advancing Spatiotemporal Consistency in Efficient 3D-Perception and 4D-Reasoning for Robotic Manipulation

    May 6, 2026Wei Li, Jizhihui Liu, Li Yixing +3Multi-View ConsistencySpatiotemporal Reasoning

  16. CasLayout: Cascaded 3D Layout Diffusion for Indoor Scene Synthesis with Implicit Relation Modeling

    Apr 30, 2026Yingrui Wu, Youkang Kong, Mingyang Zhao +33D Spatial Reasoning3D Scene Generation

  17. ReVSI: Rebuilding Visual Spatial Intelligence Evaluation for Accurate Assessment of VLM 3D Reasoning

    Apr 27, 2026Yiming Zhang, Jiacheng Chen, Jiaqi Tan +3VLM EvaluationSpatial Reasoning Benchmarks

  18. Reinforcing 3D Understanding in Point-VLMs via Geometric Reward Credit Assignment

    Apr 23, 2026Jingkun Chen, Ruoshi Xu, Mingqi Gao +23D Spatial ReasoningVLM Hallucination

  19. Exploring Spatial Intelligence from a Generative Perspective

    Apr 22, 2026Muzhi Zhu, Shunyao Jiang, Huanyi Zheng +9Spatial ReasoningUnified Multimodal Models

  20. CAPruner: Conceptual-Adjacent Scene Graph Pruner for Enhancing 3D Spatial Reasoning of Large Language Models

    Apr 21, 2026Shengli Zhou, Xiangchen Wang, Guanhua Chen +13D Spatial ReasoningVLM Reasoning

  21. XEmbodied: A Foundation Model with Enhanced Geometric and Physical Cues for Large-Scale Embodied Environments

    Apr 20, 2026Kangan Qian, ChuChu Xie, Yang Zhong +133D Spatial ReasoningEmbodied QA

  22. Beyond a Single Frame: Multi-Frame Spatially Grounded Reasoning Across Volumetric MRI

    Apr 17, 2026Lama Moukheiber, Caleb M. Yeung, Haotian Xue +33D Spatial Reasoning3D Medical Imaging

  23. SpatialEvo: Self-Evolving Spatial Intelligence via Deterministic Geometric Environments

    Apr 15, 2026Dinging Li, Yingxiu Zhao, Xinrui Cheng +163D Spatial ReasoningSelf-Training

  24. GeoAlign: Geometric Feature Realignment for MLLM Spatial Reasoning

    Apr 14, 2026Zhaochen Liu, Limeng Qiao, Guanglu Wan +13D Spatial Reasoning3D VLMs

  25. Geoparsing: Diagram Parsing for Plane and Solid Geometry with a Unified Formal Language

    Apr 13, 2026Peijie Wang, Ming-Liang Zhang, Jun Cao +103D Spatial ReasoningMultimodal Large Language Models

  26. MAG-3D: Multi-Agent Grounded Reasoning for 3D Understanding

    Apr 10, 2026Henry Zheng, Chenyue Fang, Rui Huang +33D Spatial Reasoning3D Scene Understanding

  27. AssemLM: A Spatial Reasoning Multimodal Large Language Model for Robotic Assembly

    Apr 10, 2026Zhi Jing, Jinbin Qiao, Ouyang Lu +53D Spatial ReasoningRobotic Assembly

  28. 3DrawAgent: Teaching LLM to Draw in 3D with Early Contrastive Experience

    Apr 9, 2026Hongcan Xiao, Xinyue Xiao, Yilin Wang +23D Spatial ReasoningRL for Generative Models

  29. OpenSpatial: A Principled Data Engine for Empowering Spatial Intelligence

    Apr 8, 2026Jianhui Liu, Haoze Sun, Wenbo Li +113D Spatial ReasoningSynthetic Data Generation

  30. Enhancing MLLM Spatial Understanding via Active 3D Scene Exploration for Multi-Perspective Reasoning

    Apr 8, 2026Jiahua Chen, Qihong Tang, Weinong Wang +13D Spatial ReasoningVLM Reasoning