Overview

The field studies how AI can recover the structure of 3D scenes, track objects across viewpoints, and reason about distance, direction, movement, and possible actions. Common approaches add depth and camera cues to vision-language models, build explicit maps or scene graphs, or use geometric tools and active multi-view exploration; others train structured reasoning with supervised data or reinforcement learning. These methods support tasks such as visual grounding, navigation, scene editing, and robotic manipulation, and are tested on image, video, point-cloud, and embodied benchmarks. A central challenge is that strong question-answering scores can hide reliance on 2D or linguistic shortcuts: models still struggle with occlusion, changing viewpoints, metric accuracy, and carrying spatial beliefs reliably into action.

Latest papers

CardsList

201 papers27 papers in the last four weeks, up 145% on the four weeks before. 0.2% of all new papers.

  1. Beyond Pattern Matching in 3D MLLMs: Part-Level Functional Reasoning for Generalizable Recognition

    Oct 23, 2026Weihong Li, Hao Jiang, Yaohua Zha +23D VLMs3D Spatial Reasoning

  2. VoxProg: 3D Spatial Reasoning through Voxel Programming

    Oct 21, 2026Zhichao Zhai, Menglei Zhao, Guikun Chen +43D Spatial Reasoning3D Scene Layout Generation

  3. SpatialBrain: Spatial Intelligence Growing from Experience

    Oct 21, 2026Yifan Zhou, Ziyang Gong, Xiaojun Ye +5Spatial Reasoning in Language ModelsSpatial Reasoning

  4. S-Agent 2.0: Spatial Reasoning with a General Coding Agent

    Oct 20, 2026Rui Gong, Ruoyu Wang, Yalun Dai +9Spatial Reasoning in Language Models3D Spatial Reasoning

  5. Relational Spatial Alignment for Vision-Language-Action Models

    Oct 17, 2026Chaoran Zhu, Hengyi Wang, Chenglin Cui +3Representation Alignment3D Spatial Reasoning

  6. DeSpatial: The devil of Agentic Spatial Reasoning Lies in 3D Itself

    Oct 14, 2026Yifei Liu, Xiaolong Zhou, Ziyang Gong +83D Spatial Reasoning3D Scene Understanding

  7. DynThinker: Unifying Static 3D and Dynamic 4D Spatial Reasoning

    Oct 14, 2026Qihang Cao, Haoyuan Li, Zihan Guo +8Spatiotemporal ReasoningSpatial Reasoning

  8. GeoThinker-FF: Endogenous Predictive World Representations for Fast Spatial Intelligence

    Oct 14, 2026Haoyuan Li, Qihang Cao, Huanyuan Zhou +103D VLMs3D Spatial Reasoning

  9. RoTA-Bench: Evaluating 3D Spatial Reasoning through Interactive Projection Alignment

    Oct 13, 2026Qingchuan Ma, Yuexiao Ma, Xiang Meng +73D Spatial ReasoningSpatial Reasoning Benchmarks

  10. GHOST: Geometry-Constrained Hybrid Diffusion for Open-Vocabulary 3D Scene Graph Generation

    Oct 12, 2026Changqun Feng, Wangxiandi Yin, Xin Hu +43D SGG3D Scene Understanding

  11. FloorSAV: Elucidating Spatial Audio-Visual Context with 2D Floormap for AV-LLMs

    Oct 8, 2026Kyeong-Rae Kim, Sungnyun Kim, Tae-Hyun Oh3D Spatial ReasoningAudio-Visual Understanding

  12. Never Look Back: Understanding Persistence in 3D Object Memory from Egocentric Videos

    Oct 7, 2026Shravan Chaudhari, William Paul, Suchi Saria +2Memory-Augmented Video UnderstandingEgocentric Video Understanding

  13. AssemState: Manual and Physical-State-Guided Reasoning for Zero-shot Furniture Assembly

    Oct 6, 2026Zhiyuan Qi, Jierui Li, Yifan Shen +2Robotic Assembly3D Spatial Reasoning

  14. Fine-Tuning VLM for Enhancing AI's Spatial Intelligence: Understanding 3D and 2D Rotations

    Oct 3, 2026Uttamasha Monjoree, Wei YanVisual Spatial Reasoning3D Spatial Reasoning

  15. Agentic AI with Structured CoT for Enhancing AI's Spatial Intelligence: Visualization and Reasoning of Rotation

    Oct 3, 2026Uttamasha Monjoree, Wei YanSpatial Reasoning BenchmarksStructured CoT Reasoning

  16. GeoLatent: Geometry-Guided Latent Structuring with Routed Optimization for 3D Reasoning

    Oct 1, 2026Yakun Zhu, Yi Bin, Yujuan Ding +53D Spatial ReasoningGeometric Representation Learning

  17. RelationVGGT: Visual Geometry Transformers for 3D Spatial Relation Segmentation

    Oct 1, 2026Minsu Kim, Jaesung Choe, Jiwoo Lee +23D ViTs3D Spatial Reasoning

  18. Uruqi: Learning Spatial Cognition from Visual Experience

    Sep 30, 2026Shichao Li, Meiqi Wang, Fei Su +1Spatial Reasoning BenchmarksVisual Spatial Reasoning

  19. Imagine3D-LLM: Teaching MLLMs to Imagine 3D Scenes Before Answering

    Sep 29, 2026Jaewoo Jung, Hyeonseo Yu, Honggyu An +103D Spatial Reasoning3D Scene Representation

  20. Spatial-OPSD: Self-Improving Spatial Reasoning via Label-Free Self-Distillation

    Sep 29, 2026Zhenyu Liu, Zhangquan Chen, Keyi Chen +4Visual Spatial Reasoning3D Spatial Reasoning

  21. Code4Scene: Benchmarking Coding Agents for Constructing and Editing 3D Scenes

    Sep 29, 2026Xiaokang Ye, Siddhant Hitesh Mantri, Zimeng Chen +6AI Coding Agents3D Scene Editing

  22. WM-VLM: Probing Internal World Models for Interleaved Visual-Textual Reasoning

    Sep 28, 2026Yuheng Zha, Yilei Wang, Qiyue Gao +5World Model Learning3D Spatial Reasoning

  23. Test-Time Spatial Reasoning for Robot Manipulation Using Generative Real-to-Sim

    Sep 27, 2026Ivan Kapelyukh, Yafei Hu, Ran Gong +6Real-to-Sim TransferRobotics Simulation

  24. SpatialSpeak: QA-Native Reconstruction with Local and Global Context for Spatial Chain-of-Thought Reasoning

    Sep 27, 2026Yang Cao, Jiaxin Zhang, Dave Zhenyu Chen +4Visual Spatial ReasoningMulti-View 3D Reconstruction

  25. SphMind: Towards Robust, Training-Free VLM-based Spatial Reasoning with a 360 Camera

    Sep 27, 2026Shriram Damodaran, Soumyaratna Debnath, Cheston Tan +1Test-Time Adaptation of VLMs3D Spatial Reasoning

  26. Retrieve-to-Localize: Bridging Large Language Models and LiDAR Geometry for Spatial Grounding

    Sep 24, 2026Byounggun Park, Giyong Moon, Jusung Kim +13D Spatial Reasoning3D VLMs