Overview

The field studies how AI can recover the structure of 3D scenes, track objects across viewpoints, and reason about distance, direction, movement, and possible actions. Common approaches add depth and camera cues to vision-language models, build explicit maps or scene graphs, or use geometric tools and active multi-view exploration; others train structured reasoning with supervised data or reinforcement learning. These methods support tasks such as visual grounding, navigation, scene editing, and robotic manipulation, and are tested on image, video, point-cloud, and embodied benchmarks. A central challenge is that strong question-answering scores can hide reliance on 2D or linguistic shortcuts: models still struggle with occlusion, changing viewpoints, metric accuracy, and carrying spatial beliefs reliably into action.

Latest papers

CardsList

201 papers25 papers in the last four weeks, up 47% on the four weeks before. 0.1% of all new papers.

  1. On the Generalization Capacities of MLLMs for Spatial Intelligence

    Mar 5, 2026Gongjie Zhang, Wenhao Li, Quanhao Qian +4Multimodal Large Language Models3D Spatial Reasoning

  2. SpatialText: A Pure-Text Cognitive Benchmark for Spatial Understanding in Large Language Models

    Mar 3, 2026Peiyao Jiang, Zequn Qin, Xi LiSpatial Reasoning in Language ModelsSpatial Reasoning

  3. pySpatial: Generating 3D Visual Programs for Zero-Shot Spatial Reasoning

    Mar 1, 2026Zhanpeng Luo, Ce Zhang, Silong Yong +6Visual Program Synthesis3D Spatial Reasoning

  4. SSR: Pushing the Limit of Spatial Intelligence with Structured Scene Reasoning

    Feb 28, 2026Yi Zhang, Youya Xia, Yong Wang +73D Spatial Reasoning3D VLMs

  5. PointCoT: A Multi-modal Benchmark for Explicit 3D Geometric Reasoning

    Feb 27, 2026Dongxu Zhang, Yiding Sun, Pengcheng Li +123D VLMs3D Spatial Reasoning

  6. SoPE: Spherical Coordinate-Based Positional Embedding for Enhancing Spatial Perception of 3D LVLMs

    Feb 26, 2026Guanting Ye, Qiyan Zhao, Wenhao Yu +7Positional Encoding3D VLMs

  7. Spa3R: Predictive Spatial Field Modeling for 3D Visual Reasoning

    Feb 24, 2026Haoyi Jiang, Liu Liu, Xinjie Wang +53D Spatial Reasoning3D VLMs

  8. JAEGER: Joint 3D Audio-Visual Grounding and Reasoning in Simulated Physical Environments

    Feb 20, 2026Zhan Liu, Changli Tang, Yuxin Wang +73D Spatial Reasoning3D VLMs

  9. SceneReVis: A Self-Reflective Vision-Grounded Framework for 3D Indoor Scene Synthesis via Multi-Turn RL

    Feb 10, 2026Yang Zhao, Shizhao Sun, Meisheng Zhang +33D Scene GenerationIndoor Scene Generation

  10. Think3D: Thinking with Space for Spatial Reasoning

    Jan 19, 2026Zaibin Zhang, Yuhan Wu, Lianjie Jia +103D Spatial ReasoningVLM Reasoning

  11. SpatialMosaic: A Multiview VLM Dataset for Partial Visibility

    Dec 29, 2025Kanghee Lee, Jungi Hong, Sion Lee +4Multi-View ConsistencyOcclusion Reasoning

  12. Towards Spatial Trace with Reasoning in Vision-Language Models for Robotics

    Dec 15, 2025Enshen Zhou, Yibo Li, Jingkun An +123D Spatial ReasoningVLMs for Robotics

  13. SpaceDrive: Infusing Spatial Awareness into VLM-based Autonomous Driving

    Dec 11, 2025Peizheng Li, Zhenghao Zhang, David Holtz +6Vision-Language ModelsVLMs for Autonomous Driving

  14. Think, Then Look: Active Spatial Reasoning for House-Scale 3D Scene Understanding

    Dec 2, 2025Hongpei Zheng, Shijie Li, Lin Qian +4Spatial Reasoning Benchmarks3D Spatial Reasoning

  15. Vision-Language Memory for Spatial Reasoning

    Nov 25, 2025Zuntao Liu, Yi Du, Taimeng Fu +3Memory-Augmented VLMsVision-Language Models

  16. MonoSR: Open-Vocabulary Spatial Reasoning from Monocular Images

    Nov 24, 2025Qirui Wang, Jingyi He, Yining Pan +3Spatial Reasoning BenchmarksVisual Spatial Reasoning

  17. Let Language Constrain Geometry: Vision-Language Models as Semantic and Spatial Critics for 3D Generation

    Nov 18, 2025Weimin Bai, Yubo Li, Weijian Luo +43D Spatial ReasoningText-to-3D Generation

  18. Error-Driven Scene Editing for 3D Grounding in Large Language Models

    Nov 18, 2025Yue Zhang, Zun Wang, Han Lin +53D Scene Editing3D Spatial Reasoning

  19. 3D-MoE: Towards Spatial Intelligence with Mixture-of-Experts for 3D Reasoning and Action Generation

    Jan 28, 2025Yueen Ma, Zenglin Xu, Irwin King3D Spatial ReasoningMixture-of-Experts Inference