Overview

3D scene understanding studies how to recover the geometry, objects, relationships, and often motion of environments from images, depth, and LiDAR. Common approaches include point-cloud and voxel networks, occupancy prediction, Gaussian splatting, and 3D scene graphs, increasingly combined with vision-language models for grounding and reasoning. These representations support tasks such as robot navigation and manipulation, autonomous driving, scene reconstruction, and open-vocabulary object retrieval. A central challenge is making systems both spatially reliable and efficient in large, changing scenes, while benchmarks continue to expose gaps in metric reasoning, cross-view consistency, and generalization.

Latest papers

CardsList

295 papers34 papers in the last four weeks, up 17% on the four weeks before. 0.2% of all new papers.

  1. Relational Semantic Reasoning on 3D Scene Graphs for Open World Interactive Object Search

    Mar 5, 2026Imen Mahdi, Matteo Cassinelli, Fabien Despinoy +2Robotic Object SearchRobot Navigation

  2. Thinking with Spatial Code for Physical-World Video Reasoning

    Mar 5, 2026Jieneng Chen, Wenxin Ma, Ruisheng Yuan +3Visual Spatial ReasoningPhysical Reasoning in Video

  3. Towards 3D Scene Understanding of Gas Plumes in LWIR Hyperspectral Images Using Neural Radiance Fields

    Mar 5, 2026Scout Jarman, Zigfried Hampel-Arias, Adra Carr +13D Scene Understanding3D Reconstruction

  4. 3D-RFT: Reinforcement Fine-Tuning for Video-based 3D Scene Understanding

    Mar 5, 2026Xiongkun Linghu, Jiangyong Huang, Baoxiong Jia +13D Scene Understanding3D VLMs

  5. Learning Surgical Robotic Manipulation with 3D Spatial Priors

    Mar 4, 2026Yu Sheng, Lidian Wang, Xiaomeng Chu +6Robotic ManipulationSurgical Robotics

  6. SemGS: Feed-Forward Semantic 3D Gaussian Splatting from Sparse Views for Generalizable Scene Understanding

    Mar 3, 2026Sheng Ye, Zhen-Hui Dong, Ruoyu Fan +23D Scene Understanding3D Gaussian Splatting

  7. TopoMaskV3: 3D Mask Head with Dense Offset and Height Predictions for Road Topology Understanding

    Mar 2, 2026Muhammet Esat Kalfaoglu, Halil Ibrahim Ozturk, Ozsel Kilinc +1Topological Mapping3D Scene Understanding

  8. pySpatial: Generating 3D Visual Programs for Zero-Shot Spatial Reasoning

    Mar 1, 2026Zhanpeng Luo, Ce Zhang, Silong Yong +6Visual Program Synthesis3D Spatial Reasoning

  9. I-Perceive: A Foundation Model for Vision-Language Active Perception

    Feb 28, 2026Yongxi Huang, Zhuohang Wang, Wenjing Tang +33D Scene UnderstandingRobot Foundation Models

  10. StemVLA:An Open-Source Vision-Language-Action Model with Future 3D Spatial Geometry Knowledge and 4D Historical Representation

    Feb 27, 2026Jiasong Xiao, Yutao She, Kai Li +23D Scene PredictionLong-Horizon Robotic Manipulation

  11. SF3D-RGB: Scene Flow Estimation from Monocular Camera and Sparse LiDAR

    Feb 25, 2026Rajai Alhimdiat, Ramy Battrawy, René Schuster +2Scene Flow Estimation3D Scene Understanding

  12. Open-vocabulary 3D scene perception in industrial environments

    Feb 23, 2026Keno Moenck, Adrian Philip Florea, Julian Koch +1Open-Vocabulary 3D Segmentation3D Scene Understanding

  13. Language and Geometry Grounded Sparse Voxel Representations for Holistic Scene Understanding

    Feb 17, 2026Guile Wu, David Huang, Bingbing Liu +13D Scene Understanding3D Scene Representation

  14. SpatialMosaic: A Multiview VLM Dataset for Partial Visibility

    Dec 29, 2025Kanghee Lee, Jungi Hong, Sion Lee +4Multi-View ConsistencyOcclusion Reasoning

  15. OccStress: Stress-Testing the 4D Occupancy Forecasting Chain

    Dec 17, 2025Yu Zheng, Jie Hu, Jiaqi Xiong +4Forecasting Benchmarks3D Occupancy Prediction

  16. Think, Then Look: Active Spatial Reasoning for House-Scale 3D Scene Understanding

    Dec 2, 2025Hongpei Zheng, Shijie Li, Lin Qian +4Spatial Reasoning Benchmarks3D Spatial Reasoning

  17. UniFlow: Zero-Shot LiDAR Scene Flow for Autonomous Vehicles

    Nov 23, 2025Siyi Li, Qingwen Zhang, Ishan Khatri +4Point Cloud LearningAutonomous Driving Perception

  18. HENet++: Hybrid Encoding and Multi-task Learning for 3D Perception and End-to-end Autonomous Driving

    Nov 10, 2025Zhongyu Xia, Zhiwei Lin, Yongtao Wang +1Autonomous Driving PerceptionEnd-to-End Autonomous Driving

  19. Social 3D Scene Graphs: Modeling Human Actions and Relations for Interactive Service Robots

    Sep 29, 2025Ermanno Bartoli, Dennis Rotondi, Buwei He +3Human Activity Recognition3D SGG

  20. Scene-R1: Video-Grounded Large Language Models for 3D Scene Reasoning with Lightweight Annotations

    Jun 21, 2025Junjie Wang, Zhihao Yuan, Shuyi Jiang +53D Scene Understanding3D VLMs

  21. SparseLGS: Sparse View Language Embedded Gaussian Splatting

    Dec 3, 2024Jun Hu, Zhang Chen, Zhong Li +23D Gaussian SplattingLanguage-Embedded 3DGS

  22. Voxeland: Probabilistic Instance-Aware Semantic Mapping with Evidence-based Uncertainty Quantification

    Nov 13, 2024Jose-Luis Matez-Bandera, Pepe Ojeda, Javier Monroy +23D Semantic MappingSegmentation Uncertainty Estimation