3D Scene Understanding

Ask about this topic

Momentum

12 papers in the last four weeks, up 300% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 115

All topics
CardsList

  1. Task-Adaptive Grounded 3D-Programmers Using 2D VLMs

    Oct 1, 2026Arman Raayatsanati, Sombit Dey, Anna-Maria Halacheva +33D Visual Grounding3D Scene Understanding

    TextQL · INSAIT, Sofia University “St. Kliment Ohridski”

  2. GenCOPE: Syn2Real Generalized Category-Level Object Pose Estimation for Robotic Picking

    Oct 1, 2026Jian Liu, Wei Sun, Zhenqi Dai +4Category-Level Object Pose EstimationSynthetic-To-Real Domain Gap

    IMPL Lab, SUTD · NERC-RVC, Hunan University · University of Trento

  3. EviSplat: Preserving Multi-View Evidence in 3D Gaussian Splatting for Open-Vocabulary Segmentation

    Sep 28, 2026Sungho Moon, Kota Shimomura, Junwoo Park +4Open-Vocabulary 3D Segmentation3D Scene Understanding

    DGIST, Daegu, Republic of Korea · Chubu University, Japan · Elith Inc., Japan +2

  4. SceneScaffold: Active Scene-State Construction for Unified 3D Scene Understanding

    Sep 27, 2026Xiangqi Li, Libo Huang, Jiarui Zhao +43D Scene UnderstandingState-Tracking

    State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences · University of Chinese Academy of Sciences

  5. TrackEverything: Long Horizon Dense Tracking via De-Duplicating 3D Scene Representations

    Sep 24, 2026Ayush Jain, Sreeharsha Paruchuri, Ishita Gupta +53D Tracking3D Scene Understanding

    Carnegie Mellon University · Meta

  6. OREN-X: Octree Residual Network for Real-Time Multi-Modal Mapping

    Sep 24, 2026Zhirui Dai, Qihao Qian, Dinh Minh Nguyen +63D MappingSimultaneous Localization And Mapping

    Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA 92093, USA · VinMotion · Parsons +2

  7. CitySTAR: Structured and Topology-Aware Reasoning for Open-Vocabulary Urban 3D Grounding

    Sep 17, 2026Shuai Zhang, Hongye Hou, Qinghe Liu +53D Visual Grounding3D Scene Understanding

    HKUST(GZ) · HKUST

  8. PointZero: 3D Point Track Completion for Learning Transferable 3D Dynamics

    Sep 16, 2026Bardienus P. Duisterhof, Kaifeng Zhang, Adam Hung +53D Tracking3D Scene Understanding

    CMU · Columbia · NVIDIA

  9. Partition-Invariant Tuning for 3D Scene Understanding

    Sep 14, 2026Hongqiang Lin, Tianle Wang, Shuiwang Li +4Point Clouds3D Scene Understanding

    ZJU · GUT · THU +3

  10. What Makes a 3D Scene Editable? A Factorized Benchmark of Fidelity, Locality, Consistency, and Preservation

    Sep 14, 2026Sariah Patro, Arjun Mehra, Nikhil Bhatia3D Editing3D Scene Understanding

    University of Delhi & Jadavpur University

  11. GoDeep: Annotation-Free Open-Vocabulary 3D Scene Understanding via Language-Space Lifting

    Sep 8, 2026Thodoris Betsas, Anastasios Doulamis, Andreas Georgopoulos3D Scene UnderstandingVisual Embeddings

    Laboratory of Photogrammetry, School of Rural, Surveying and Geoinformatics Engineering, NTUA, 15772 Athens, Greece

  12. Spheriverse: 3D Scene Understanding from Spherical Observations in the Wild

    Sep 8, 2026Fei Teng, Sheng Wu, Mengfei Duan +73D Semantic Occupancy Prediction3D Scene Understanding

    School of Artificial Intelligence and Robotics and the National Engineering Research Center of Robot Visual Perception and Control Technology, Hunan University, China · School of Automation and Electrical Engineering, Zhejiang University of Science and Technology, China · Ant Group, China +1

  13. ScenePilot: Grow-and-Repair Policy for Text-Driven 3D Indoor Scene Generation

    Aug 31, 2026Jiawei Zhang, Hongsong Wang, Pan Zhou3D Scene GenerationIndoor Scene Generation

    Southeast University · Singapore Management University

  14. STAR: A Spatial-Topology Aware Routing Framework for Generalizable 3D Scene Understanding

    Aug 12, 2026Mingwei Xing, Xinliang Wang, Yifeng Shi3D Scene UnderstandingScene Understanding

    KE Holdings Inc.

  15. CasDeblurGS: Cascaded 2D-to-3D Multi-View Consistency for 3D Gaussian Splatting from Two Blurry Images

    Aug 11, 2026Haeyun Choi, Minhyuk Jang, I-Gil KimNovel View Synthesis3D Gaussian

    University of Virginia, Charlottesville, VA, USA · KT R&D Center · KT R&D Center, Seoul, Republic of Korea

  16. OccAnyScene: Towards Unified Indoor-Outdoor 3D Occupancy Prediction

    Aug 9, 2026Junjie Liu, Wanshui Gan, Zitong Dai +63D Semantic Occupancy Prediction3D Scene Understanding

    Pengcheng Laboratory · SUSTech · Shanghai Artificial Intelligence Laboratory +1

  17. Rethinking 3D Segmentation from Individual LiDAR Scans: Incidence-Aware Sampling on the SIP Benchmark

    Aug 7, 2026Seongyong Kim, Jingdao Chen, Yong Kwon ChoInteractive 3D SegmentationPoint Clouds

    Graduate Student, School of Civil and Environmental Engineering, Georgia Institute of Technology, 790 Atlantic Dr., Atlanta GA · Assistant Professor, Department of Computer Science and Engineering, Mississippi State University, 665 George Perry St, Mississippi State, MS 39762 · Professor, School of Civil and Environmental Engineering, Georgia Institute of Technology, 790 Atlantic Dr., Atlanta, GA

  18. InstanceSplat: Instance-Aware Feed-Forward 3D Gaussian Splatting for Scene Understanding

    Aug 7, 2026Minchao Jiang, Xiaoxuan Ma, Shunyu Jia +3Feed-Forward 3D Gaussian Splatting3D Scene Understanding

    1Shanghai Jiao Tong University · 2Eastern Institute of Technology, Ningbo · 3Carnegie Mellon University +2

  19. SmartMage: Dynamic Modality Orchestration for 3D Scene Understanding

    Aug 5, 2026Yue Zhang, Yingzhao Jian, Yunqiu Xu +23D Scene UnderstandingMultimodal Reasoning

    Zhejiang University Hangzhou, Zhejiang, China · Stanford University Stanford, California, USA

  20. WorldClaw: Agentic 3D Open-World Generation at Scale

    Aug 5, 2026Chunchao Guo, Jinpeng Li, Yang Li +13D World3D Scene Understanding

    Tencent Hunyuan

  21. HiSC: Hierarchical Spatial Clustering Token Compression for Efficient 3D Scene Understanding

    Aug 5, 2026Jiuhe Qu, Yingping Liang, Ying Fu3D Scene UnderstandingToken Compression

    Beijing Institute of Technology Beijing, China

  22. OutLangSplat: 3D Language Gaussian Splatting for UAV Outdoor Scenes

    Aug 5, 2026Xia Yan, He Wu, Yanghui Xu +23D Scene UnderstandingObject Localization

    Zhejiang University of Technology · Hangzhou Dianzi University

  23. Global Graph-Validated Optimization for VLM-based 3D Indoor Scene Generation

    Aug 4, 2026Jialu Huang, Yingxuan You, Fei Wang +13D Scene Generation3D Scene Understanding

    National Key Laboratory of Human-Machine Hybrid Augmented Intelligence Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, China · 2 École Polytechnique Fédérale de Lausanne (EPFL), CVLab, Switzerland · School of Electronics and Information, Northwestern Polytechnical University and Shaanxi Key Laboratory of Information Acquisition and Processing, China

  24. Probing the 3D Object-Level Understanding of Pre-Trained Detection Transformers

    Aug 2, 2026Robin Kim, Colin Samplawski, Benjamin M. Marlin3D Object DetectionDetection Transformer

    UMass Amherst, Amherst, MA, USA · SRI International, Menlo Park, CA, USA

  25. Distill What RGB Can Recover: Privileged 3D Evidence for RGB-Only Vision-Language Models

    Jul 31, 2026Yanbin Hu, Jin Cui, Jun Ye +43D Scene UnderstandingRed-Green-Blue

    School of Software, Xi’an Jiaotong University · School of Artificial Intelligence, Xi’an Jiaotong University · State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University +1

  26. MonoVoc: Decoupling Geometry and Semantics for Lightweight Monocular Open-Vocabulary 3D Gaussians

    Jul 30, 2026Pouya Ardekhani, Zahra Dehghanian, Morteza Abolghasemi +13D Scene Understanding3D Gaussian

    Sharif University of Technology, Tehran, Iran

  27. InterOCF: Spatio-Temporal 2D-3D Interaction for Camera-Only 4D Occupancy Forecasting

    Jul 27, 2026Qi Zhang, Xinquan Yu, Kaiyi Zhang +13D Semantic Occupancy PredictionOccupancy

    College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, China.

  28. SceneActBench: Can Agents Act on the 3D Scenes They See?

    Jul 24, 2026Yifei Zhao, Xiangxin Zhou, Wenhao Yang +113D Scene UnderstandingScene Understanding

    1Tencent Hunyuan · 2THU · 3NJU +3

  29. D3VL: Understanding Driving Scenes from 3D Time Series Data and Video with Language Models

    Jul 21, 2026Heesang Han, A. Lynn Abbott, Abhijit SarkarAutonomous DrivingWaymo Open Motion Dataset

    Bradley Department of Electrical and Computer Engineering, Virginia Tech, USA · Sanghani Center for Artificial Intelligence and Data Analytics, USA · Virginia Tech Transportation Institute, USA

  30. CR-Refiner: An Object-Centric Optimal Transport Reranker for Edit-Conditioned 3D Scene Retrieval

    Jul 21, 2026Hao Wu, Jinjing Zhu, Nanyu Wu +43D Editing3D Scene Understanding

    Hong Kong University of Science and Technology · Hong Kong University of Science and Technology (Guangzhou)

  31. Scene-SAM3D: Multi-View Scene Asset Generation Without Fine-Tuning

    Jul 18, 2026Yuqi Zhang, Yadan Luo, Xiangyu Sun +33D Scene GenerationIndoor Scene Generation

    The University of Queensland · Shanghai AI Laboratory · East China Normal University

  32. Vision-Language-Motion Maps: An Open-Vocabulary, Uncertainty-Aware, Queryable Motion Attribute for 3D Scene Maps

    Jul 17, 2026Dibyendu Ghosh, Ayushi Shakya3D Mapping3D Scene Understanding

    Rekise Marine, Bangalore, India

  33. SoftNav: Injecting 3D Scene Tokens into VLMs for Embodied Navigation

    Jul 16, 2026Yi Wu, Junjie An, Xiao Liu +6Vision-Language NavigationObject Goal Navigation

    Zhejiang University · Shandong University

  34. ThinkBLOX: 3D Indoor Scene Generation with Progressive Reasoning

    Jul 15, 2026Yuan Xiao, Can Wang, Xiangyu Kong +13D Scene Generation3D Scene Understanding

    Department of Computer Science, City University of Hong Kong, Hong Kong · School of Computing and Data Science, University of Hong Kong · School of Computer Science, Beijing Information Science and Technology University

  35. HIVE-3D: Hierarchical Voxel Enhancement for High-Quality 3D Scene Generation

    Jul 15, 2026Bin Zang, Wenting Zheng, Xiaoliang Luo +83D Scene Generation3D Scene Understanding

    State Key Laboratory of CAD&CG, Zhejiang University, Hangzhou, China · China Mobile (Jiangxi) Virtual Reality Technology Co., Ltd., Nanchang, China

  36. VistaVLA: Geometry- and Semantic-Aware 3D Gaussian-Grounded VLA for Robotic Manipulation

    Jul 14, 2026Mohan Liu, Zhihao Gu, Xuanyu Chen +5Diffusion-Based Vision-Language-Actions3D Scene Understanding

    EmPACT Lab, Nanyang Technological University, Singapore · Institute for Infocomm Research (I2R), A*STAR, Singapore

  37. CoSAG: Compact Semantic Anchor Gaussians via Training-Free Rate-Distortion Coding

    Jul 11, 2026Yuang Jia, Jinlong Wang, Junhong Lin +23D Scene UnderstandingGaussian Primitives

    SECE, Peking University · University of Electronic Science and Technology of China

  38. MultiView-Bench: A Diagnostic Benchmark for World-Centric Multi-View Integration in VLMs

    Jul 9, 2026Hantao Zhang, Jinru Sui, Ed Li +2Multi-View3D Scene Understanding

    Yale University · University of Edinburgh

  39. CAIRN: Cross-Room 3D Scene Understanding with Topology-Aware Large Multimodal Models

    Jul 7, 2026He Liang, Chenyang Ma, Yiming Zhang +43D Scene Understanding

    University of Oxford · 3Simon Fraser University · 2Microsoft Research

  40. PVCap: Towards Accurate 3D Dense Captioning via PseudoCap and VoxelCapNet

    Jul 7, 2026Xiaopei Wu, Chenshu Hou, Liang Peng +93D Scene UnderstandingVoxel

    1SH AI Lab · 2ZJU · 1SH AI Lab 2ZJU +2

  41. Ground3D-LMM: Fine-Grained 3D Point Grounding and Spatial Reasoning with LMM

    Jul 6, 2026Amol Harsh, Zongyan Han, Jean Lahoud +53D Visual Grounding3D Scene Understanding

    Mohamed bin Zayed University of Artificial Intelligence · The Hong Kong Polytechnic University · Linköping University

  42. Beyond Isolated Objects: Relationship-aware Open Vocabulary Scene Understanding via 3D Scene Graph Analysis

    Jul 6, 2026Xianhao Chen, Jiarui Hu, Yuanbo Yang +53D Scene Understanding3D Scene Graphs

    State Key Lab of CAD&CG, Zhejiang University, China · Zhejiang University, China

  43. Holo-Captioning: Toward the Text Equivalent of 3D Scenes

    Jul 3, 2026Kun-Yu Lin, Chengke Bu, Zhenguo Li +13D Scene Understanding3D Generation

    Visual AI Lab, The University of Hong Kong · Frontier Robotics

  44. VLRC: Vision-Language Reprojection Consistency as a scalable signal for better feed-forward 3D pretraining

    Jul 2, 2026Marwane Hariat, David Filliat, Antoine Manzanera3D Scene UnderstandingVision-Language Reprojection Consistency

    U2IS, ENSTA – Institut Polytechnique de Paris · Agence Minist´erielle pour l’IA de D´efense

  45. Alignment Is All You Need For X-to-4D Generation

    Jul 2, 2026Qiaowei Miao, Kehan Li, Yawei Luo +14D Generation3D Scene Understanding

    Zhejiang University, Hangzhou 310027, China

  46. Mirror Illusion Art

    Jul 2, 2026Xiaopei Zhu, Zeyuan Li, Jun Zhu +1ArtGenerative Inverse Design

    Department of Computer Science and Technology, BNRist, Tsinghua University · Huazhong University of Science and Technology · IDG/McGovern Institute for Brain Research, Tsinghua University +1

  47. Structured 4D Latent Predictive Model for Robot Planning

    Jul 1, 2026Zhiyi Li, Peilin Wu, Xiaoshen Han +2Robot PlanningInverse Dynamics

    1MIT · 2Harvard University

  48. IBRSteG: Learning a Generalizable Steganography Framework for 3D Gaussian Splatting

    Jun 29, 2026Fanye Kong, Hongyu Xia, Yu Zheng +33D GaussianSteganography

    Department of Automation, Tsinghua University, Beijing 100084, China

  49. Scenes as Objects, Not Primitives: Instance-Structured 3D Tokenization from Unposed Views

    Jun 28, 2026Mijin Yoo, In Cho, Subin Jeon +33D Scene UnderstandingNovel View Synthesis

    1Yonsei University · 2Seoul National University

  50. SAD-GS: Learning Reliable 3D Semantic Gaussian Fields via Dynamic Geo-Semantic Anchoring

    Jun 28, 2026Yufei Zhang, Chenlu Zhan, Gaoang Wang +1Open-Vocabulary 3D Segmentation3D Gaussian

    Zhejiang University

  51. Agentic Collaborative Cognition for Zero-Shot 3D Understanding

    Jun 23, 2026Wenxin Wang, Bo Zhang, Feng Chen +43D Scene UnderstandingFuzzy Cognitive Map

    Sichuan University · Adelaide University · University of Electronic Science and Technology of China +1

  52. MeshFlow: Mesh Generation with Equivariant Flow Matching

    Jun 22, 2026Qi Sun, Kiyohiro Nakayama, Jing Nathan Yan +6Mesh GenerationRiemannian Flow Matching

    City University of Hong Kong, Hong Kong · Stanford University, USA · Cornell Tech, USA +1

  53. Lightweight 3D Feature Pretraining by Bayesian Inversion of 2D Foundation Models

    Jun 19, 2026Marwane Hariat, Gianni Franchi, David Filliat +13D Scene Understanding3D Generation

    U2IS, ENSTA – Institut Polytechnique de Paris, Palaiseau, France · Pôle Recherche, Agence Ministérielle pour l’IA de Défense, Palaiseau, France

  54. JanusMesh: Fast and Zero-Shot 3D Visual Illusion Generation via Cross-Space Denoising

    Jun 18, 2026Siang-Ling Zhang, Huai-Hsun Cheng, Tsung-Ju Yang +13D Generative Models3D Scene Understanding

    National Yang Ming Chiao Tung University

  55. Occ-VLM: Occupancy Grounded Vision Language Model for Indoor Scene Understanding

    Jun 18, 2026Jianing Li, Zhou Fang, Yijiang Liu +13D Scene Understanding3D Representation

    School of Electronic Science and Engineering, Nanjing University

  56. QueryGaussian: Scalable and Training-Free Open-Vocabulary 3D Instance Retrieval

    Jun 18, 2026Xiuyuan Zhu, Ke Lu, Zijie Yang +33D Scene Understanding3D Generation

    University of Chinese Academy of Sciences, Beijing, China · 3Peng Cheng Laboratory, Shenzhen, China · 2State Key Laboratory of Communication Content Cognition, Beijing, China

  57. 3D-DLP: Self-Supervised 3D Object-Centric Scene Representation Learning

    Jun 17, 2026Ellina Zhang, Madhaven Iyengar, Amir Zadeh +43D Scene Understanding3D Generation

    Carnegie Mellon University · Lambda AI

  58. OneCanvas: 3D Scene Understanding via Panoramic Reprojection

    Jun 17, 2026Bartłomiej Baranowski, Dave Zhenyu Chen, Matthias Nießner3D Scene UnderstandingSpatial Reasoning

    Technical University of Munich · Huawei

  59. EditSSC: Toward Editable Semantic Occupancy Scenes with Unconditional Diffusion Models

    Jun 8, 2026Fatima Balde, Raoul de Charette, Alexandre Boulch3D Scene Generation3D Scene Understanding

    Inria

  60. EPS3D: End-to-End Feed-Forward 3D Panoptic Segmentation

    Jun 8, 2026Runsong Zhu, Jiaxin Guo, Xiaoyang Guo +9Open-Vocabulary 3D Segmentation3D Scene Understanding

    The Chinese University of Hong Kong, HK SAR, China · Hong Kong Centre for Logistics Robotics, HK SAR, China · Horizon Robotics, China +2