3D Scene Representation

Ask about this topic

Overview

3D scene representation studies how to encode the shape, appearance, meaning, and motion of environments so they can be reconstructed, rendered, edited, or used by robots and other AI systems. Common approaches include explicit representations such as meshes, voxels, point clouds, Gaussian splats, and scene graphs, alongside implicit neural fields and compact learned tokens; these are used in tasks from novel-view synthesis to dynamic mapping and scene generation. Current work increasingly combines geometric structure with language or semantic features, and tests representations on reconstruction benchmarks as well as navigation, spatial reasoning, and manipulation tasks. A central tension is balancing visual fidelity and geometric reliability against memory, computation, and scalability, especially for large, changing scenes and incomplete observations.

Latest papers

CardsList

242 papers35 papers in the last four weeks, up 35% on the four weeks before. 0.2% of all new papers.

  1. SpatialGrammar: A Domain-Specific Language for LLM-Based 3D Indoor Scene Generation

    Apr 30, 2026Song Tang, Kaiyong Zhao, Yuliang Li +53D Scene Generation3D Scene Representation

    The Hong Kong University of Science and Technology (Guangzhou) · XGRIDS · Harbin Institute of Technology (Shenzhen)

  2. Semantic Foam: Unifying Spatial and Semantic Scene Decomposition

    Apr 29, 2026Amr Sharafeldin, Shrisudhan Govindarajan, Thomas Walker +43D Semantic Segmentation3D Scene Representation

    1Simon Fraser University · University of Edinburgh · 3Wayve Technologies +2

  3. Power Foam: Unifying Real-Time Differentiable Ray Tracing and Rasterization

    Apr 27, 2026Shrisudhan Govindarajan, Daniel Rebain, Dor Verbin +3Differentiable Rendering3D Scene Representation

    Simon Fraser University · Google · Google Deepmind +2

  4. INSIGHT: Indoor Scene Intelligence from Geometric-Semantic Hierarchy Transfer for Public~Safety

    Apr 25, 2026Alexander Nikitas Dimopoulos, Joseph Grasso, John Beltz3D Semantic Segmentation3D Scene Representation

    Location Based Services, PSCR, NIST, Boulder, CO, USA · Network Operations Group, PSCR, NIST, Gaithersburg, MD, USA

  5. GSCompleter: A Distillation-Free Plugin for Metric-Aware 3D Gaussian Splatting Completion in Seconds

    Apr 22, 2026Ao Gao, Jingyu Gong, Xin Tan +33D Gaussian Splatting3D Reconstruction

    School of Computer Science and Technology, East China Normal University, Shanghai, China · Shanghai Innovation Institute, Shanghai, China · Chongqing Key Laboratory of Precision Optics, Chongqing Institute of East China Normal University, Chongqing, China +2

  6. View-Consistent 3D Scene Editing via Dual-Path Structural Correspondense and Semantic Continuity

    Apr 20, 2026Pufan Li, Bi'an Du, Shenghe Zheng +2Multi-View Consistency3D Scene Editing

    Wangxuan Institute of Computer Technology, Peking University, No. 128, Zhongguancun North Street, Beijing, China · Department of Computer Science and Engineering, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong SAR, China

  7. HSG: Hyperbolic Scene Graph

    Apr 19, 2026Liyang Wang, Zeyu Zhang, Hao TangGraph Representation LearningHierarchical Representation Learning

    School of Computer Science, Peking University

  8. D-Prism: Differentiable Primitives for Structured Dynamic Modeling

    Apr 18, 2026Xingyuan Yu, Yijin Li, Chong Zeng +3Differentiable Rendering3D Reconstruction

    State Key Lab of CAD&CG, Zhejiang University · Stanford University · Hangzhou Dianzi University

  9. PLAF: Pixel-wise Language-Aligned Feature Extraction for Efficient 3D Scene Understanding

    Apr 17, 2026Junjie Wen, Junlin He, Fei Ma +13D Scene Representation3D Representation Learning

    Pengcheng Laboratory, Shenzhen, 518108, China · The School of Intelligent Engineering, Sun Yat-Sen University-ShenzhenCampus, Shenzhen, Guangdong, China · School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China.

  10. GlobalSplat: Efficient Feed-Forward 3D Gaussian Splatting via Global Scene Tokens

    Apr 16, 2026Roni Itkin, Noam Issachar, Yehonatan Keypur +33D Gaussian Splatting3DGS Acceleration

    The Hebrew University of Jerusalem · Westlake University

  11. Rethinking Image-to-3D Generation with Sparse Queries: Efficiency, Capacity, and Input-View Bias

    Apr 15, 2026Zhiyuan Xu, Jiuming Liu, Yuxin Chen +3Image-to-3D Scene Generation3D Scene Generation

    UC Berkeley · University of Cambridge · UT Austin

  12. GS4City: Hierarchical Semantic Gaussian Splatting via City-Model Priors

    Apr 13, 2026Qilin Zhang, Jinyu Zhu, Olaf Wysocki +23D Scene Representation3D Scene Understanding

    Technical University of Munich (TUM) · Munich Center for Machine Learning (MCML) · Karlsruhe Institute of Technology (KIT) +1

  13. Any 3D Scene is Worth 1K Tokens: 3D-Grounded Representation for Scene Generation at Scale

    Apr 13, 2026Dongxu Wei, Qi Xu, Zhiqi Li +63D Scene Generation3D Diffusion Models

    Westlake University · Afari Intelligent Drive · Zhejiang University

  14. SEM-ROVER: Semantic Voxel-Guided Diffusion for Large-Scale Driving Scene Generation

    Apr 7, 2026Hiba Dahmani, Nathan Piasco, Moussab Bennehar +53D Scene GenerationAutonomous Driving Scenario Generation

    Noah’s Ark, Huawei Paris Research Center, France · COSYS, Gustave Eiffel University, France · LASTIG, IGN-ENSG, Gustave Eiffel University, France

  15. Rendering Multi-Human and Multi-Object with 3D Gaussian Splatting

    Apr 3, 2026Weiquan Wang, Jun Xiao, Feifei Shao +3Dynamic Scene Reconstruction3D Reconstruction

    State Key Lab of CAD&CG, College of Computer Science, Zhejiang University, Hangzhou 310027, China · Department of Computer Science and Engineering, The Hong Kong University of Science and Technology, Clear Water Bay, Hong Kong

  16. Pandora: Articulated 3D Scene Graphs from Egocentric Vision

    Mar 30, 2026Alan Yu, Yun Chang, Christopher Xie +13D Scene Representation3D Scene Understanding

    Laboratory for Information and Decision Systems, Massachusetts Institute of Technology · Meta Reality Labs

  17. Chat-Scene++: Exploiting Context-Rich Object Identification for 3D LLM

    Mar 29, 2026Haifeng Huang, Yilun Chen, Zehan Wang +23D VLMs3D Scene Understanding

    School of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China. · Shanghai AI Laboratory, Shanghai 200032, China.

  18. NimbusGS: Unified 3D Scene Reconstruction under Hybrid Weather

    Mar 28, 2026Yanying Li, Jinyang Li, Shengfeng He +33D ReconstructionMulti-View 3D Reconstruction

    School of Computer Science and Technology, Ocean University of China · Singapore Management University · Harbin Institute of Technology (Shenzhen) +1

  19. GLINT: Modeling Scene-Scale Transparency via Gaussian Radiance Transport

    Mar 27, 2026Youngju Na, Jaeseong Yun, Soohyun Ryu +33D Reconstruction3D Scene Representation

    KAIST · NAVER LABS

  20. KitchenTwin: Semantically and Geometrically Grounded 3D Kitchen Digital Twins

    Mar 25, 2026Quanyun Wu, Kyle Gao, Daniel Long +3Digital Twins3D Scene Representation

    University of Waterloo, Waterloo, ON, Canada

  21. LightSplat: Fast and Memory-Efficient Open-Vocabulary 3D Scene Understanding in Five Seconds

    Mar 25, 2026Jaehun Bang, Jinhyeok Kim, Minji Kim +2Open-Vocabulary 3D Segmentation3D Scene Understanding

    AIGS, UNIST · GSAI, POSTECH

  22. Cog3DMap: Multi-View Vision-Language Reasoning with 3D Cognitive Maps

    Mar 24, 2026Chanyoung Gwak, Yoonwoo Jeong, Byungwoo Jeon +3Multimodal Spatial Reasoning3D Spatial Reasoning

    POSTECH · KAIST · RLWRLD

  23. WorldMesh: Generating Navigable Multi-Room 3D Scenes via Mesh-Conditioned Image Diffusion

    Mar 24, 2026Manuel-Andreas Schneider, Angela Dai3D Scene Generation3D Scene Representation

    Technical University of Munich, Germany

  24. SLARM: Streaming and Language-Aligned Reconstruction Model for Dynamic Scenes

    Mar 24, 2026Zhicheng Qiu, Jiarui Meng, Tong-an Luo +4Dynamic Scene ReconstructionStreaming 3D Reconstruction

    Huawei Technologies Ltd.

  25. UniQueR: Unified Query-based Feedforward 3D Reconstruction

    Mar 24, 2026Chensheng Peng, Quentin Herau, Jiezhi Yang +63D Gaussian Splatting3D Reconstruction

    Applied Intuition · UC Berkeley · Stanford University

  26. GaussianSSC: Triplane-Guided Directional Gaussian Fields for 3D Semantic Completion

    Mar 23, 2026Ruiqi Xian, Jing Liang, He Yin +2Tri-Plane Representations3D Scene Completion

  27. Scene Representation using 360° Saliency Graph and its Application in Vision-based Indoor Navigation

    Mar 20, 2026Preeti Meena, Himanshu Kumar, Sandeep Yadav3D Scene RepresentationVisual Navigation

    Discipline of Electrical Engineering, Indian Institute of Technology Jodhpur, Jodhpur-342030, India

  28. DriveTok: 3D Driving Scene Tokenization for Unified Multi-View Reconstruction and Understanding

    Mar 19, 2026Dong Zhuo, Wenzhao Zheng, Sicheng Zuo +43D Scene Representation3D Scene Understanding

    Tsinghua University · Yinwang Intelligent Technology Co. Ltd.

  29. NanoGS: Training-Free Gaussian Splat Simplification

    Mar 17, 2026Butian Xiong, Rong Liu, Tiantian Zhou +33DGS Compression3D Gaussian Splatting

    USC Institute for Creative Technologies · Texas A&M University

  30. OneWorld: Taming Scene Generation with 3D Unified Representation Autoencoder

    Mar 17, 2026Sensen Gao, Zhaoqing Wang, Qihang Cao +53D Scene Generation3D Diffusion Models

    Mohamed bin Zayed University of Artificial Intelligence · AISphere · Shanghai Jiao Tong University +3