Overview

3D scene representation studies how to encode the shape, appearance, meaning, and motion of environments so they can be reconstructed, rendered, edited, or used by robots and other AI systems. Common approaches include explicit representations such as meshes, voxels, point clouds, Gaussian splats, and scene graphs, alongside implicit neural fields and compact learned tokens; these are used in tasks from novel-view synthesis to dynamic mapping and scene generation. Current work increasingly combines geometric structure with language or semantic features, and tests representations on reconstruction benchmarks as well as navigation, spatial reasoning, and manipulation tasks. A central tension is balancing visual fidelity and geometric reliability against memory, computation, and scalability, especially for large, changing scenes and incomplete observations.

Latest papers

CardsList

242 papers35 papers in the last four weeks, up 35% on the four weeks before. 0.2% of all new papers.

  1. RelateGS: Reliable Semantic and Relational Evidence for 3D Scene Understanding with Gaussian Splatting

    Oct 24, 2026Seongjun Choi, Sangyoun Lee3D Scene Understanding3D Visual Grounding

  2. OmniRay: Camera-Agnostic Monocular 3D Reconstruction with Composite Ray Fields

    Oct 22, 2026Namitha Guruprasad, Abhay Yadav, Cheng Peng +23D ReconstructionMonocular 3D Reconstruction

  3. CoGaussian: Open-Vocabulary Gaussian-based Collaborative 3D Scene Understanding

    Oct 20, 2026Om Shivam Verma, Shaya Farahmand, Lingjun Zhao +13D Scene Understanding3D Occupancy Prediction

  4. OV-Foam: How 3D Representations Shape Semantic Feature Lifting

    Oct 20, 2026Yousef Rajeh, Alejandra Esparza Pelcastre, Ivan Viola +1Open-Vocabulary 3D Segmentation3D Scene Representation

  5. SwitchSplat: Learning Discrete Object States from Casually Captured Scenes

    Oct 17, 2026Yizheng Xie, Yalda Foroutan, George Shramko +33D Scene Representation3D Gaussian Splatting

  6. Persistent Planar Memory for Video World Models

    Oct 16, 2026Yuze He, Bin Tan, Zelin Gao +4Video World ModelsMemory-Augmented Video Generation

  7. GeoState: Learning View-Decoupled Geometry States for 3D World Modeling

    Oct 15, 2026Hongchang Liu, Jian Liu, Yujuan Ding +5World Model Learning3D Scene Prediction

  8. GRASE: Geometry-native Real-to-sim Agentic Scene Modeling from Video

    Oct 15, 2026Zhaorui Lin, Haohan Liu, Zhen Chen +1Real-to-Sim Transfer3D Scene Representation

  9. GLoD-LVSM: Learning Geometry-Grounded Continuous-LoD Scene Representations for Large View Synthesis Models

    Oct 14, 2026Weikai Lin, Nicholas Milef, Carl S Marshall +33D Scene RepresentationNovel View Synthesis

  10. SceneAE: Scene Generation and Reconstruction in Queryable 3D-Anchored Latent Space

    Oct 14, 2026Shuofeng Sun, Wenzhao Zheng, Yunpeng Zhang +33D Scene Generation3D Scene Representation

  11. CoTL: Compact Token Learning for 3D Scene Representation

    Oct 13, 2026Han Liang, Sibo Wu, Anpei Chen +13D Scene RepresentationMulti-View 3D Reconstruction

  12. CityCode: Building Agent-Operable 3D Cities from Sparse Aerial Observations

    Oct 13, 2026Jiahui Sun, Ran Bi, Yifei Liu +8Aerial 3D Reconstruction3D Scene Representation

  13. EgoAlign: Situated 3D Understanding without Situation Descriptions

    Oct 12, 2026Yiyang Li, Tianyi Ma, Zehong Wang +13D VQA3D VLMs

  14. Make It Flow: Animating Water in 3D Gaussian Splatting Scenes

    Oct 9, 2026Kjell Keune, Florian Hahlbohm, Jannis Möller +33D Gaussian Splatting3D Scene Representation

  15. UNITAS: A 3D-Native World Action Model for Embodied Manipulation

    Oct 8, 2026Ruixiang Wang, Yongyi Su, Wenlve Zhou +14World Action ModelsEmbodied World Models

  16. PAM-ToD: Plug-and-Play Appearance Modeling for Cross-Time-of-Day 3D Gaussian Splatting

    Oct 8, 2026Kota Shimomura, Sungho Moon, Tsubasa Hirakawa +33D Scene Relighting3D Gaussian Splatting

  17. NeRFifyMesh: Optimizing Neural Radiance Fields from Textured Meshes for Robotics Scene Building

    Oct 7, 2026Nillan Nimal, Mahboubeh Asadi, Sajad Saeedi3D Scene RepresentationNeural Radiance Fields

  18. ActiveLang: Active Open-Vocabulary 3D Mapping with Semantic-Uncertainty-Guided Exploration

    Oct 7, 2026Liyan Chen, Hairong Yin, Huangying Zhan +33D Semantic Mapping3D Mapping

  19. S2Tok: Streaming 3D Gaussian Reconstruction with Persistent Spatial Tokens

    Oct 6, 2026Fang Li, Jiraphon Yenphraphai, Quentin Herau +5Streaming 3D Reconstruction3D Scene Representation

  20. Octrees as an Explicit 3D Language

    Oct 1, 2026Ran Dan, Si-Tong Wei, Pengfei Xiong +33D Shape GenerationUnified Multimodal Models

  21. SCION: Scene Composition with Instanced Neural Primitives

    Oct 1, 2026William Koch, Amogh Joshi, Cyrus Vachha +23DGS Compression3D Scene Editing

  22. 4Director: Controlling Video World Models with Rigid 3D Geometry

    Oct 1, 2026Wei Cao, Hao Zhang, Vikram Voleti +5Camera-Conditioned Video GenerationCamera-Controlled Video Generation

  23. LiteReality-Agent: An Agentic System for Interactable 3D Indoor Scene Reconstruction

    Oct 1, 2026Zhening Huang, Yueyan Li, Johnathan Chiu +53D Reconstruction3D Scene Representation

  24. A Compact Explicit 4D Representation for Dynamic Scenes

    Oct 1, 2026Di Yang, Zhihao Li, Yanhai Xiong +1Dynamic Scene ReconstructionNovel View Synthesis

  25. Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstruction

    Sep 30, 2026Ziren Gong, Guo Chen, Yongjia Li +133D Gaussian Splatting4D Reconstruction

  26. Lens Flare Removal and Reconstruction

    Sep 30, 2026Tarun Yenamandra, Jonathon Luiten, Daniel Cremers +13D Scene RepresentationImage Restoration