3D Scene Editing

Ask about this topic

Overview

3D scene editing turns instructions, images, or direct user input into changes to a reconstructed or generated world, supporting design, content creation, and simulation. Approaches include editing native representations such as 3D Gaussian splats, meshes, and neural fields, as well as editing 2D views with diffusion models and lifting the results into 3D; newer systems also use scene graphs, language agents, and structured action planning. Work spans local object changes, removal and insertion, layout editing, relighting, and dynamic scenes, with evaluation increasingly checking edit fidelity, locality, preservation of untouched regions, and consistency across viewpoints. The central tension is that flexible, prompt-faithful edits can damage geometry or surrounding content, while reliable preservation and multi-view consistency can limit the scale of changes or increase computation.

Latest papers

CardsList

91 papers11 papers in the last four weeks, up 175% on the four weeks before. 0.1% of all new papers.

  1. 3DCodeEdit: Benchmarking Instruction-Guided 3D Program Editing

    Oct 28, 2026Binjie Wang, Xinran Zhao, Shoubin Yu +83D Asset Editing3D Scene Editing

    New York University · Carnegie Mellon University · UNC, Chapel Hill +3

  2. GraftRay: Physically Based Mesh Insertion into Gaussian Splatting Scenes via Path Tracing

    Oct 27, 2026Jinxin Ai, Matthias Niessner3D Scene Editing3D Gaussian Splatting

    Technical University of Munich

  3. VitronEdit: Universal Visual Editing across Images, Videos, and 3D Scenes

    Oct 19, 2026Jing Wang, Yanlin Li, Mong-Li Lee +33D Scene EditingImage Editing

    National University of Singapore · University of Oxford

  4. RxGS: Relightable Gaussian Stylization via BRDF Decomposition

    Oct 19, 2026Wanrong Hong, Liu Jiang, Mukesh Prasad +13D Scene Editing3D Gaussian Splatting

    School of Computer Science, University of Technology Sydney, Sydney, Australia. · Department of Civil and Environmental Engineering, Stanford University, Stanford, United State. · Australian Artificial Intelligence Institute, University of Technology Sydney, Sydney, 2007, Australia.

  5. Edit4D: Editable 4D Scene Generation with Textual Control

    Oct 15, 2026Chanwoo Kim, Tackgeun You, Hwasup Lim4D Scene Generation3D Scene Editing

    1Korea Institute of Science and Technology (KIST), Republic of Korea · University of Science and Technology (UST), Republic of Korea

  6. UMAS3D: Unified Mask-Free 3D Editing with Region-Adaptive Source Preservation

    Oct 11, 2026Xianlin Zeng, Xiaolong Shen, Ruijie Quan +13D Asset Editing3D Shape Editing

    ReLER, College of Artificial Intelligence, Zhejiang University

  7. View Matters: Keyframe-Guided Text-Driven 3D Gaussian Editing

    Oct 6, 2026Kaizhe Zhang, Yijie Zhou, Weizhan Zhang +33D Gaussian Splatting3D Scene Editing

    School of Computer Science and Technology, MOE-KLINNS Lab Xi’an Jiaotong University, Xi’an, Shaanxi 710049, China

  8. ElasticFit: Fit-Aware 3D Object Insertion via VLM Reasoning and Generative Adaptation

    Oct 5, 2026Tzu-Hsin Hsieh, Ricardo Marroquim3D Scene Editing3D Visual Grounding

    Delft University of Technology Delft, Netherlands

  9. ChromaGS: Text-Driven Semantic Editing of 4D Gaussian Avatars

    Oct 2, 2026Antonio Canela, Jordi Sànchez-Riera3D Scene Editing3D Gaussian Splatting

    Universitat Polit`ecnica de Catalunya · Institut de Rob`otica i Inform`atica Industrial, CSIC-UPC

  10. SCION: Scene Composition with Instanced Neural Primitives

    Oct 1, 2026William Koch, Amogh Joshi, Cyrus Vachha +23DGS Compression3D Scene Editing

    Princeton University

  11. EditHero: A Benchmark for Long-Horizon Part-Level 3D Editing and Vibe Modeling

    Oct 1, 2026Ruihan Yu, Yu-Ju Tsai, Muyao Niu +93D Asset Editing3D Shape Editing

    Alaya Lab · The University of Tokyo · Institute of Science Tokyo +1

  12. WINGS: Reference-Free Gaussian Splatting Inpainting with 3D-Native Generative Priors

    Sep 29, 2026Noé Lallouet, Michael Fischer, Elie Michel3D Gaussian Splatting3D Scene Editing

    Adobe MILES Team, LAMSADE Paris Dauphine – PSL University Paris, France · Adobe London, UK · Adobe Paris, France

  13. Code4Scene: Benchmarking Coding Agents for Constructing and Editing 3D Scenes

    Sep 29, 2026Xiaokang Ye, Siddhant Hitesh Mantri, Zimeng Chen +6AI Coding Agents3D Scene Editing

    UC San Diego · UC Berkeley

  14. φ-RIE: From Photorealistic Reconstruction to Interactive Environments

    Sep 22, 2026Runyi Yang, Deheng Zhang, Xiaoye Wang +63D Gaussian Splatting3D Scene Editing

    INSAIT, Sofia University “St. Kliment Ohridski”. · vivo Mobile Communication Co., Ltd. · Karlsruhe Institute of Technology

  15. What Makes a 3D Scene Editable? A Factorized Benchmark of Fidelity, Locality, Consistency, and Preservation

    Sep 14, 2026Sariah Patro, Arjun Mehra, Nikhil Bhatia3D Gaussian Splatting3D Scene Editing

    University of Delhi & Jadavpur University

  16. PointGT: Simultaneous Geometry and Texture Editing for Point-Based Representations

    Sep 3, 2026Yanshu Zhang, George Shramko, Pratul P. Srinivasan +13D Shape Editing3D Scene Editing

    Simon Fraser University, Canada · Google DeepMind, USA · Alberta Machine Intelligence Institute (Amii), Canada +1

  17. ScenePilot: Grow-and-Repair Policy for Text-Driven 3D Indoor Scene Generation

    Aug 31, 2026Jiawei Zhang, Hongsong Wang, Pan Zhou3D Scene EditingFunctional 3D Scene Generation

    Southeast University · Singapore Management University

  18. LightFuse: Relightable Interactive Gaussian Scene Reconstruction via Multi-Scan Fusion and 2D Gaussian Ray Tracing

    Aug 29, 2026Haonan Zhou, Gaoxiang Linghu, Youlin Jia +5Differentiable Ray Tracing3D Scene Relighting

    ZJU-UIUC Institute, Zhejiang University · College of Mathematics, Sichuan University · College of Computer Science and Technology, Zhejiang University +1

  19. Chat-Edit-3D++: Interactive 3D and 4D Scene Editing via Large Language Models

    Aug 29, 2026Shuangkang Fang, Yufeng Wang, Yi-Hsuan Tsai +43D Scene EditingText-Guided 3D Scene Editing

    School of Electrical and Information Engineering, Beihang University, Beijing 100191, China. · Institute of Unmanned System, Beihang University, Beijing 100191, China. · Atmanity Inc., USA. +2

  20. CoGeo-GS: Concept-Driven and Geometry-Aware Multi-Object Removal in 3D Scenes

    Aug 27, 2026Yuanxiang Ni, Xianliang Huang, Chenhang Ma +43D Scene Editing3D Gaussian Splatting

    Southern University of Science and Technology, Shenzhen, China · PICO, ByteDance, Beijing, China · Zhejiang University, Hangzhou, China +2

  21. LumiTokens: 3D Relighting via Token-Space Lighting Transformation

    Aug 18, 2026Yiwen Chen, Matheus Gadelha, Huaizu Jiang3D Scene RelightingImage Relighting

    Northeastern University · Adobe Research

  22. DesignAgent3D: Interactive 3D Scene Editing via Designer-like Multimodal Reasoning

    Aug 18, 2026Xiujin Liu, Tianyu Yang, Yilun Zhao +13D Scene EditingText-Guided 3D Scene Editing

    University of Notre Dame South Bend, Indiana, USA · Yale University New Haven, Connecticut, USA

  23. GaussianDWM++: Language-Grounded 3D Gaussian Driving World Model for Unified Scene Understanding, Editing, and Multi-Modal Generation

    Aug 17, 2026Tianchen Deng, Xuefeng Chen, Shuang Wu +5World Models for Autonomous Driving4D Scene Generation

    School of Automation and Intelligent Sensing, Shanghai Jiao Tong University; the State Key Laboratory of Avionics Integration and Aviation System-of-Systems Synthesis; and the Shanghai Key Laboratory of Navigation and Location Based Services, Shanghai 200240, China · Tsinghua University, Shenzhen, China · Chongqing Afari Intelligent Drive Co., Ltd., China +1

  24. ReRef-3D: A Benchmark for Spatial Referring Expression-Guided 3D Object Placement

    Aug 17, 2026Mary Lynn Martin, Yifei Zhang, Martha Palmer +13D Spatial Reasoning3D Scene Editing

    University of Colorado Boulder

  25. VibeWorlding: Can Multimodal Agents Construct 3D Open Worlds End-to-End?

    Aug 15, 2026Yansong Ning, Jingwen Ye, Zhongkai Wu +5Multimodal AgentsAI Agent Benchmarks

    AI Thrust, HKUST(GZ) · TEG AIPD, Tencent

  26. StateFlow: Building, Evolving, and Accessing 3D World States for Previsualization

    Aug 12, 2026Yuyang Yin, Zixiang Li, Longxuan Deng +113D Scene Editing3D Scene Generation

    Beijing Jiaotong University · Mootion AI · Beijing Normal University +2

  27. Roomer: Reflective Object-Grounded Model Editing and Repair for 3D Indoor Layout Synthesis

    Aug 3, 2026Lingwei Dang, Ziyan Qiu, Jiajia Cheng +93D Scene Editing3D Scene Layout Generation

    School of Software Engineering, South China University of Technology · School of Information Science and Technology, ShanghaiTech University

  28. GaussianSelector: Lightweight Human-Guided Object Selection in 3D Gaussian Splatting with Graph Optimization

    Aug 2, 2026Baihan Yang, Tiexin Li, Yuheng Liu +43D Gaussian Splatting3D Scene Editing

    UC San Diego · City University of Hong Kong · UC Irvine

  29. FocusGS: Spatial Delta Layers for Local Repair and Deterministic Editing of Trained 3D Gaussian Assets

    Jul 30, 2026Yiqun Pan, Yukun Shi3D Gaussian Splatting3D Scene Editing

    College of Information Science and Technology, Beijing University of Chemical Technology, Beijing, China

  30. NEO: NeRF It Once, Edit It Many Times for Continuous Object Manipulation

    Jul 27, 2026Mikołaj Zieliński, David Hall, Dominik Belter +13D Scene EditingRobotic Manipulation

    Institute of Robotics and Machine Intelligence, Poznan University of Technology, 61-131 Pozna´n, Poland · CSIRO Robotics, CSIRO, Australia