Functional 3D Scene Generation

Overview

Functional 3D scene generation studies how to build environments that are not only visually plausible but also usable for activities such as navigation, object manipulation, and simulation. Methods include language- or vision-guided agents, procedural scene programs, learned object-relation models, and generative asset and layout systems, often combined with geometric constraints and physics-based checking or repair. Work spans indoor layouts, tabletop interactions, and larger simulated worlds for robotics, with evaluation based on measures such as collisions, reachability, relation correctness, task completion, and human preference. A central challenge is balancing visual quality and diversity with physical validity and functional completeness, while keeping generation efficient, editable, and reliable beyond familiar settings.

Latest papers

CardsList

37 papers5 papers in the last four weeks, down 50% on the four weeks before. 0.0% of all new papers.

  1. Greenscapes: Optimized Vegetation Configurations in Cities

    Oct 29, 2026Patryk Bartkowiak, Marcin Marlewski, Paweł Wójcik +53D Scene Layout GenerationFunctional 3D Scene Generation

  2. Cinematize from Unreal: Agentic Choreography for Controllable World Simulation

    Oct 28, 2026Zifan Song, Caihua Shan, Kaitao Song +3Functional 3D Scene GenerationCode Generation

  3. ScIntBench: Physical Interaction Plausibility in 3D Scene Generation

    Oct 27, 2026Wendi Ying, Daochang Liu, Leonid Sigal +13D Scene GenerationIndoor Scene Generation

  4. SceneBloom: Agentic Indoor Environment Generation with Realistic and Diverse Layouts for Embodied Learning

    Oct 23, 2026Yuhan Liu, Lianhui Qin, Shenji WanIndoor Scene Generation3D Scene Layout Generation

  5. Scene-Designer: Learning Design Intelligence for Agentic 3D Scene Generation

    Oct 16, 2026Xuanyu Liu, Hongyan Feng, Miao Pan +53D Scene GenerationIndoor Scene Generation

  6. PhySGA: A Physics-Space Grounded Agentic Framework for Generalizable and Interactive 3D Composition

    Oct 14, 2026Weichen Lyu, Chong Xia, Mingyu Dong +33D Scene GenerationRobotic Assembly

  7. EmbodiedSmith: Scaling Embodied Data through Recursive Self-Improvement Flywheel in Simulation

    Oct 6, 2026Yikai Qin, Yifei Deng, Mingjian Liang +13Robot Foundation ModelsRobotics Simulation

  8. DistScene: Object-to-Scene Distillation for 3D Scene Generation

    Oct 3, 2026Kunming Luo, Hongyu Yan, Ken Deng +63D Scene GenerationImage-to-3D Scene Generation

  9. LMBuild: Evaluating LLM Agents for Generating Buildable and Functional Structures

    Oct 3, 2026Jiateng Liu, Rushi Wang, Cheng Qian +9LLM Agent EvaluationAI Agent Benchmarks

  10. SPHERE: Adaptive VR Indoor Scene Generation via LLM-Enhanced Spatial Preference Learning and Human-in-the-Loop RL

    Oct 1, 2026Hyeonmin Lee, Zheng Wei, Kyungmin Kwon +3Human-in-the-Loop AI3D Scene Generation

  11. SPOON: Towards Coherent Compositional 3D Scene Generation from Uncalibrated Multi-view Images

    Sep 30, 2026Guibiao Liao, Mochu Xiang, Heng Li +6Object Pose Estimation3D Scene Generation

  12. WorldAgent: Verification-Guided Agentic Physical World Construction

    Sep 27, 2026Caoliwen Wang, Mengdi Wang, Yige Chen +133D Scene GenerationFunctional 3D Scene Generation

  13. Fysiverse-3D-Vision Technical Report: Generating Executable 3D Worlds from Images through Unified Spatial Reasoning

    Sep 22, 2026Dingkang Yang, Yizhou Liu, Wendong Cheng +53D Scene GenerationFunctional 3D Scene Generation

  14. ESG: Generating Physically Consistent Dynamic 3D Scenes from Text Descriptions

    Sep 14, 2026Xintong Fang, Zhiyuan Fang, Rengan Xie +63D SGG3D Scene Generation

  15. WorldSculpt: Generating Compositional Worlds from Grounded Videos

    Sep 4, 2026Muyao Niu, Jixuan He, Ruihan Yu +93D Scene Generation3D Scene Representation

  16. SceneMosaic: Efficient and Diverse Simulation-Ready Scene Generation via Hybrid Agentic Layout Evolution

    Sep 4, 2026Xingjian Ran, Xiaoye Mo, Sihao Liu +33D Scene Generation3D Scene Layout Generation

  17. ScenePilot: Grow-and-Repair Policy for Text-Driven 3D Indoor Scene Generation

    Aug 31, 2026Jiawei Zhang, Hongsong Wang, Pan Zhou3D Scene EditingFunctional 3D Scene Generation

  18. SpatialCrafter: Single Image World Modeling with Generative 3D Proxies

    Aug 27, 2026Chuan Fang, Lingteng Qiu, Yixun Liang +8Image-to-3D Scene Generation3D Scene Generation

  19. Beyond Placement and Articulation: Usage-Driven Code Scenes for Embodied Interaction

    Aug 19, 2026Zijian Xiao, Zipeng Ye, Jinkun Hao +33D Scene GenerationFunctional 3D Scene Generation

  20. D3D-GEN: Robot-Aware Domain-Grounded Interactive 3D World Generation for Social Robotics

    Aug 12, 2026Anh Duc Do, Volodymyr Shcherbyna, Tai Duc Nguyen +5Robotics SimulationFunctional 3D Scene Generation

  21. iARCS: Iterative Agentic RL for Controllable 3D Scene Generation

    Aug 6, 2026Saugat Adhikari, Ashok Prasad Neupane, Pramish Paudel +2Constrained Generative ModelingAgentic RL

  22. WorldClaw: Agentic 3D Open-World Generation at Scale

    Aug 5, 2026Chunchao Guo, Jinpeng Li, Yang Li +1Open-Ended Generation3D Asset Generation

  23. EmbodiedGen V2: An Agentic, Simulation-Ready 3D World Engine for Embodied AI

    Jul 8, 2026Xinjie Wang, Liu Liu, Taojun Ding +93D Asset GenerationRobotics Simulation

  24. CP4D: Compositional Physics-aware 4D Scene Generation

    Jun 8, 2026Hanxin Zhu, Cong Wang, Tianyu He +4Physical Consistency in Video Generation3D Scene Generation

  25. PhyScene3D: Physically Consistent Interactive 3D Tabletop Scene Generation

    Jun 1, 2026Weixing Chen, Zhuoqian Feng, Yang Liu +63D Scene GenerationFunctional 3D Scene Generation

  26. Function2Scene: 3D Indoor Scene Layout from Functional Specifications

    May 29, 2026Ruiqi Wang, Qimin Chen, Daniel Ritchie +43D Scene GenerationFunctional 3D Scene Generation