3D Scene Layout Generation

Ask about this topic

Overview

3D scene layout generation studies how to place and organize objects so a scene matches an input while remaining geometrically and functionally plausible. Methods include diffusion and autoregressive models, scene graphs and domain-specific languages, and language- or vision-language agents that build layouts step by step. Many systems use collision checks, physics simulation, reachability constraints, or visual feedback to refine placements, and are tested on indoor-scene benchmarks, image-based reconstruction, and simulation tasks. A central challenge is balancing semantic fidelity and visual quality with physical feasibility and usability; fine-grained evaluation of these properties remains difficult.

Latest papers

CardsList

80 papers10 papers in the last four weeks, up 43% on the four weeks before. 0.1% of all new papers.

  1. SceneBloom: Agentic Indoor Environment Generation with Realistic and Diverse Layouts for Embodied Learning

    Oct 23, 2026Yuhan Liu, Lianhui Qin, Shenji WanIndoor Scene Generation3D Scene Layout Generation

    New York University · University of California, San Diego

  2. CityLift: Compositional 3D Urban Generation from a Single Image

    Oct 23, 2026Haoran Gong, Jie Feng, Chenxu Wang3D Scene GenerationImage-to-3D Scene Generation

    School of Software Engineering, Xi’an Jiaotong University · Zhongguancun Academy, Beijing, China

  3. Easy-3Dfy: Object-Level Geometric Composition for Single-Image 3D Scene Construction

    Oct 23, 2026Ziang Zhang, Wenyou Yi, Zehan Wang +4Image-to-3D Scene Generation3D Scene Layout Generation

    Zhejiang University · Tencent

  4. VoxProg: 3D Spatial Reasoning through Voxel Programming

    Oct 21, 2026Zhichao Zhai, Menglei Zhao, Guikun Chen +43D Spatial Reasoning3D Scene Layout Generation

    Zhejiang University · vivo Mobile Communication Co., Ltd., Shenzhen, China

  5. GALA: Geometry-Aware Language Model for Controllable Object Arrangement

    Oct 20, 2026Chucheng Xiang, Runze Wang, Zhi Deng +103D Scene Layout Generation3D VLMs

    University of Science and Technology of China, Hefei, China · Tencent, Shenzhen, China · Tsinghua University, Shenzhen, China +1

  6. VIGOR: Verifiable Industrial Geometry Optimization and Repair in Scene Programs

    Oct 9, 2026Fuqiang Wang, Zheng Guo, Xiaoming Wu +53D Scene Layout GenerationLLM-Based Program Synthesis

    Qilu University of Technology, Jinan, China · Tianjin University, Tianjin, China · Shandong University, Jinan, China +3

  7. DistScene: Object-to-Scene Distillation for 3D Scene Generation

    Oct 3, 2026Kunming Luo, Hongyu Yan, Ken Deng +63D Scene GenerationImage-to-3D Scene Generation

    The Hong Kong University of Science and Technology · TeleAI, China Telecom

  8. SPHERE: Adaptive VR Indoor Scene Generation via LLM-Enhanced Spatial Preference Learning and Human-in-the-Loop RL

    Oct 1, 2026Hyeonmin Lee, Zheng Wei, Kyungmin Kwon +3Human-in-the-Loop AI3D Scene Generation

    Sungkyunkwan University · The Hong Kong University of Science and Technology

  9. SPOON: Towards Coherent Compositional 3D Scene Generation from Uncalibrated Multi-view Images

    Sep 30, 2026Guibiao Liao, Mochu Xiang, Heng Li +6Object Pose Estimation3D Scene Generation

    The University of Hong Kong · Shenzhen Loop Area Institute · TranscEngram +2

  10. Scene Retargeting: Learning Object Placement with Analogical Transfer

    Sep 29, 2026Minkwan Kim, Junho Kim, Seungmin Lee +23D Scene Layout Generation

    Dept. of Electrical and Computer Engineering, Seoul National University · Interdisciplinary Program in Artificial Intelligence and INMC, Seoul National University

  11. HARMONY: Hierarchical Agentic Reasoning for MONocular Image-to-Scene Synthesis

    Sep 22, 2026Shufan Sun, Chen Wang, Enxin Song +23D Reconstruction3D Scene Representation

    University of Pennsylvania

  12. Fysiverse-3D-Vision Technical Report: Generating Executable 3D Worlds from Images through Unified Spatial Reasoning

    Sep 22, 2026Dingkang Yang, Yizhou Liu, Wendong Cheng +53D Scene GenerationFunctional 3D Scene Generation

    Physical Superintelligence Lab, Fysics AI · Multimedia Laboratory (MMLab), The Chinese University of Hong Kong · College of Intelligent Robotics and Advanced Manufacturing, Fudan University

  13. Mira-Scene: Pixel-Aligned Layouts for Generative 3D Scene Reconstruction

    Sep 20, 2026Yang-Tian Sun, Tianjia Liu, Zehuan Huang +73D Reconstruction3D Scene Layout Generation

    The University of Hong Kong · VAST

  14. PACE: Precise AI Cinematic Expression

    Sep 17, 2026Bing Duan, Qiang Guo, Linpu Li +6Geometry-Conditioned Image GenerationConditional Image Generation

    Studio π

  15. SceneMosaic: Efficient and Diverse Simulation-Ready Scene Generation via Hybrid Agentic Layout Evolution

    Sep 4, 2026Xingjian Ran, Xiaoye Mo, Sihao Liu +33D Scene Generation3D Scene Layout Generation

    The University of Hong Kong · University of Electronic Science and Technology of China

  16. SpatialGuard: Harness-Guided Verifiable Spatial Reasoning for Text-to-Image Generation

    Sep 1, 2026Ziyun Qian, Zizhi Chen, Yizhou Liu +33D Spatial ReasoningT2I Generation

    College of Intelligent Robotics and Advanced Manufacturing, Fudan University · Fysics Intelligence Technologies Co., Ltd. (Fysics AI)

  17. ScenePilot: Grow-and-Repair Policy for Text-Driven 3D Indoor Scene Generation

    Aug 31, 2026Jiawei Zhang, Hongsong Wang, Pan Zhou3D Scene EditingFunctional 3D Scene Generation

    Southeast University · Singapore Management University

  18. FuncRoom-Agent: Sequential Feed-Forward 3D Functional Indoor Scene Generation

    Aug 30, 2026Hao Feng, Zhi Zuo, MingJian Liang +6Process Reward Models3D Scene Generation

  19. Text-Driven Artistic Staging: 3D Posing, Lighting, and Camera References from Paintings

    Aug 28, 2026Yunge WenHuman Motion Generation3D Scene Generation

    Massachusetts Institute of Technology, New York University, USA

  20. Semantic- and Density-Aware Planning for Accessibility-Preserving Multi-Object Placement

    Aug 17, 2026Benno Wingender, Nils Dengler, Nicolas Busch +2Robot Task PlanningLong-Horizon Robotic Manipulation

  21. Remote-Sensing City Layout Extraction with MLLM

    Aug 17, 2026Zigan Zhou, Kai Li, Yupeng DengRemote Sensing Image Understanding3D Scene Layout Generation

    City University of Hong Kong Hong Kong SAR, China · School of Electronic, Electrical and Communication Engineering University of Chinese Academy of Sciences Beijing, China · Aerospace Information Research Institute Chinese Academy of Sciences Beijing, China

  22. D3D-GEN: Robot-Aware Domain-Grounded Interactive 3D World Generation for Social Robotics

    Aug 12, 2026Anh Duc Do, Volodymyr Shcherbyna, Tai Duc Nguyen +5Robotics SimulationFunctional 3D Scene Generation

    Singapore Management University · Max Planck Institute · Technical University Braunschweig

  23. PolyLayout: Hierarchical VLM-Guided Layout Generation Beyond Rectangular Rooms

    Aug 11, 2026Yutong Jiang, Zahra Atashgahi, Carlos Soto Garcia Delgado +43D Scene Layout GenerationIndoor Scene Generation

    IKEA Retail (Ingka Group), Amsterdam, The Netherlands

  24. GOPI: Generation-Oriented 3D Pose Inference for Furniture Insertion from Single-View RGB-D Indoor Scenes

    Aug 7, 2026Ruifeng Zhai, Renjie Liu, Guangrun Wang +1Image GenerationObject Pose Estimation

    School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou 510000, China · the Guangdong Key Laboratory of Big Data Analysis and Processing · X-Era AI Lab

  25. iARCS: Iterative Agentic RL for Controllable 3D Scene Generation

    Aug 6, 2026Saugat Adhikari, Ashok Prasad Neupane, Pramish Paudel +2Constrained Generative ModelingAgentic RL

    Pulchowk Campus, IOE, Tribhuvan University, Lalitpur, Nepal · INSAIT, Sofia University “St. Kliment Ohridski”, Bulgaria · NAAMII, Kathmandu, Nepal

  26. Global Graph-Validated Optimization for VLM-based 3D Indoor Scene Generation

    Aug 4, 2026Jialu Huang, Yingxuan You, Fei Wang +13D Scene Generation3D Scene Representation

    National Key Laboratory of Human-Machine Hybrid Augmented Intelligence Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, China · 2 École Polytechnique Fédérale de Lausanne (EPFL), CVLab, Switzerland · School of Electronics and Information, Northwestern Polytechnical University and Shaanxi Key Laboratory of Information Acquisition and Processing, China

  27. Roomer: Reflective Object-Grounded Model Editing and Repair for 3D Indoor Layout Synthesis

    Aug 3, 2026Lingwei Dang, Ziyan Qiu, Jiajia Cheng +93D Scene Editing3D Scene Layout Generation

    School of Software Engineering, South China University of Technology · School of Information Science and Technology, ShanghaiTech University

  28. Learning an Interior Layout Policy in a Domain Specific Language Action Space

    Jul 31, 2026Yuhao Lu, Weichen Zhang, Wenyi Xiao +23D Scene Layout GenerationIndoor Scene Generation

    Taobao & Tmall Group of Alibaba

  29. PlanCraft: Sketch, Refine, and Furnish for Architect-Inspired Progressive 3D Residential Scene Generation

    Jul 26, 2026Pengyu Zeng, Yuqin Dai, Jun Yin +73D Scene Generation3D Scene Layout Generation

    Tsinghua University

  30. Scene-SAM3D: Multi-View Scene Asset Generation Without Fine-Tuning

    Jul 18, 2026Yuqi Zhang, Yadan Luo, Xiangyu Sun +33D Asset Generation3D Scene Generation

    The University of Queensland · Shanghai AI Laboratory · East China Normal University