3D Scene Layout Generation

Ask about this topic

Overview

3D scene layout generation studies how to place and organize objects so a scene matches an input while remaining geometrically and functionally plausible. Methods include diffusion and autoregressive models, scene graphs and domain-specific languages, and language- or vision-language agents that build layouts step by step. Many systems use collision checks, physics simulation, reachability constraints, or visual feedback to refine placements, and are tested on indoor-scene benchmarks, image-based reconstruction, and simulation tasks. A central challenge is balancing semantic fidelity and visual quality with physical feasibility and usability; fine-grained evaluation of these properties remains difficult.

Latest papers

CardsList

80 papers10 papers in the last four weeks, up 43% on the four weeks before. 0.1% of all new papers.

  1. SDesc3D: Towards Layout-Aware 3D Indoor Scene Generation from Short Descriptions

    Apr 2, 2026Jie Feng, Jiawei Shen, Junjia Huang +4Indoor Scene Generation3D Scene Layout Generation

    Xidian University China · Sun Yat-sen University China

  2. GardenDesigner: Encoding Aesthetic Principles into Jiangnan Garden Construction via a Chain of Agents

    Apr 2, 2026Mengtian Li, Fan Yang, Ruixue Xiong +33D Scene Generation3D Scene Layout Generation

    Shanghai University · Shanghai Engineering Research Center of Motion Picture Special Effects · The Hong Kong University of Science and Technology (Guangzhou)

  3. StoryBlender: Inter-Shot Consistent and Editable 3D Storyboard with Spatial-temporal Dynamics

    Apr 1, 2026Bingliang Li, Zhenhong Sun, Jiaming Bian +63D Scene Generation3D Scene Layout Generation

    Independent Researcher · Australia National University Australia · Central South University China +4

  4. WorldFlow3D: Flowing Through 3D Distributions for Unbounded World Generation

    Mar 31, 2026Amogh Joshi, Julian Ost, Felix Heide3D Scene Generation3D Scene Layout Generation

    Princeton University · Torc Robotics

  5. AeroScene: Progressive Scene Synthesis for Aerial Robotics

    Mar 24, 2026Nghia Vu, Tuong Do, Dzung Tran +63D Scene GenerationSynthetic Data Generation for Robotics

    AIOZ Ltd., Singapore · University of Liverpool, UK · National Tsing Hua University, Taiwan +2

  6. FlowScene: Style-Consistent Indoor Scene Generation with Multimodal Graph Rectified Flow

    Mar 20, 2026Zhifei Yang, Guangyao Zhai, Keyang Lu +6Image-to-3D Scene GenerationIndoor Scene Generation

    School of Computer Science, Peking University · Technical University of Munich · Beijing Jiaotong University +3

  7. Intelligent Co-Design: An Interactive LLM Framework for Interior Spatial Design via Multi-Modal Agents

    Mar 16, 2026Ren Jian Lim, Rushi Dai3D Scene Layout GenerationHuman-AI Co-Creation

    Hong Kong Center for Construction Robotics, The Hong Kong University of Science and Technology

  8. Scene Generation at Absolute Scale: Utilizing Semantic and Geometric Guidance From Text for Accurate and Interpretable 3D Indoor Scene Generation

    Mar 14, 2026Stefan Ainetter, Thomas Deixelberger, Edoardo A. Dominici +3Diffusion Model Guidance3D Scene Generation

    Huawei Technologies, Austria · Graz University of Technology, Austria · Huawei Technologies, Switzerland

  9. SceneAssistant: A Visual Feedback Agent for Open-Vocabulary 3D Scene Generation

    Mar 12, 2026Jun Luo, Jiaxiang Tang, Ruijie Lu +13D Scene GenerationText-to-3D Generation

    Peking University · NVIDIA

  10. MV-SAM3D: Adaptive Multi-View Fusion for Layout-Aware 3D Generation

    Mar 12, 2026Baicheng Li, Dong Wu, Jun Li +43D Shape Generation3D Scene Generation

    Peking University · JD Explore Academy

  11. PARSE: Part-Aware Relational Spatial Modeling

    Mar 8, 2026Yinuo Bai, Peijun Xu, Kuixiang Shao +5Spatial Reasoning3D Spatial Reasoning

    ShanghaiTech University · Deemos Technology

  12. Pano3DComposer: Feed-Forward Compositional 3D Scene Generation from Single Panoramic Image

    Mar 6, 2026Zidian Qiu, Ancong Wu3D Scene GenerationImage-to-3D Scene Generation

    Sun Yat-sen University

  13. TIMI: Training-Free Image-to-3D Multi-Instance Generation with Spatial Fidelity

    Mar 2, 2026Xiao Cai, Pengpeng Zeng, Ji Zhang +33D Scene Generation3D Diffusion Models

    School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu, China · School of Computer Science and Technology, Tongji University, Shanghai, China · School of Computing and Artificial Intelligence, Southwest Jiaotong University, Chengdu, China +1

  14. SeeThrough3D: Occlusion Aware 3D Control in Text-to-Image Generation

    Feb 26, 2026Vaibhav Agrawal, Rishubh Parihar, Pradhaan Bhat +2Controllable Image GenerationOcclusion Reasoning

    IIIT Hyderabad · IISc Bengaluru

  15. RoboLayout: Differentiable 3D Scene Generation for Embodied Agents

    Feb 18, 2026Ali Shamsaddinlou3D Scene Layout Generation3D Scene Generation

  16. PhyScensis: Physics-Augmented LLM Agents for Complex Physical Scene Arrangement

    Feb 16, 2026Yian Wang, Han Yang, Minghao Guo +53D Scene Layout GenerationFunctional 3D Scene Generation

    UMass Amherst · Genesis AI · MIT +1

  17. SceneReVis: A Self-Reflective Vision-Grounded Framework for 3D Indoor Scene Synthesis via Multi-Turn RL

    Feb 10, 2026Yang Zhao, Shizhao Sun, Meisheng Zhang +33D Scene GenerationIndoor Scene Generation

    Shanghai Jiao Tong University, Shanghai, China · Microsoft Research Asia, Beijing, China · Peking University, Beijing, China +1

  18. TabletopGen: Tabletop Scene Generation and Interactive Simulation for Robotic Manipulation

    Dec 1, 2025Ziqian Wang, Yonghao He, Licheng Yang +6Robotic Data CollectionRobotics Simulation

    School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China · State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), Institute of Automation, Chinese Academy of Sciences, Beijing, China · D-Robotics, Beijing, China +2

  19. Apples on the Table? Evaluating Text-Guided 3D Scene Synthesis via Fine-Grained Constraint Verification

    Nov 4, 2025Minseok Kang, Dongwook Choi, Gyeom Hwangbo +33D Spatial Reasoning3D Scene Generation

    Yonsei University

  20. DecompDreamer: A Composition-Aware Curriculum for Structured 3D Asset Generation

    Mar 15, 2025Utkarsh Nath, Rajeev Goel, Rahul Khurana +53D Asset GenerationText-to-3D Generation

    Arizona State University · Intel Labs · Stability AI