3D Scene Layout Generation

Overview

3D scene layout generation studies how to place and organize objects so a scene matches an input while remaining geometrically and functionally plausible. Methods include diffusion and autoregressive models, scene graphs and domain-specific languages, and language- or vision-language agents that build layouts step by step. Many systems use collision checks, physics simulation, reachability constraints, or visual feedback to refine placements, and are tested on indoor-scene benchmarks, image-based reconstruction, and simulation tasks. A central challenge is balancing semantic fidelity and visual quality with physical feasibility and usability; fine-grained evaluation of these properties remains difficult.

Latest papers

CardsList

86 papers11 papers in the last four weeks, up 57% on the four weeks before. 0.1% of all new papers.

  1. Evaluating Language Models as Spatial Priors for Object-Goal Navigation

    Nov 13, 2026Jun MiuraObject-Goal NavigationSpatial Reasoning in Language Models

  2. Deformable Contact-Aware 3D Object Placement

    Nov 5, 2026Songhe Wang, David Miller, Charles A. Kamhoua3D Scene Layout Generation

  3. Bri3D: Bridging the Object-Scene Gap in Single-Image 3D Generation via Scene-Anchor

    Nov 5, 2026Hongye Hou, Shuai Zhang, Hongjie Li +4Image-to-3D Scene Generation3D Scene Layout Generation

  4. GREP: Grounding Generated Room Evaluation in Principles

    Nov 4, 2026Mohan Cao, Yongsen Mao, Chucheng Xiang +4Automated EvaluationIndoor Scene Generation

  5. Greenscapes: Optimized Vegetation Configurations in Cities

    Oct 29, 2026Patryk Bartkowiak, Marcin Marlewski, Paweł Wójcik +53D Scene Layout GenerationFunctional 3D Scene Generation

  6. SceneBloom: Agentic Indoor Environment Generation with Realistic and Diverse Layouts for Embodied Learning

    Oct 23, 2026Yuhan Liu, Lianhui Qin, Shenji WanIndoor Scene Generation3D Scene Layout Generation

  7. CityLift: Compositional 3D Urban Generation from a Single Image

    Oct 23, 2026Haoran Gong, Jie Feng, Chenxu Wang3D Scene GenerationImage-to-3D Scene Generation

  8. VoxProg: 3D Spatial Reasoning through Voxel Programming

    Oct 21, 2026Zhichao Zhai, Menglei Zhao, Guikun Chen +43D Spatial Reasoning3D Scene Layout Generation

  9. GALA: Geometry-Aware Language Model for Controllable Object Arrangement

    Oct 20, 2026Chucheng Xiang, Runze Wang, Zhi Deng +103D Scene Layout Generation3D VLMs

  10. VIGOR: Verifiable Industrial Geometry Optimization and Repair in Scene Programs

    Oct 9, 2026Fuqiang Wang, Zheng Guo, Xiaoming Wu +53D Scene Layout GenerationLLM-Based Program Synthesis

  11. DistScene: Object-to-Scene Distillation for 3D Scene Generation

    Oct 3, 2026Kunming Luo, Hongyu Yan, Ken Deng +63D Scene GenerationImage-to-3D Scene Generation

  12. SPHERE: Adaptive VR Indoor Scene Generation via LLM-Enhanced Spatial Preference Learning and Human-in-the-Loop RL

    Oct 1, 2026Hyeonmin Lee, Zheng Wei, Kyungmin Kwon +3Human-in-the-Loop AI3D Scene Generation

  13. SPOON: Towards Coherent Compositional 3D Scene Generation from Uncalibrated Multi-view Images

    Sep 30, 2026Guibiao Liao, Mochu Xiang, Heng Li +6Object Pose Estimation3D Scene Generation

  14. Scene Retargeting: Learning Object Placement with Analogical Transfer

    Sep 29, 2026Minkwan Kim, Junho Kim, Seungmin Lee +23D Scene Layout Generation

  15. Fysiverse-3D-Vision Technical Report: Generating Executable 3D Worlds from Images through Unified Spatial Reasoning

    Sep 22, 2026Dingkang Yang, Yizhou Liu, Wendong Cheng +53D Scene GenerationFunctional 3D Scene Generation

  16. Mira-Scene: Pixel-Aligned Layouts for Generative 3D Scene Reconstruction

    Sep 20, 2026Yang-Tian Sun, Tianjia Liu, Zehuan Huang +73D Reconstruction3D Scene Layout Generation

  17. SceneMosaic: Efficient and Diverse Simulation-Ready Scene Generation via Hybrid Agentic Layout Evolution

    Sep 4, 2026Xingjian Ran, Xiaoye Mo, Sihao Liu +33D Scene Generation3D Scene Layout Generation

  18. SpatialGuard: Harness-Guided Verifiable Spatial Reasoning for Text-to-Image Generation

    Sep 1, 2026Ziyun Qian, Zizhi Chen, Yizhou Liu +33D Spatial ReasoningT2I Generation

  19. ScenePilot: Grow-and-Repair Policy for Text-Driven 3D Indoor Scene Generation

    Aug 31, 2026Jiawei Zhang, Hongsong Wang, Pan Zhou3D Scene EditingFunctional 3D Scene Generation

  20. Text-Driven Artistic Staging: 3D Posing, Lighting, and Camera References from Paintings

    Aug 28, 2026Yunge WenHuman Motion Generation3D Scene Generation

  21. Remote-Sensing City Layout Extraction with MLLM

    Aug 17, 2026Zigan Zhou, Kai Li, Yupeng DengRemote Sensing Image Understanding3D Scene Layout Generation

  22. D3D-GEN: Robot-Aware Domain-Grounded Interactive 3D World Generation for Social Robotics

    Aug 12, 2026Anh Duc Do, Volodymyr Shcherbyna, Tai Duc Nguyen +5Robotics SimulationFunctional 3D Scene Generation

  23. PolyLayout: Hierarchical VLM-Guided Layout Generation Beyond Rectangular Rooms

    Aug 11, 2026Yutong Jiang, Zahra Atashgahi, Carlos Soto Garcia Delgado +43D Scene Layout GenerationIndoor Scene Generation

  24. GOPI: Generation-Oriented 3D Pose Inference for Furniture Insertion from Single-View RGB-D Indoor Scenes

    Aug 7, 2026Ruifeng Zhai, Renjie Liu, Guangrun Wang +1Image GenerationObject Pose Estimation