Indoor Scene Generation

Ask about this topic

Overview

Indoor scene generation studies how to turn descriptions, images, floor plans, and user needs into coherent room layouts and 3D environments. Methods range from procedural rules and scene graphs to diffusion models, autoregressive generators, and language-model agents that plan, validate, and refine object placement. The results can support architectural design and create interactive environments for robotics and simulation. A central challenge is balancing visual realism and semantic control with physical validity, usability, and efficient editing, especially in complex or multi-room spaces.

Latest papers

CardsList

63 papers5 papers in the last four weeks, up 25% on the four weeks before. 0.0% of all new papers.

  1. SceneBloom: Agentic Indoor Environment Generation with Realistic and Diverse Layouts for Embodied Learning

    Oct 23, 2026Yuhan Liu, Lianhui Qin, Shenji WanIndoor Scene Generation3D Scene Layout Generation

    New York University · University of California, San Diego

  2. GALA: Geometry-Aware Language Model for Controllable Object Arrangement

    Oct 20, 2026Chucheng Xiang, Runze Wang, Zhi Deng +103D Scene Layout Generation3D VLMs

    University of Science and Technology of China, Hefei, China · Tencent, Shenzhen, China · Tsinghua University, Shenzhen, China +1

  3. Scene-Designer: Learning Design Intelligence for Agentic 3D Scene Generation

    Oct 16, 2026Xuanyu Liu, Hongyan Feng, Miao Pan +53D Scene GenerationIndoor Scene Generation

    Zhejiang University · Universal Identification Technology (Hangzhou) Co.,Ltd.

  4. RenoLayout: Unified Floorplan Renovation and Furniture Layout for Constraint-Aware Residential Design

    Oct 15, 2026Jingguo Liu, Yuanqing Liu, Chong Zhang +1Constrained Generative ModelingIndoor Scene Generation

    Beike

  5. EnvDreamer: Large-Scale Multimodal-to-Environment Generation for Embodied AI

    Oct 3, 2026Kabir Swain, Sijie Han, Antonio TorralbaSynthetic Data Generation for Robotics3D Scene Generation

    MIT · University of Toronto

  6. SPHERE: Adaptive VR Indoor Scene Generation via LLM-Enhanced Spatial Preference Learning and Human-in-the-Loop RL

    Oct 1, 2026Hyeonmin Lee, Zheng Wei, Kyungmin Kwon +3Human-in-the-Loop AI3D Scene Generation

    Sungkyunkwan University · The Hong Kong University of Science and Technology

  7. Awomo-SimDataEngine: Agentic Simulation-ReadyWorld Generation

    Oct 1, 2026Awomo-PhysicalRSI Team, Danjiao Ma, Enhui Ma +21Robot Demonstration GenerationSynthetic Data Generation for Robotics

    Awomo-PhysicalRSI Team

  8. BinoGen: Scaling egocentric binocular data for embodied visual perception and learning

    Sep 17, 2026Chunpeng Li, Ya-tang LiSynthetic Data GenerationStereo Vision

    College of Biological Sciences, China Agricultural University, Beijing, China · Beijing Institute for Brain Research, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China · Chinese Institute for Brain Research, Beijing (CIBR), Beijing, China

  9. SceneMosaic: Efficient and Diverse Simulation-Ready Scene Generation via Hybrid Agentic Layout Evolution

    Sep 4, 2026Xingjian Ran, Xiaoye Mo, Sihao Liu +33D Scene Generation3D Scene Layout Generation

    The University of Hong Kong · University of Electronic Science and Technology of China

  10. ScenePilot: Grow-and-Repair Policy for Text-Driven 3D Indoor Scene Generation

    Aug 31, 2026Jiawei Zhang, Hongsong Wang, Pan Zhou3D Scene EditingFunctional 3D Scene Generation

    Southeast University · Singapore Management University

  11. FuncRoom-Agent: Sequential Feed-Forward 3D Functional Indoor Scene Generation

    Aug 30, 2026Hao Feng, Zhi Zuo, MingJian Liang +6Process Reward Models3D Scene Generation

  12. Beyond Placement and Articulation: Usage-Driven Code Scenes for Embodied Interaction

    Aug 19, 2026Zijian Xiao, Zipeng Ye, Jinkun Hao +33D Scene GenerationFunctional 3D Scene Generation

    Shanghai Jiao Tong University · Meituan

  13. D3D-GEN: Robot-Aware Domain-Grounded Interactive 3D World Generation for Social Robotics

    Aug 12, 2026Anh Duc Do, Volodymyr Shcherbyna, Tai Duc Nguyen +5Robotics SimulationFunctional 3D Scene Generation

    Singapore Management University · Max Planck Institute · Technical University Braunschweig

  14. PolyLayout: Hierarchical VLM-Guided Layout Generation Beyond Rectangular Rooms

    Aug 11, 2026Yutong Jiang, Zahra Atashgahi, Carlos Soto Garcia Delgado +43D Scene Layout GenerationIndoor Scene Generation

    IKEA Retail (Ingka Group), Amsterdam, The Netherlands

  15. GOPI: Generation-Oriented 3D Pose Inference for Furniture Insertion from Single-View RGB-D Indoor Scenes

    Aug 7, 2026Ruifeng Zhai, Renjie Liu, Guangrun Wang +1Image GenerationObject Pose Estimation

    School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou 510000, China · the Guangdong Key Laboratory of Big Data Analysis and Processing · X-Era AI Lab

  16. To See a World in a Living Context: Unified Indoor-Outdoor Urban World Generation

    Aug 6, 2026Xiaobin Huang, Zilong Huang, Yang Luo +33D Scene GenerationText-to-3D Generation

    1Sun Yat-sen University · 2Norwegian University of Science and Technology · 1Sun Yat-sen

  17. Global Graph-Validated Optimization for VLM-based 3D Indoor Scene Generation

    Aug 4, 2026Jialu Huang, Yingxuan You, Fei Wang +13D Scene Generation3D Scene Representation

    National Key Laboratory of Human-Machine Hybrid Augmented Intelligence Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, China · 2 École Polytechnique Fédérale de Lausanne (EPFL), CVLab, Switzerland · School of Electronics and Information, Northwestern Polytechnical University and Shaanxi Key Laboratory of Information Acquisition and Processing, China

  18. Roomer: Reflective Object-Grounded Model Editing and Repair for 3D Indoor Layout Synthesis

    Aug 3, 2026Lingwei Dang, Ziyan Qiu, Jiajia Cheng +93D Scene Editing3D Scene Layout Generation

    School of Software Engineering, South China University of Technology · School of Information Science and Technology, ShanghaiTech University

  19. SG-Layout: Structured Scene Graph-Guided Layout Generation with LLMs

    Aug 2, 2026Junsheng Wang, Chao Chen, Mengying Xie +2Indoor Scene Generation

    Chongqing University, Chongqing, China

  20. Learning an Interior Layout Policy in a Domain Specific Language Action Space

    Jul 31, 2026Yuhao Lu, Weichen Zhang, Wenyi Xiao +23D Scene Layout GenerationIndoor Scene Generation

    Taobao & Tmall Group of Alibaba

  21. Genie Sim PanoWorld: An Infinite Indoor 3D World Generation Pipeline via Panoramic Scene Modeling and Simulation

    Jul 29, 2026Yongxin Su, Linjie Hou, Feng Wang +4Camera-Controlled Video GenerationVideo Diffusion Models

    Corresponding author.

  22. PlanCraft: Sketch, Refine, and Furnish for Architect-Inspired Progressive 3D Residential Scene Generation

    Jul 26, 2026Pengyu Zeng, Yuqin Dai, Jun Yin +73D Scene Generation3D Scene Layout Generation

    Tsinghua University

  23. Agentic Designer: Progressive Multi-Agent Collaboration for Structure-Aware Interior Layout Generation

    Jul 23, 2026Zhijing Yang, Haocheng Lin, Zhihua Xu +4Constrained Generative ModelingMulti-Agent Systems

    Guangdong University of Technology, Guangzhou, China · Sun Yat-sen University, Guangzhou, China · South China University of Technology, Guangzhou, China

  24. ThinkBLOX: 3D Indoor Scene Generation with Progressive Reasoning

    Jul 15, 2026Yuan Xiao, Can Wang, Xiangyu Kong +13D Scene Editing3D Scene Generation

    Department of Computer Science, City University of Hong Kong, Hong Kong · School of Computing and Data Science, University of Hong Kong · School of Computer Science, Beijing Information Science and Technology University

  25. MAGIC: Transition-Aware Generation of Navigable Multi-Scene Game Worlds with Large Language Models

    Jul 13, 2026Tsz Hei Fan, Choi Wing Fung, Yuxuan Wan +23D Scene GenerationProcedural Content Generation

    Department of Computer Science and Engineering, The Chinese University of Hong Kong

  26. 3D Scene Graph Prediction: Generating Hierarchical Models from Partially Observed Environments

    Jul 12, 2026Siyi H, Jared Strade, Hyungtae Lim +13D SGG3D Scene Layout Generation

    Laboratory for Information & Decision Systems (LIDS), Massachusetts Institute of Technology, Cambridge, MA 02139, USA. · Department of Electrical and Computer Engineering, Oakland University, Rochester, MI 48309, USA.

  27. GRE-Diff: Gaussian Room Embeddings for Structured Layout Diffusion

    Jul 9, 2026Jing Wang, Haoran Xiong, Zihao Yan +2Floor Plan GenerationIndoor Scene Generation

    Guangdong Provincial Key Laboratory of Visual Media and Multidimensional Intelligence, CSSE, Shenzhen University, China · School of Computer Science, University of Guelph, Canada

  28. InSpace: Structure-Aware 3D Indoor Scene Generation from a Single 360° Image

    Jul 4, 2026Gwanhyeong Koo, Hyunsu Kim, Youngji Kim +53D Scene Generation3D Scene Layout Generation

    1KAIST · *Work done during an internship at NAVER LABS. · 2NAVER LABS +1

  29. Text-Driven 3D Indoor Scene Synthesis in Non-Manhattan Environments

    Jul 2, 2026Xianhui Meng, Zirui Song, Yuchen Zhang +103D Scene Generation3D Scene Layout Generation

    University of Science and Technology of China · Xiaomi EV · Mohamed bin Zayed University of Artificial Intelligence +4

  30. Architect-Ant: Editable Automatic Furnishing of Architectural Floor Plans

    Jun 9, 2026Fedor Rodionov, Aleksandar Cvejic, Michael Birsak +2Procedural Content GenerationIndoor Scene Generation

    King Abdullah University of Science and Technology (KAUST), Saudi Arabia · Miami University, United States of America