Autoregressive 3D Scene Generation

Latest papers

15 papers1 paper in the last four weeks, with none the four weeks before. 0.0% of all new papers.

GALA: Geometry-Aware Language Model for Controllable Object Arrangement
Oct 20, 2026Chucheng Xiang, Runze Wang, Zhi Deng +103D Scene Layout Generation 3D VLMs
University of Science and Technology of China, Hefei, China · Tencent, Shenzhen, China · Tsinghua University, Shenzhen, China +1
Sparse auto-regressive modeling for scene generation from multi-view images
Sep 3, 2026Thomas Lucas, Maxime Pietrantoni, Philippe Weinzaepfel +4Sparse-View 3D Reconstruction 3D Scene Generation
1NAVER LABS Europe, France · 2NAVER LABS, South Korea · 3Carnegie Mellon University, USA
OctWorld: Long-Range World-Consistent Video Generation with Octree-Based 3D Mapping
Sep 3, 2026Zelong Lv, Sicheng Xu, Jianfeng Xiang +53D Scene Representation Camera-Controlled Video Generation
University of Science and Technology of China · Microsoft Research Asia · Tsinghua University
MegaParts: Scaling Part-Aware 3D Object Generation to 300 Parts via Token-Efficient Autoregressive Modeling
Aug 14, 2026Manwen Liao, Xinyu Lian, Jian Mao +11Autoregressive 3D Scene Generation Part-Level 3D Generation
The University of Hong Kong · Shanghai Artificial Intelligence Laboratory · Fudan University +5
SubdivAR: Autoregressive Next-Scale Prediction for Neural Mesh Subdivision
Jun 25, 2026Huipeng Guo, Zikai Song, Hang Long +73D Mesh Generation Neural Representation Geometry
Huazhong University of Science and Technology
SuperVoxelGPT: Adaptive and Ordered 3D Tokenization for Autoregressive Shape Generation
May 28, 2026Yuan Li, Congyi Zhang, Xifeng Gao +13D Shape Generation Autoregressive Generation
University of Texas at Dallas, USA · LightSpeed, USA
Rollback-Free Stable Brick Structures Generation
May 7, 2026Chenhui Xu, Ziyue Bai, Fuxun Yu +23D Shape Generation Autoregressive Generation
University of Buffalo · University of Maryland, College Park · Microsoft +1
Repurposing 3D Generative Model for Autoregressive Layout Generation
Apr 17, 2026Haoran Feng, Yifan Niu, Zehuan Huang +43D Scene Generation Autoregressive Generation
School of Software, Beihang University · 2Tsinghua University · University of Hong Kong +2
Autoregressive Diffusion for Compositional Text-to-Scene Generation
Apr 17, 2026Zhenggang Tang, Yuehao Wang, Yuchen Fan +9Autoregressive Diffusion 3D Scene Generation
Meta Reality Labs · University of Illinois Urbana-Champaign · University of Texas at Austin
Omni123: Exploring 3D Native Foundation Models with Limited 3D Data by Unifying Text to 2D and 3D Generation
Apr 2, 2026Chongjie Ye, Cheng Cao, Chuanyu Pan +4Autoregressive 3D Scene Generation 3D Foundation Models
FNii-Shenzhen · SSE, CUHK(SZ) · Meshy AI
ARGS: Auto-Regressive Gaussian Splatting via Parallel Progressive Next-Scale Prediction
Apr 1, 2026Quanyuan Ruan, Kewei Shi, Jiabao Lei +2Autoregressive 3D Scene Generation 3D Asset Generation
South China University of Technology · The University of Hong Kong · The Chinese University of Hong Kong, Shenzhen +1
GaussianGPT: Towards Autoregressive 3D Gaussian Scene Generation
Mar 27, 2026Nicolas von Lützow, Barbara Rössle, Katharina Schmid +13D Gaussian Splatting 3D Scene Generation
Technical University of Munich, Germany
LoST: Level of Semantics Tokenization for 3D Shapes
Mar 18, 2026Niladri Shekhar Dutt, Zifan Shi, Paul Guerrero +4Autoregressive 3D Scene Generation 3D Shape Generation
University College London · Adobe Research
PixARMesh: Autoregressive Mesh-Native Single-View Scene Reconstruction
Mar 6, 2026Xiang Zhang, Sohyun Yoo, Hongrui Wu +3Autoregressive 3D Scene Generation 3D Mesh Reconstruction
UC San Diego · Lambda, Inc.
LaGen: Towards Autoregressive LiDAR Scene Generation
Nov 26, 2025Sizhuo Zhou, Xiaosong Jia, Fanrui Zhang +73D Scene Generation Autoregressive Generation
University of Science and Technology of China, Hefei, Anhui 230026, China · Shanghai Innovation Institute, Shanghai 200231, China · Fudan University, Shanghai 200433, China +1

Oct 20, 2026J/K move · Enter open · S save

GALA: Geometry-Aware Language Model for Controllable Object Arrangement

Chucheng Xiang, Runze Wang, Zhi Deng, Ruchao Bao+9

University of Science and Technology of China, Hefei, China · Tencent, Shenzhen, China · Tsinghua University, Shenzhen, China+1

3D Scene Layout Generation 3D VLMs Indoor Scene Generation Autoregressive 3D Scene Generation

Open paper AskPDF arXiv

Reasoning about fine-grained placement constraints, such as support and containment, is essential for realistic 3D scene creation. It remains a significant challenge for existing methods that rely on simplified object representations like oriented bounding box (OBB), which are blind to the detailed geometry. To address this limitation, we introduce GALA, a geometry-aware language model with explicit point cloud perception for controllable object placement. Our model performs autoregressively by predicting the 6D pose of one target object at a time conditioned on the scene context and placement instruction. We utilize a two-stage training strategy: the first stage aligns geometric and textual modalities through pretraining tasks, and the second stage fine-tunes the model for placement. To facilitate this task, we also curate a multi-source scene dataset covering diverse room types and fine-grained furniture arrangements, which will be open-sourced for community benefit. Experiments on our benchmark show our model significantly outperforms baselines without explicit geometric reasoning. We further develop a multi-stage plan-place-verify agent pipeline that uses the model for text-driven scene generation. Project Page: https://xccelephant.github.io/paper/gala/