Overview

4D scene generation studies how to build dynamic 3D scenes that remain coherent as objects move and viewpoints change, from image, video, text, or action inputs. Common approaches lift video diffusion into dynamic Gaussian, mesh, or point-cloud representations; generate structured scene tokens autoregressively; or combine object-level motion with physics simulation. Language and trajectory controls are increasingly used to support editing, interaction, and embodied simulation. A central challenge is balancing visual quality with geometric, temporal, and physical consistency, especially for long sequences and unseen viewpoints where training data and reliable evaluations are limited.

Latest papers

CardsList

57 papers6 papers in the last four weeks, down 45% on the four weeks before. 0.0% of all new papers.

  1. PanDWM: Panoramic 4D Driving World Models

    Nov 15, 2026Jiajun Sun, Zeyu Zhang, Zeyu Ren +3World Models for Autonomous Driving4D Scene Generation

  2. DyCraft: An Agentic System for Long-Horizon 4D Scene Generation

    Oct 29, 2026Jeff Tan, Hang Dai, Zeqian Long +54D Scene Generation3D Scene Generation

  3. AEON: Unifying Video and 3D World Models

    Oct 20, 2026Weiqi Zhang, Wenyuan Zhang, Yu-Shen Liu +1Video World Models3D-Aware Video Generation

  4. Edit4D: Editable 4D Scene Generation with Textual Control

    Oct 15, 2026Chanwoo Kim, Tackgeun You, Hwasup Lim4D Scene Generation3D Scene Editing

  5. Code2Worlds-2: Physically Plausible Agent Harness for Embodied World Simulation

    Oct 13, 2026Haoyu Zhang, Siming Li, Zeyu Zhang +3Physics-Based SimulationEmbodied World Models

  6. GeoFix: Geometry Fixing for 4D Consistent Generation

    Oct 9, 2026Yeobin Hong, Hyojun Go, Dohun Lee +7Geometric Consistency in Video Generation4D Scene Generation

  7. OuroWorld: Bringing Any 3D World Alive as Diverse, Endlessly Looping 3D Cinemagraphs

    Oct 8, 2026You-Zhe Xie, Ting-Wei Chou, Yu-Hsuan Li +33D-Aware Video GenerationDynamic Scene Reconstruction

  8. MATE4D: Matrix-Guided Editable 4D Generation from a Single Image

    Oct 8, 2026Xiaotian Chen, Dongfu Yin4D Scene GenerationTemporal Consistency in Video Generation

  9. ChronoWorld: Camera-Controlled Consistent 4D World Generation via Spatiotemporal Cues and Geometric Reflections

    Oct 5, 2026Xiaoyu Zhou, Dingwei Xian, Zhenyu Wang +3Camera-Controlled Video GenerationMulti-View Video Generation

  10. DynaMesh: Dynamic 3D Texture Generation

    Oct 4, 2026Raj Hansini, Guan Chen, Rana Hanocka +13D Texture GenerationText-to-3D Generation

  11. Kepler4D: Controllable Future Video Generation via 4D Scene State Evolution

    Oct 2, 2026Feiran Wang, Bin Duan, Junyi Wu +2Video GenerationControllable Video Generation

  12. UniDynamics: Event-RGB Fusion for Unified Future 4D Dynamic Scene Generation

    Oct 2, 2026Daikun Liu, Xin Zhan, Teng Wang +24D Scene GenerationVideo Prediction

  13. NeuIDO: Neural Intrinsic Dynamics Operator for Physics-Informed 4D World Models

    Sep 21, 2026Jiajing Lin, Xin Zhang, Jianhua SunPhysics-Informed Generative ModelingNeural Operators

  14. VideoTok4D: A 4D-Aware Video Tokenizer for Compact World Representation

    Sep 11, 2026Xinyi Chen, Hanxin Zhu, Xijun Wang +4Video Diffusion ModelsVideo Token Compression

  15. PhysMAS: Physics-Grounded Multi-Agent Synthesis of Compositional 4D Gaussians

    Sep 7, 2026Jiang Qin, Chunji Lv, Yangguang Wei +63D Gaussian SplattingMaterial Point Method

  16. PASTEL: Panoramic Alignment for Monocular 4D Scene Reconstruction

    Sep 5, 2026Yuankun Yang, Yi Wei, Bo Bai +24D Reconstruction4D Scene Generation

  17. Streaming4D: Accelerate 4D World Models via Block-wise Video Generation and Incremental Reconstruction

    Sep 1, 2026Xiaoyan Liu, Jiaxin Liu, Kangrui Li +14D Reconstruction3D Reconstruction

  18. 4DSynth: Controllable Procedural World Synthesis for Dynamic Embodied Simulation

    Aug 27, 2026Zehao Qi, Haochen Luo, Jia-Wang Bian +2Procedural Content Generation4D Scene Generation

  19. GaussianDWM++: Language-Grounded 3D Gaussian Driving World Model for Unified Scene Understanding, Editing, and Multi-Modal Generation

    Aug 17, 2026Tianchen Deng, Xuefeng Chen, Shuang Wu +5World Models for Autonomous Driving4D Scene Generation

  20. Beyond Pixels: From Video Priors to 4D Worlds

    Aug 11, 2026Zihao Liu, Xiaolong Shen, Zhenglin Zhou +2Video Diffusion Models4D Scene Generation

  21. 4DHumanDiff: Direct Text-to-4DGS Generation for Consistent 360-Degree Dynamic Humans

    Jul 30, 2026Renlong Wu, Haoran Chen, Yuxiang Wei +33D Gaussian Splatting3D Avatar Generation

  22. GS-Agent: Creating 4D Physical Worlds With Generative Simulation

    Jul 23, 2026Hongxin Zhang, Chunru Lin, Junyan Li +3Procedural Content Generation4D Scene Generation

  23. Hallo4D: Multi-Modal Hallucination Mitigation for Consistent Spatio-Temporal Generation

    Jul 14, 2026Hongbo Wang, Huaibo Huang, Jie Cao +3Multi-View Consistency3D Scene Generation

  24. RynnWorld-4D: 4D Embodied World Models for Robotic Manipulation

    Jul 7, 2026Haoyu Zhao, Xingyue Zhao, Siteng Huang +3Language-Conditioned Robot ManipulationBimanual Robotic Manipulation

  25. Alignment Is All You Need For X-to-4D Generation

    Jul 2, 2026Qiaowei Miao, Kehan Li, Yawei Luo +1Cross-Modal AlignmentMultimodal Generation

  26. SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation

    Jul 2, 2026Chunjiang Liu, Xiaoyuan Wang, Haoyu Chen +3Multi-Agent LLM Systems3D Scene Generation