Overview

4D scene generation studies how to build dynamic 3D scenes that remain coherent as objects move and viewpoints change, from image, video, text, or action inputs. Common approaches lift video diffusion into dynamic Gaussian, mesh, or point-cloud representations; generate structured scene tokens autoregressively; or combine object-level motion with physics simulation. Language and trajectory controls are increasingly used to support editing, interaction, and embodied simulation. A central challenge is balancing visual quality with geometric, temporal, and physical consistency, especially for long sequences and unseen viewpoints where training data and reliable evaluations are limited.

Latest papers

CardsList

52 papers12 papers in the last four weeks, up 140% on the four weeks before. 0.1% of all new papers.

  1. AEON: Unifying Video and 3D World Models

    Oct 20, 2026Weiqi Zhang, Wenyuan Zhang, Yu-Shen Liu +1Video World Models3D-Aware Video Generation

  2. Edit4D: Editable 4D Scene Generation with Textual Control

    Oct 15, 2026Chanwoo Kim, Tackgeun You, Hwasup Lim4D Scene Generation3D Scene Editing

  3. Code2Worlds-2: Physically Plausible Agent Harness for Embodied World Simulation

    Oct 13, 2026Haoyu Zhang, Siming Li, Zeyu Zhang +3Physics-Based SimulationEmbodied World Models

  4. GeoFix: Geometry Fixing for 4D Consistent Generation

    Oct 9, 2026Yeobin Hong, Hyojun Go, Dohun Lee +7Geometric Consistency in Video Generation4D Scene Generation

  5. OuroWorld: Bringing Any 3D World Alive as Diverse, Endlessly Looping 3D Cinemagraphs

    Oct 8, 2026You-Zhe Xie, Ting-Wei Chou, Yu-Hsuan Li +33D-Aware Video GenerationDynamic Scene Reconstruction

  6. MATE4D: Matrix-Guided Editable 4D Generation from a Single Image

    Oct 8, 2026Xiaotian Chen, Dongfu Yin4D Scene GenerationTemporal Consistency in Video Generation

  7. ChronoWorld: Camera-Controlled Consistent 4D World Generation via Spatiotemporal Cues and Geometric Reflections

    Oct 5, 2026Xiaoyu Zhou, Dingwei Xian, Zhenyu Wang +3Camera-Controlled Video GenerationMulti-View Video Generation

  8. DynaMesh: Dynamic 3D Texture Generation

    Oct 4, 2026Raj Hansini, Guan Chen, Rana Hanocka +13D Texture GenerationText-to-3D Generation

  9. Kepler4D: Controllable Future Video Generation via 4D Scene State Evolution

    Oct 2, 2026Feiran Wang, Bin Duan, Junyi Wu +2Video GenerationControllable Video Generation

  10. UniDynamics: Event-RGB Fusion for Unified Future 4D Dynamic Scene Generation

    Oct 2, 2026Daikun Liu, Xin Zhan, Teng Wang +24D Scene GenerationVideo Prediction

  11. NeuIDO: Neural Intrinsic Dynamics Operator for Physics-Informed 4D World Models

    Sep 21, 2026Jiajing Lin, Xin Zhang, Jianhua SunPhysics-Informed Generative ModelingNeural Operators

  12. VideoTok4D: A 4D-Aware Video Tokenizer for Compact World Representation

    Sep 11, 2026Xinyi Chen, Hanxin Zhu, Xijun Wang +4Video Diffusion ModelsVideo Token Compression

  13. PhysMAS: Physics-Grounded Multi-Agent Synthesis of Compositional 4D Gaussians

    Sep 7, 2026Jiang Qin, Chunji Lv, Yangguang Wei +63D Gaussian SplattingMaterial Point Method

  14. PASTEL: Panoramic Alignment for Monocular 4D Scene Reconstruction

    Sep 5, 2026Yuankun Yang, Yi Wei, Bo Bai +24D Reconstruction4D Scene Generation

  15. Streaming4D: Accelerate 4D World Models via Block-wise Video Generation and Incremental Reconstruction

    Sep 1, 2026Xiaoyan Liu, Jiaxin Liu, Kangrui Li +14D Reconstruction3D Reconstruction

  16. 4DSynth: Controllable Procedural World Synthesis for Dynamic Embodied Simulation

    Aug 27, 2026Zehao Qi, Haochen Luo, Jia-Wang Bian +2Procedural Content Generation4D Scene Generation

  17. GaussianDWM++: Language-Grounded 3D Gaussian Driving World Model for Unified Scene Understanding, Editing, and Multi-Modal Generation

    Aug 17, 2026Tianchen Deng, Xuefeng Chen, Shuang Wu +5World Models for Autonomous Driving4D Scene Generation

  18. Beyond Pixels: From Video Priors to 4D Worlds

    Aug 11, 2026Zihao Liu, Xiaolong Shen, Zhenglin Zhou +2Video Diffusion Models4D Scene Generation

  19. 4DHumanDiff: Direct Text-to-4DGS Generation for Consistent 360-Degree Dynamic Humans

    Jul 30, 2026Renlong Wu, Haoran Chen, Yuxiang Wei +33D Gaussian Splatting3D Avatar Generation

  20. GS-Agent: Creating 4D Physical Worlds With Generative Simulation

    Jul 23, 2026Hongxin Zhang, Chunru Lin, Junyan Li +3Procedural Content Generation4D Scene Generation

  21. Hallo4D: Multi-Modal Hallucination Mitigation for Consistent Spatio-Temporal Generation

    Jul 14, 2026Hongbo Wang, Huaibo Huang, Jie Cao +3Multi-View Consistency3D Scene Generation

  22. RynnWorld-4D: 4D Embodied World Models for Robotic Manipulation

    Jul 7, 2026Haoyu Zhao, Xingyue Zhao, Siteng Huang +3Language-Conditioned Robot ManipulationBimanual Robotic Manipulation

  23. Alignment Is All You Need For X-to-4D Generation

    Jul 2, 2026Qiaowei Miao, Kehan Li, Yawei Luo +1Cross-Modal AlignmentMultimodal Generation

  24. SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation

    Jul 2, 2026Chunjiang Liu, Xiaoyuan Wang, Haoyu Chen +3Multi-Agent LLM Systems3D Scene Generation

  25. Unified Panoramic-Gaussian Representation for Monocular 4D Scene Synthesis

    Jul 2, 2026Yuankun Yang, Yi Wei, Wenyang Zhou +1Camera-Conditioned Video GenerationDynamic Gaussian Splatting

  26. World from Motion: Generative Dynamic Gaussian Reconstruction from Monocular Video

    Jul 1, 2026Liyuan Zhu, Shengyu Huang, Amrita Mazumdar +63D Gaussian Splatting4D Reconstruction

  27. One Video, One World: Turning Monocular Video into Physical 4D Scenes

    Jun 30, 2026Junhao Chen, Boran Zhang, Mingjin Chen +74D Reconstruction3D Reconstruction