4D Scene Generation

Follow this topic Ask about this topic

Momentum

4 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 33

All topics

ChronoWorld: Camera-Controlled Consistent 4D World Generation via Spatiotemporal Cues and Geometric Reflections
Oct 5, 2026Xiaoyu Zhou, Dingwei Xian, Zhenyu Wang +3Camera-Controlled Video Generation Multi-View Video Generation
Wangxuan Institute of Computer Technology, Peking University · VGI Labs Co., Ltd. · University of California, Merced
DynaMesh: Dynamic 3D Texture Generation
Oct 4, 2026Raj Hansini, Guan Chen, Rana Hanocka +1Text-to-3D Generation Texture Synthesis
University of Chicago
NeuIDO: Neural Intrinsic Dynamics Operator for Physics-Informed 4D World Models
Sep 21, 2026Jiajing Lin, Xin Zhang, Jianhua SunPhysics-Informed Generative Modeling Neural Operators
School of Artificial Intelligence, Shanghai Jiao Tong University, China · School of Informatics, Xiamen University, China
VideoTok4D: A 4D-Aware Video Tokenizer for Compact World Representation
Sep 14, 2026Xinyi Chen, Hanxin Zhu, Xijun Wang +4Video Diffusion Models Video Token Compression
University of Science and Technology of China
PhysMAS: Physics-Grounded Multi-Agent Synthesis of Compositional 4D Gaussians
Sep 7, 2026Jiang Qin, Chunji Lv, Yangguang Wei +63D Gaussian Splatting Material Point Method
Beijing Institute of Technology · Meituan · Sichuan University
Beyond Pixels: From Video Priors to 4D Worlds
Aug 11, 2026Zihao Liu, Xiaolong Shen, Zhenglin Zhou +2Video Diffusion Models 4D Scene Generation
ReLER, CCAI, Zhejiang University
4DHumanDiff: Direct Text-to-4DGS Generation for Consistent 360-Degree Dynamic Humans
Jul 30, 2026Renlong Wu, Haoran Chen, Yuxiang Wei +33D Gaussian Splatting 3D Avatar Generation
School of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001, China
GS-Agent: Creating 4D Physical Worlds With Generative Simulation
Jul 23, 2026Hongxin Zhang, Chunru Lin, Junyan Li +3Procedural Content Generation 4D Scene Generation
University of Massachusetts Amherst · Genesis AI
Hallo4D: Multi-Modal Hallucination Mitigation for Consistent Spatio-Temporal Generation
Jul 14, 2026Hongbo Wang, Huaibo Huang, Jie Cao +3Multi-View Consistency 3D Scene Generation
MAIS&NLPR, Institute of Automation, Chinese Academy of Science, Beijing, 100190, China · University of Chinese Academy of Sciences, Beijing, 101408, China · Shanghaitech University, Shanghai, 201210, China
RynnWorld-4D: 4D Embodied World Models for Robotic Manipulation
Jul 7, 2026Haoyu Zhao, Xingyue Zhao, Siteng Huang +3Language-Conditioned Robot Manipulation Bimanual Robotic Manipulation
DAMO Academy, Alibaba Group · Hong Kong Embodied AI Lab · CUHK +1
Alignment Is All You Need For X-to-4D Generation
Jul 2, 2026Qiaowei Miao, Kehan Li, Yawei Luo +1Cross-Modal Alignment Multimodal Generation
Zhejiang University, Hangzhou 310027, China
SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation
Jul 2, 2026Chunjiang Liu, Xiaoyuan Wang, Haoyu Chen +3Multi-Agent LLM Systems 3D Scene Generation
1Carnegie Mellon University · 2Harvard University · University of California, Merced
Unified Panoramic-Gaussian Representation for Monocular 4D Scene Synthesis
Jul 2, 2026Yuankun Yang, Yi Wei, Wenyang Zhou +1Camera-Conditioned Video Generation 3D Scene Representation
School of Data Science, Fudan University · 2Central Media Technology Institute, Huawei
World from Motion: Generative Dynamic Gaussian Reconstruction from Monocular Video
Jul 1, 2026Liyuan Zhu, Shengyu Huang, Amrita Mazumdar +63D Gaussian Splatting 4D Reconstruction
1Stanford University · 2NVIDIA
World Narrative Model for Highly Controllable Video Generation: A Paradigm Shift from Pixel Sampling to Physical World Orchestration
Jun 30, 2026Ye Chen, Xuanhong Chen, Yupeng Zhu +23Camera-Controlled Video Generation Controllable Video Generation
Shanghai Jiao Tong University
One Video, One World: Turning Monocular Video into Physical 4D Scenes
Jun 30, 2026Junhao Chen, Boran Zhang, Mingjin Chen +74D Reconstruction 3D Reconstruction
Shenzhen International Graduate School, Tsinghua University, China · University of Science and Technology of China, China · The Hong Kong Polytechnic University, China +4
CP4D: Compositional Physics-aware 4D Scene Generation
Jun 8, 2026Hanxin Zhu, Cong Wang, Tianyu He +4Physical Consistency in Video Generation 3D Scene Generation
School of Information Science and Technology, University of Science and Technology of China · Zhongguancun Academy · the State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences. +2
PhysAgent: Automating Physics-Based 4D Synthesis via Trajectory-Grounded Multi-Agent Feedback
Jun 7, 2026Chunji Lv, Jiaxi Ye, Yuchen Jiang +2Multi-Agent System Optimization 3D Scene Generation
Beijing Institute of Technology
Not All Points Are Equal: Uncertainty-Aware 4D LiDAR Scene Synthesis
Jun 1, 2026Xiang Xu, Alan Liang, Youquan Liu +53D Scene Generation Generative Modeling
1NUAA · 2NUS · 3FDU +4
MORPHOS: Autoregressive 4D Generation with Temporal Structured Latents
Jun 1, 2026Minkyung Kwon, Jinhyeok Choi, Youngjin Shin +33D Asset Generation Autoregressive Generation
KAIST AI
PhyGenHOI: Physically-Aware 4D Generation of Dynamic Human-Object Interactions
May 28, 2026Omer Benishu, Gal Fiebelman, Sagie BenaimHOI Generation Human Motion Generation
Hebrew University of Jerusalem
Helix4D: Complex 4D Mesh Generation
May 25, 2026Jiraphon Yenphraphai, Jianqi Chen, Jian Wang +63D Mesh Generation Positional Encoding
1Snap · 2Purdue University · 3KAUST
Full-4D: Generating Full-Scope 4D Scenes from a Single-View Video
May 25, 2026Tingxi Chen, Ke Hao, Yabo Chen +6Camera-Conditioned Video Generation 4D Reconstruction
Shanghai Jiao Tong University · Institute of Artificial Intelligence, China Telecom (TeleAI)
Geometric 4D Stitching for Grounded 4D Generation
May 11, 2026Sunwoo Park, Taesung Kwon, Jong Chul Ye3D Scene Generation 3D Shape Generation
KAIST AI
ST-Gen4D: Embedding 4D Spatiotemporal Cognition into World Model for 4D Generation
May 8, 2026Haonan Wang, Hanyu Zhou, Tao Gu +1World Models 3D Scene Generation
School of Artificial Intelligence and Automation, Huazhong University of Science and Technology · School of Computing, National University of Singapore · School of Computing, Macquarie University
Unified 4D World Action Modeling from Video Priors with Asynchronous Denoising
Apr 29, 2026Jun Guo, Qiwei Li, Peiyan Li +7Action-Conditioned Video Generation Video Diffusion Models
Tsinghua University · Xiaomi Robotics · Peking University +1
OccDirector: Language-Guided Behavior and Interaction Generation in 4D Occupancy Space
Apr 24, 2026Zhuding Liang, Tianyi Yan, Dubing Chen +6Diffusion Transformer Multi-Agent Systems
SKL-IOTSC, CIS, University of Macau, Macau, China · Li Auto Inc, Beijing, China
LivingWorld: Interactive 4D World Generation with Environmental Dynamics
Apr 2, 2026Hyeongju Mun, In-Hwan Jin, Sohyeong Kim +13D Scene Generation Interactive World Models
Department of Electrical and Electronic Engineering, Pusan National University
Phys4D: Fine-Grained Physics-Consistent 4D Modeling from Video Diffusion
Mar 3, 2026Haoran Lu, Shang Wu, Songling Liu +9Physical Consistency in Video Generation Video Diffusion Models
1Northwestern University · 2Dolby Laboratories
Geometry-Aware Single-Image 4D Synthesis via Dense Trajectory Generation
Dec 4, 2025Yanran Zhang, Ziyi Wang, Wenzhao Zheng +3Video Diffusion Models 3D Scene Generation
Department of Automation, Tsinghua University, China · GigaAI
LaGen: Towards Autoregressive LiDAR Scene Generation
Nov 26, 2025Sizhuo Zhou, Xiaosong Jia, Fanrui Zhang +73D Scene Generation Autoregressive Generation
University of Science and Technology of China, Hefei, Anhui 230026, China · Shanghai Innovation Institute, Shanghai 200231, China · Fudan University, Shanghai 200433, China +1
Streaming4D: Accelerate 4D World Models via Block-wise Video Generation and Incremental Reconstruction
Date pendingXiaoyan Liu, Jiaxin Liu, Kangrui Li +14D Reconstruction 3D Reconstruction
The Chinese University of Hong Kong · The Hong Kong Polytechnic University · The University of New South Wales +1
Dream4D: Lifting Camera-Controlled I2V towards Spatiotemporally Consistent 4D Generation
Date pendingXiaoyan Liu, Kangrui Li, Jiaxin Liu +2Camera-Controlled Video Generation Image-to-Video Generation
The Chinese University of Hong Kong · The Hong Kong Polytechnic University · The University of New South Wales +1

Oct 5, 2026, cs.CVJ/K move · Enter open · S save

ChronoWorld: Camera-Controlled Consistent 4D World Generation via Spatiotemporal Cues and Geometric Reflections

Xiaoyu Zhou, Dingwei Xian, Zhenyu Wang, Yajiao Xiong+2

Wangxuan Institute of Computer Technology, Peking University · VGI Labs Co., Ltd. · University of California, Merced

Camera-Controlled Video Generation Multi-View Video Generation Temporal Consistency in Video Generation 4D Scene Generation

Open paper AskPDF arXiv

While existing camera-controllable video generation models can produce visually compelling sequences, preserving intrinsic 4D spatiotemporal coherence remains challenging. To address this limitation, we propose ChronoWorld, an "Observation--State--Reflection" framework that leverages spatiotemporal causal cues and reconstruction priors to generate globally consistent, free-view 4D scenes. Given a context video, we introduce a Spatiotemporal Epipolar Causal Attention mechanism that enforces multi-view epipolar constraints and temporal causality throughout the generation process. In addition, we develop a reconstruction-driven geometric reflection pipeline with a 4D retrieval strategy to enable dynamic self-assessment and correction of generated outputs, improving consistency and accuracy. Extensive experiments show that ChronoWorld achieves state-of-the-art performance in spatiotemporally consistent, cinematic-quality 4D scene generation, with strong generalization and high-fidelity geometry across diverse scenarios.

Momentum

Related topics

Latest papers 33