Multi-View Video Generation

Overview

Multi-view video generation studies how to create videos that remain coherent across camera viewpoints and over time, enabling novel-view rendering, 3D reconstruction, and interactive simulation. Common approaches extend diffusion or autoregressive video models with camera and pose controls, cross-view attention, shared spatial representations, or geometric cues such as depth, point clouds, and 3D memory. Work spans dynamic human scenes, robot manipulation, and driving world models, with benchmarks including DNA-Rendering, ActorsHQ, Ego-Exo4D, and nuScenes. A central challenge is balancing visual realism and controllability with geometric consistency across large viewpoint changes and long sequences, especially when training data provides only sparse views.

Latest papers

CardsList

57 papers13 papers in the last four weeks, up 225% on the four weeks before. 0.1% of all new papers.

  1. SyncVid: World-Equivariant Diffusion for Synchronized Video Generation

    Oct 22, 2026Farhad G. Zanjani, Animesh Karnewar, Fatih Porikli +1Multi-View Video GenerationVideo Diffusion Models

  2. Learning the 4D World through Point Trajectory Forecasting

    Oct 20, 2026Byungwoo Jeon, Sunghwan Hong, Dohyeon Kim +103D Scene PredictionMulti-View Video Generation

  3. OverSeer: Multi-Agent World Models Beyond What Agents See

    Oct 20, 2026Runjia Li, Kam Woh Ng, Minghao Chen +6Video World ModelsMulti-View Consistency

  4. Video Diffusion Avatars: Taming Video Diffusion Models into Controllable 3D Avatars

    Oct 16, 2026Simon Giebenhain, Tobias Kirschstein, Liam Schoneveld +33D Avatar GenerationHuman Avatar Animation

  5. Momentum: Persistent Dynamics for Video World Models

    Oct 16, 2026Nedko Savov, Stefan Maria Ailuro, Danda Pani Paudel +3Video World ModelsMemory-Augmented Video Generation

  6. 4LC: 4D Latent Cache for Efficient Conditioning in Dynamic World Modeling

    Oct 13, 2026Jianhui Zhang, Zuyao Lin, Pengxin Xu +2Video World ModelsMemory-Augmented Video Generation

  7. Multics: Generative Multi-Player World Model with Hierarchical Communication

    Oct 12, 2026Kaiyi Huang, Wangbo Yu, Yukun Huang +6Interactive World ModelsWorld Models

  8. ChronoWorld: Camera-Controlled Consistent 4D World Generation via Spatiotemporal Cues and Geometric Reflections

    Oct 5, 2026Xiaoyu Zhou, Dingwei Xian, Zhenyu Wang +3Camera-Controlled Video GenerationMulti-View Video Generation

  9. SymRegFlow: Symmetry-Regularized Flow Matching for Video World Models

    Oct 2, 2026Xi Ye, Yuzhu Wang, Xiaoyang Liu +6Multi-View Video GenerationVideo Generation

  10. Ego-Forge: Text and Geometric-Attention Free Exo-to-Egocentric Video Generation

    Sep 28, 2026Mohammad Mahdi, Luc Van Gool, Danda Pani PaudelCamera-Conditioned Video GenerationVideo Diffusion Models

  11. ConsistWorld: Evidence Routing for Consistent Multi-Agent World Models

    Sep 18, 2026Qianxun Xu, Xianfang Zeng, Xinyao Liao +3Multi-View ConsistencyMulti-View Video Generation

  12. Building Pretraining Data for World Models: An Unreal Engine-Based Pipeline for Action-Conditioned Video Generation

    Sep 3, 2026Haoyu Wang, Songchun Zhang, Haoran Li +3Action-Conditioned Video GenerationMulti-View Video Generation

  13. 4DAnyone: Create Anyone in 4D from a Casual Monocular Video

    Aug 20, 2026Yudong Jin, Tao Xie, Qihang Zhang +6Video Diffusion ModelsMulti-View Video Generation

  14. CrossScope: A Role-Asymmetric World Model for Joint Dual-Scope Surgical Video Prediction

    Aug 4, 2026Wanhao Liu, Jinsong Lin, Rulin Zhou +11Multi-View Video GenerationMulti-View Learning

  15. HarmoHOI: Harmonizing Appearance and 3D Motion for Multi-view Hand-Object Interaction Synthesis

    Jul 19, 2026Lingwei Dang, Juntong Li, Zonghan Li +5Multi-View ConsistencyMulti-View Video Generation

  16. M4^\text{4}World: A Multi-view Multimodal Driving World Model for Interactive Object Manipulation and Minute-long Streaming

    Jul 15, 2026Ke Cheng, Hanqiao Ye, Lei Shi +8Multi-View Video GenerationLong-Horizon Video Generation

  17. MV-Forcing: Long Multi-View Video Generation via 4D-Grounded Spatio-Temporal Self-Forcing

    Jul 6, 2026Gal Fiebelman, Hadar Averbuch-Elor, Sagie BenaimMulti-View ConsistencyVideo Diffusion Models

  18. OmniDrive: An LLM-Choreographed Multi-Agent World Model with Unified Latent Co-Compression for Multi-View Driving Video Generation

    Jun 16, 2026Zijie Meng, Yufei Liu, Chengqian Ma +8Multi-View ConsistencyMulti-View Video Generation

  19. Flex4DHuman: Flexible Multi-view Video Diffusion for 4D Human Reconstruction

    Jun 11, 2026Jen-Hao Cheng, Yipeng Wang, Hao Zhang +2Camera-Conditioned Video Generation4D Reconstruction

  20. Full-4D: Generating Full-Scope 4D Scenes from a Single-View Video

    May 25, 2026Tingxi Chen, Ke Hao, Yabo Chen +6Camera-Conditioned Video Generation4D Reconstruction

  21. Probing into Camera Control of Video Models

    May 14, 2026Chen Hou, Christian RupprechtDiffusion Model GuidanceCamera-Controlled Video Generation