Multi-View Video Generation

Overview

Multi-view video generation studies how to create videos that remain coherent across camera viewpoints and over time, enabling novel-view rendering, 3D reconstruction, and interactive simulation. Common approaches extend diffusion or autoregressive video models with camera and pose controls, cross-view attention, shared spatial representations, or geometric cues such as depth, point clouds, and 3D memory. Work spans dynamic human scenes, robot manipulation, and driving world models, with benchmarks including DNA-Rendering, ActorsHQ, Ego-Exo4D, and nuScenes. A central challenge is balancing visual realism and controllability with geometric consistency across large viewpoint changes and long sequences, especially when training data provides only sparse views.

Latest papers

CardsList

61 papers8 papers in the last four weeks, down 27% on the four weeks before. 0.1% of all new papers.

  1. Beyond Vehicle-Centric Data: Scaling Autonomous Driving through Roadside-to-Vehicle Generation

    Nov 15, 2026Yichen Zhang, Zihan Wang, Hao Chen +6Synthetic Data GenerationAutonomous Driving Datasets

  2. AI-Based Multi-View Echocardiographic Image Synthesis using Dynamic Shape Control

    Nov 13, 2026João Freitas, Anca Balinisteanu, Ahmed Youssef +3Medical Image SynthesisSynthetic Data Augmentation

  3. CoCode-World: Shared 3D Proxy Representation for Multi-Player World Models

    Nov 11, 2026Qirui Li, Xin Zhang, Yabo Chen +7Video World ModelsMulti-View Video Generation

  4. PrimeSim: A Generalist World Model Simulator from Large-Scale Cross-Embodiment Demonstrations

    Nov 3, 2026Travis Davies, Wentao Ma, Lihao Guo +10World Models for RoboticsAction-Conditioned World Models

  5. SyncVid: World-Equivariant Diffusion for Synchronized Video Generation

    Oct 22, 2026Farhad G. Zanjani, Animesh Karnewar, Fatih Porikli +1Multi-View Video GenerationVideo Diffusion Models

  6. Learning the 4D World through Point Trajectory Forecasting

    Oct 20, 2026Byungwoo Jeon, Sunghwan Hong, Dohyeon Kim +103D Scene PredictionMulti-View Video Generation

  7. OverSeer: Multi-Agent World Models Beyond What Agents See

    Oct 20, 2026Runjia Li, Kam Woh Ng, Minghao Chen +6Video World ModelsMulti-View Consistency

  8. Video Diffusion Avatars: Taming Video Diffusion Models into Controllable 3D Avatars

    Oct 16, 2026Simon Giebenhain, Tobias Kirschstein, Liam Schoneveld +33D Avatar GenerationHuman Avatar Animation

  9. Momentum: Persistent Dynamics for Video World Models

    Oct 16, 2026Nedko Savov, Stefan Maria Ailuro, Danda Pani Paudel +3Video World ModelsMemory-Augmented Video Generation

  10. 4LC: 4D Latent Cache for Efficient Conditioning in Dynamic World Modeling

    Oct 13, 2026Jianhui Zhang, Zuyao Lin, Pengxin Xu +2Video World ModelsMemory-Augmented Video Generation

  11. Multics: Generative Multi-Player World Model with Hierarchical Communication

    Oct 12, 2026Kaiyi Huang, Wangbo Yu, Yukun Huang +6Interactive World ModelsWorld Models

  12. ChronoWorld: Camera-Controlled Consistent 4D World Generation via Spatiotemporal Cues and Geometric Reflections

    Oct 5, 2026Xiaoyu Zhou, Dingwei Xian, Zhenyu Wang +3Camera-Controlled Video GenerationMulti-View Video Generation

  13. SymRegFlow: Symmetry-Regularized Flow Matching for Video World Models

    Oct 2, 2026Xi Ye, Yuzhu Wang, Xiaoyang Liu +6Multi-View Video GenerationVideo Generation

  14. Ego-Forge: Text and Geometric-Attention Free Exo-to-Egocentric Video Generation

    Sep 28, 2026Mohammad Mahdi, Luc Van Gool, Danda Pani PaudelCamera-Conditioned Video GenerationVideo Diffusion Models

  15. ConsistWorld: Evidence Routing for Consistent Multi-Agent World Models

    Sep 18, 2026Qianxun Xu, Xianfang Zeng, Xinyao Liao +3Multi-View ConsistencyMulti-View Video Generation

  16. Building Pretraining Data for World Models: An Unreal Engine-Based Pipeline for Action-Conditioned Video Generation

    Sep 3, 2026Haoyu Wang, Songchun Zhang, Haoran Li +3Action-Conditioned Video GenerationMulti-View Video Generation

  17. 4DAnyone: Create Anyone in 4D from a Casual Monocular Video

    Aug 20, 2026Yudong Jin, Tao Xie, Qihang Zhang +6Video Diffusion ModelsMulti-View Video Generation

  18. CrossScope: A Role-Asymmetric World Model for Joint Dual-Scope Surgical Video Prediction

    Aug 4, 2026Wanhao Liu, Jinsong Lin, Rulin Zhou +11Multi-View Video GenerationMulti-View Learning

  19. HarmoHOI: Harmonizing Appearance and 3D Motion for Multi-view Hand-Object Interaction Synthesis

    Jul 19, 2026Lingwei Dang, Juntong Li, Zonghan Li +5Multi-View ConsistencyMulti-View Video Generation

  20. M4^\text{4}World: A Multi-view Multimodal Driving World Model for Interactive Object Manipulation and Minute-long Streaming

    Jul 15, 2026Ke Cheng, Hanqiao Ye, Lei Shi +8Multi-View Video GenerationLong-Horizon Video Generation

  21. MV-Forcing: Long Multi-View Video Generation via 4D-Grounded Spatio-Temporal Self-Forcing

    Jul 6, 2026Gal Fiebelman, Hadar Averbuch-Elor, Sagie BenaimMulti-View ConsistencyVideo Diffusion Models

  22. OmniDrive: An LLM-Choreographed Multi-Agent World Model with Unified Latent Co-Compression for Multi-View Driving Video Generation

    Jun 16, 2026Zijie Meng, Yufei Liu, Chengqian Ma +8Multi-View ConsistencyMulti-View Video Generation

  23. Flex4DHuman: Flexible Multi-view Video Diffusion for 4D Human Reconstruction

    Jun 11, 2026Jen-Hao Cheng, Yipeng Wang, Hao Zhang +2Camera-Conditioned Video Generation4D Reconstruction