Multi-View Video Generation

Overview

Multi-view video generation studies how to create videos that remain coherent across camera viewpoints and over time, enabling novel-view rendering, 3D reconstruction, and interactive simulation. Common approaches extend diffusion or autoregressive video models with camera and pose controls, cross-view attention, shared spatial representations, or geometric cues such as depth, point clouds, and 3D memory. Work spans dynamic human scenes, robot manipulation, and driving world models, with benchmarks including DNA-Rendering, ActorsHQ, Ego-Exo4D, and nuScenes. A central challenge is balancing visual realism and controllability with geometric consistency across large viewpoint changes and long sequences, especially when training data provides only sparse views.

Latest papers

CardsList

57 papers13 papers in the last four weeks, up 225% on the four weeks before. 0.1% of all new papers.

  1. Action Images: End-to-End Policy Learning via Multiview Video Generation

    Apr 7, 2026Haoyu Zhen, Zixian Gao, Qiao Sun +7Action Representation LearningWorld Action Models

  2. SpatialVAM:Spatial-Aware Multi-View Video Diffusion as a Data-Efficient Robot Policy

    Apr 3, 2026Peiyan Li, Yixiang Chen, Yuan Xu +13Multi-Task Robotic ManipulationData-Efficient Robot Learning

  3. Gloria: Consistent Character Video Generation via Content Anchors

    Mar 31, 2026Yuhang Yang, Fan Zhang, Huaijin Pi +5Video GenerationIdentity-Preserving Video Generation

  4. VistaGEN: Consistent Driving Video Generation with Fine-Grained Control Using Multiview Visual-Language Reasoning

    Mar 30, 2026Li-Heng Chen, Ke Cheng, Yahui Liu +3Controllable Video GenerationAutonomous Driving Scenario Generation

  5. VideoWeaver: Multimodal Multi-View Video-to-Video Transfer for Embodied Agents

    Mar 26, 2026George Eskandar, Fengyi Shen, Mohammad Altillawi +4Multi-View Video GenerationVideo Diffusion Models

  6. Toward Physically Consistent Driving Video World Models under Challenging Trajectories

    Mar 25, 2026Jiawei Zhou, Zhenxin Zhu, Lingyi Du +10Trajectory-Guided Video GenerationWorld Models for Autonomous Driving

  7. Beyond Viewpoint Generalization: What Multi-View Demonstrations Offer and How to Synthesize Them for Robot Manipulation?

    Mar 23, 2026Boyang Cai, Qiwei Liang, Jiawei Li +11Multi-View LearningGeneralization in Robotic Manipulation

  8. Identity-Consistent Video Generation under Large Facial-Angle Variations

    Mar 22, 2026Bin Hu, Zipeng Qi, Guoxi Huang +6Identity-Preserving Video GenerationMulti-View Video Generation

  9. OrthoPhys: Physically Plausible Video Generation with Orthogonal-View Geometry Guidance

    Mar 19, 2026Cong Wang, Hanxin Zhu, Xiao Tang +43D-Aware Video GenerationPhysical Consistency in Video Generation

  10. 3DreamBooth: High-Fidelity 3D Subject-Driven Video Generation Model

    Mar 19, 2026Hyun-kyu Ko, Jihyeon Park, Younghyun Kim +23D-Aware Video GenerationControllable Video Generation

  11. Stereo World Model: Camera-Guided Stereo Video Generation

    Mar 18, 2026Yang-Tian Sun, Zehuan Huang, Yifan Niu +4Video World ModelsCamera-Conditioned Video Generation

  12. Tri-Prompting: Video Diffusion with Unified Control over Scene, Subject, and Motion

    Mar 16, 2026Zhenghong Zhou, Xiaohang Zhan, Zhiqin Chen +83D-Aware Video GenerationVideo Generation

  13. Risk-Controllable Multi-View Diffusion for Driving Scenario Generation

    Mar 12, 2026Hongyi Lin, Wenxiu Shi, Heye Huang +5Autonomous Driving Scenario GenerationControllable Video Generation

  14. ShareVerse: Multi-Agent Consistent Video Generation for Shared World Modeling

    Mar 3, 2026Jiayi Zhu, Jianing Zhang, Yiying Yang +2Video World ModelsMulti-View Video Generation

  15. HumanOrbit: 3D Human Reconstruction as 360° Orbit Generation

    Feb 27, 2026Keito Suzuki, Kunyao Chen, Lei Wang +5Multi-View Image Synthesis3D Human Reconstruction

  16. Human Video Generation from a Single Image with 3D Pose and View Control

    Feb 24, 2026Tiantian Wang, Chun-Han Yao, Tao Hu +3Image-to-Video GenerationVideo Generation

  17. RAYNOVA: Scale-Temporal Autoregressive World Modeling in Ray Space

    Feb 24, 2026Yichen Xie, Chensheng Peng, Mazen Abdelfattah +6Multi-View Video GenerationWorld Models

  18. AnyView: Synthesizing Any Novel View in Dynamic Scenes

    Jan 23, 2026Basile Van Hoorick, Dian Chen, Shun Iwase +7Multi-View ConsistencyCamera-Conditioned Video Generation

  19. Do View-Consistent Representations Matter for Camera-Controlled Video Generation?

    Nov 24, 2025Duolikun Danier, Ge Gao, Chengxi Zeng +4Camera-Controlled Video GenerationVideo Diffusion Models

  20. EMMA: Enhancing Robotic Control Robustness through a Generative Visual Model

    Sep 26, 2025Zhehao Dong, Xiaofeng Wang, Zheng Zhu +12Robustness of VLA ModelsSynthetic Data Generation for Robotics

  21. S^2VG: 3D Stereoscopic and Spatial Video Generation via Denoising Frame Matrix

    Aug 11, 2025Peng Dai, Feitong Tan, Qiangeng Xu +6Multi-View Video GenerationImage Inpainting