Video-Reference Video Generation

Overview

The field studies how to create or edit videos while using reference clips to carry over people, objects, actions, styles, or scene information. Common approaches condition diffusion-transformer generators on reference frames or video tokens, using attention, lightweight adapters, visual anchors, or explicit motion and geometry controls; some separate motion generation from identity transfer or refine selected keyframes. These methods support applications such as personalized avatars, character replacement, video restyling, and reference-guided scene editing, evaluated for reference fidelity, instruction following, visual quality, and temporal consistency. A central challenge is preserving fine details while allowing requested changes, especially with similar-looking subjects, viewpoint shifts, complex motion, and long sequences.

Latest papers

CardsList

29 papers6 papers in the last four weeks, up 100% on the four weeks before. 0.0% of all new papers.

  1. FreeCHROMA: Generative Chroma Keying from Unaligned Background References

    Oct 10, 2026Jiayi Wu, Tianfu Wang, Rui Zhao +6Video Diffusion ModelsVideo-Reference Video Generation

  2. Towards Unified Evaluation of Prompt Enhancers for Video Generation

    Oct 8, 2026Yawen Shao, Yubo Zhu, Ziyun Dai +21Video Generation EvaluationVideo-Reference Video Generation

  3. SemCam: Semantic Camera Motion Control for Video Generation

    Oct 4, 2026Janna Bruner, Omer Talmi, Ianir Ideses +3Video-Reference Video GenerationCamera-Controlled Video Generation

  4. Memory-Guided B-Roll Generation from User Video Collections

    Oct 1, 2026Cusuh Ham, Fabian Caba Heilbron, Josef Sivic +1Video-Reference Video GenerationMemory-Augmented Video Generation

  5. OmniVBench: A Benchmark and Large-Scale Dataset for Omni Reference-to-Video Generation

    Sep 18, 2026Wenxue Li, Peiyan Guan, Haoyang Jiang +14Video-Reference Video GenerationVideo Generation

  6. PAI-Actor: Cinematic Multi-Character Replacement in Dynamic Scenes

    Sep 5, 2026Bangxun Tang, Heyuan Gao, Yiren Song +4Human Motion GenerationVideo Diffusion Models

  7. KeyID: Decoupled Drafting and Keyframe Editing for Identity-Preserving Video Generation

    Aug 17, 2026Jianjie Luo, Yiming Zhong, Haoming Shen +2Identity-Preserving Video GenerationVideo-Reference Video Generation

  8. FilmBench: A Film-Grade Benchmark for Cinematic Video Generation

    Jul 27, 2026Shengyi Wang, Niantong Li, Guangzheng Hu +27Video-Reference Video GenerationT2V Generation

  9. VIPER: Visual In-Context Physics Reasoning for Physically Plausible Video Generation

    Jul 26, 2026Tianxiao Chen, Hanmo Chen, Huajin Chen +3Video-Reference Video GenerationPhysical Consistency in Video Generation

  10. ID-V2V: Identity-Preserving Video Restylization

    Jul 24, 2026Yuancheng Xu, Mingming He, Pablo Salamanca +5Video-Reference Video GenerationIdentity-Preserving Video Generation

  11. SpheRoPE: Zero-Shot Optimization-Free 360 Panorama Generation with Spherical RoPE

    Jun 30, 2026Or Hirschorn, Aaron Olender, Eli Alshan +3Video-Reference Video GenerationRotary Positional Embeddings

  12. DataMagic: Transforming Tabular Data into Data Insight Video

    Jun 18, 2026Yupeng Xie, Chen Ma, Zhenyang Wang +6Video-Reference Video GenerationData Visualization

  13. A Comprehensive Ecosystem for Open-Domain Customized Video Generation

    Jun 10, 2026Jingxu Zhang, Yuqian Hong, Daneul Kim +6Video-Reference Video GenerationIdentity-Preserving Video Generation

  14. Pantheon360: Taming Digital Twin Generation via 3D-Aware 360° Video Diffusion

    May 25, 2026Ting-Hsuan Chen, Ying-Huan Chen, Tao Tu +10Video-Reference Video GenerationCamera-Controlled Video Generation

  15. Soap2Soap: Long Cinematic Video Remaking via Multi-Agent Collaboration

    May 17, 2026Yiren Song, Huilin Zhong, Kevin Qinghong Lin +2Temporal Consistency in Video GenerationMulti-Shot Video Generation

  16. Generate Your Talking Avatar from Video Reference

    Apr 30, 2026Zujin Guo, Zhenhui Ye, Yi Ren +4Video-Reference Video GenerationAudio-Video Generation

  17. Gloria: Consistent Character Video Generation via Content Anchors

    Mar 31, 2026Yuhang Yang, Fan Zhang, Huaijin Pi +5Video GenerationIdentity-Preserving Video Generation

  18. AnyID: Ultra-Fidelity Universal Identity-Preserving Video Generation from Any Visual References

    Mar 26, 2026Jiahao Wang, Hualian Sheng, Sijia Cai +5Identity-Preserving Video GenerationControllable Video Generation

  19. GaussFusion: Improving 3D Reconstruction in the Wild with A Geometry-Informed Video Generator

    Mar 26, 2026Liyuan Zhu, Manjunath Narayana, Michal Stary +33D Gaussian SplattingNovel View Synthesis

  20. HECTOR: Hybrid Editable Compositional Object References for Video Generation

    Mar 9, 2026Guofeng Zhang, Angtian Wang, Jacob Zhiyuan Fang +4Trajectory-Guided Video GenerationCompositional Video Generation

  21. EffectMaker: Unifying Reasoning and Generation for Customized Visual Effect Creation

    Mar 6, 2026Shiyuan Yang, Ruihuang Li, Jiale Tao +3Controllable Video GenerationVideo-Reference Video Generation