Video Generation

Follow this topic Ask about this topic

Momentum

32 papers in the last four weeks, up 146% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 241

All topics

OmniHumanoid: Streaming Cross-Embodiment Video Generation with Paired-Free Adaptation
May 12, 2026Yiren Song, Xiyao Deng, Pei Yang +2Unsupervised Domain Adaptation Streaming Video Generation
Show Lab, National University of Singapore
PresentAgent-2: Towards Generalist Multimodal Presentation Agents
May 12, 2026Wei Wu, Ziyang Xu, Zeyu Zhang +2Video Generation Multimodal Agents
1Peking University · 2La Trobe University
AllocMV: Optimal Resource Allocation for Music Video Generation via Structured Persistent State
May 11, 2026Huimin Wang, Leilei Ouyang, Chang Xia +3Audio-Video Generation Long-Horizon Video Generation
College of Computer Science, Sichuan University.
TIE: Time Interval Encoding for Video Generation over Events
May 11, 2026Zhilei Shu, Shangwen Zhu, Zihang Liang +10Rotary Positional Embeddings Video Diffusion Models
University of Science and Technology of China · Matrix Team · Shanghai Jiao Tong University +5
Improving Human Image Animation via Semantic Representation Alignment
May 11, 2026Chang Liu, Mengting Chen, Yixuan Huang +5Image-to-Video Generation Video Diffusion Models
School of Artificial Intelligence, Shanghai Jiao Tong University, China · Alibaba Group, China
SocialDirector: Training-Free Social Interaction Control for Multi-Person Video Generation
May 11, 2026Liangyang Ouyang, Ruicong Liu, Caixin Kang +2Video Generation Controllable Video Generation
1The University of Tokyo · 2Shanda AI Research Tokyo
SDTalk: Structured Facial Priors and Dual-Branch Motion Fields for Generalizable Gaussian Talking Head Synthesis
May 11, 2026Peng Jia, Zhen Xiao, Jia Li +33D Gaussian Splatting Talking Head Generation
Hefei University of Technology, Hefei, China · University of Science and Technology of China, Hefei, China
SWIFT: Prompt-Adaptive Memory for Efficient Interactive Long Video Generation
May 10, 2026Shanwen Tan, Hao Li, Jingtao Zhang +4Long Video Generation Memory-Augmented Video Generation
University of Science and Technology of China · Fudan University · Georgia Institute of Technology +1
EduStory: A Unified Framework for Pedagogically-Consistent Multi-Shot STEM Instructional Video Generation
May 10, 2026Xinyi Wu, Jayant Teotia, Shuai Zhao +1Long-Horizon Video Generation Video Generation
1Nanyang Technological University
CollabVR: Collaborative Video Reasoning with Vision-Language and Video Generation Models
May 9, 2026Joowon Kim, Seungho Shin, Joonhyung Park +1Video Generation Video Reasoning
KAIST · Kyung Hee University · AITRICS
Unison: Harmonizing Motion, Speech, and Sound for Human-Centric Audio-Video Generation
May 9, 2026Shihao Cheng, Jiaxu Zhang, Quanyue Song +6Audio-Video Generation Audio-Visual Synchronization
State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan, China · ByteDance, China · State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, China +2
FreeSpec: Training-Free Long Video Generation via Singular-Spectrum Reconstruction
May 7, 2026Fangda Chen, Shanshan Zhao, Longrong Yang +3Video Diffusion Models Long Video Generation
College of Computer Science and Technology, National University of Defense Technology · Alibaba International Digital Commerce · Zhejiang University +1
SwiftI2V: Efficient High-Resolution Image-to-Video Generation via Conditional Segment-wise Generation
May 7, 2026YaoYang Liu, Yuechen Zhang, Wenbo Li +3Image-to-Video Generation Video Generation
HKUST · CUHK · Joy Future Academy +2
FaithfulFaces: Pose-Faithful Facial Identity Preservation for Text-to-Video Generation
May 6, 2026Yuanzhi Wang, Xuhua Ren, Jiaxiang Cheng +7Text-to-Video Generation Identity-Preserving Video Generation
1. Nanyang Technological University · 2. Tencent Hunyuan · 3. University of Science and Technology of China +1
AniMatrix: An Anime Video Generation Model that Thinks in Art, Not Physics
May 5, 2026Tencent HY TeamPhysical Consistency in Video Generation Video Generation
Tencent HY Team
Bridging the Embodiment Gap: Disentangled Cross-Embodiment Video Editing
May 5, 2026Zhiyuan Li, Wenyan Yang, Wenshuai Zhao +4Disentangled Representation Learning Cross-Embodiment Robot Learning
Department of Electrical Engineering and Automation, Aalto University, Finland · Department of Computer Science, Aalto University, Finland · Hong Kong University of Science and Technology, China +1
Video Generation with Predictive Latents
May 4, 2026Yian Zhao, Feng Wang, Qiushan Guo +4Variational Autoencoders Predictive Coding
ByteDance Seed · Tsinghua University · Peking University
AsymTalker: Identity-Consistent Long-Term Talking Head Generation via Asymmetric Distillation
May 1, 2026Yuxin Lu, Jiayang Sun, Guibo Zhu +1Video Diffusion Models Long Video Generation
Soochow University · Institute of Automation, Chinese Academy of Sciences
PhyCo: Learning Controllable Physical Priors for Generative Motion
Apr 30, 2026Sriram Narayanan, Ziyu Jiang, Srinivasa Narasimhan +1Physics-Informed Generative Modeling Physical Consistency in Video Generation
1Carnegie Mellon University · 2NEC Labs America · 3UC San Diego
Generate Your Talking Avatar from Video Reference
Apr 30, 2026Zujin Guo, Zhenhui Ye, Yi Ren +4Video-Reference Video Generation Audio-Video Generation
Nanyang Technological University · HeyGen Research · University of Melbourne
DepthPilot: From Controllability to Interpretability in Colonoscopy Video Generation
Apr 29, 2026Junhu Fu, Ke Chen, Weidong Guo +9Endoscopy Physical Consistency in Video Generation
College of Biomedical Engineering, Fudan University, Shanghai 200433, China · Key Laboratory of Medical Imaging Computing and Computer Assisted Intervention of Shanghai, Shanghai 200032, China · Department of Endoscopy, Fudan University Shanghai Cancer Center, Shanghai 200032, China +4
A Systematic Post-Train Framework for Video Generation
Apr 28, 2026Zeyue Xue, Siming Fu, Jie Huang +9Diffusion Model Alignment Video Diffusion Models
The University of Hong Kong · JD Explore Academy · Tsinghua University +2
DATAREEL: Automated Data-Driven Video Story Generation with Animations
Apr 28, 2026Ridwan Mahbub, Syem Aziz, Mahir Ahmed +4Data Visualization Video Generation
York University · Bangladesh University of Business and Technology · RBC, Canada +2
Alice v1: Distillation-Enhanced Video Generation Surpassing Closed-Source Models
Apr 27, 2026Wang Xiaoyu, Phong Nguyen, Chen ZhaoVideo Diffusion Models Diffusion Model Distillation
Mirage Team Open Source Research
MuSS: A Large-Scale Dataset and Cinematic Narrative Benchmark for Multi-Shot Subject-to-Video Generation
Apr 26, 2026Haojie Zhang, Di Wu, Bingyan Liu +5Video Generation Multi-Shot Video Generation
South China University of Technology · Guangzhou, China · Fudan University +3
PhysLayer: Language-Guided Layered Animation with Depth-Aware Physics
Apr 26, 2026Tianyidan Xie, Zhentao Huang, Mingjie Wang +4Physical Consistency in Video Generation Image-to-Video Generation
Nanjing University · University of Guelph · Zhejiang Sci-Tech University +1
EAD-Net: Emotion-Aware Talking Head Generation with Spatial Refinement and Temporal Coherence
Apr 25, 2026Yahui Li, Yinfeng Yu, Liejun Wang +1Video Diffusion Models Audio-Visual Synchronization
School of Computer Science and Technology, Xinjiang University Urumqi, China
KD-CVG: A Knowledge-Driven Approach for Creative Video Generation
Apr 23, 2026Linkai Liu, Wei Feng, Xi Zhao +9Multimodal RAG Text-to-Video Generation
† Sun Yat-sen University · ⋆ JD.COM
Building a Precise Video Language with Human-AI Oversight
Apr 22, 2026Zhiqiu Lin, Chancharik Mitra, Siyuan Cen +13Human-in-the-Loop Annotation Video Captioning
1Carnegie Mellon University · 2Harvard University
ReImagine: Rethinking Controllable High-Quality Human Video Generation via Image-First Synthesis
Apr 21, 2026Zhengwentai Sun, Keru Zheng, Chenghong Li +7Camera-Controlled Video Generation Video Generation
School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen · Future Network of Intelligence Institute, CUHK-Shenzhen, China

May 12, 2026, cs.CVJ/K move · Enter open · S save

OmniHumanoid: Streaming Cross-Embodiment Video Generation with Paired-Free Adaptation

Yiren Song, Xiyao Deng, Pei Yang, Yihan Wang+1

Show Lab, National University of Singapore

Unsupervised Domain Adaptation Streaming Video Generation Synthetic Data Generation for Robotics Video Generation Cross-Embodiment Transfer Humanoid Robotics

Open paper AskPDF arXiv

Cross-embodiment video generation aims to transfer motions across different humanoid embodiments, such as human-to-robot and robot-to-robot, enabling scalable data generation for embodied intelligence. A major challenge in this setting is that motion dynamics are partly transferable across embodiments, whereas appearance and morphology remain embodiment-specific. Existing approaches often entangle these factors, and many require paired data for every target embodiment, which limits scalability to new robots. We present OmniHumanoid, a framework that factorizes transferable motion learning and embodiment-specific adaptation. Our method learns a shared motion transfer model from motion-aligned paired videos spanning multiple embodiments, while adapting to a new embodiment using only unpaired videos through lightweight embodiment-specific adapters. To reduce interference between motion transfer and embodiment adaptation, we further introduce a branch-isolated attention design that separates motion conditioning from embodiment-specific modulation. In addition, we construct a synthetic cross-embodiment dataset with motion-aligned paired videos rendered across diverse humanoid assets, scenes, and viewpoints. Experiments on both synthetic and real-world benchmarks show that OmniHumanoid achieves strong motion fidelity and embodiment consistency, while enabling scalable adaptation to unseen humanoid embodiments without retraining the shared motion model.

Momentum

Related topics

Latest papers 241