T2V Generation

T2V: Text-to-Video

Ask about this topic

Overview

Text-to-video generation studies how to turn language into coherent video, enabling uses such as storytelling, instruction, and creative production. Most systems build on diffusion transformers or flow-matching models, with prompt refinement, inference-time guidance, reference conditioning, and preference-based post-training used to improve control. Evaluation combines visual-quality and prompt-alignment measures such as VBench and T2V-CompBench with targeted tests of physics, temporal events, identity, and spatial relations. Models can produce convincing appearances, but reliable motion, physical interactions, and fine-grained prompt compliance remain difficult, while inference cost and safety add deployment challenges.

Latest papers

CardsList

110 papers14 papers in the last four weeks, up 75% on the four weeks before. 0.1% of all new papers.

  1. From Cheap Fakes to Pure Synthesis: Addressing the New Era of T2V Fake News Videos

    Aug 7, 2026Yifeng Luo, Yupeng Li, Liang Lan +1Fake News DetectionT2V Generation

    Department of Interactive Media Hong Kong Baptist University AI and Social Good Lab, AI Media Centre Hong Kong Baptist University Hong Kong, China · Department of Interactive Media Hong Kong Baptist University AI Media Centre Hong Kong Baptist University Hong Kong, China · Institute of Artificial Intelligence and Future Networks Beijing Normal University Zhuhai, China

  2. EmoWorld: A Decoupled Affective Field for Controllable Emotional Video Generation

    Aug 6, 2026Bingyuan Wang, Baistan Zhyldyzbekov, Kunyu Feng +1Image-to-Video GenerationVideo Diffusion Models

    The Hong Kong University of Science and Technology (Guangzhou) · The Hong Kong University of Science and Technology

  3. Vorch-Streamer: Extending Human Audio-Visual Generation to Real-Time Long-Form Streaming

    Aug 6, 2026Menglin Han, Yang Ding, Yulei Lu +6T2V GenerationLong-Horizon Video Generation

    Vorch Team · Tongji University · Harbin Institute of Technology, Shenzhen +1

  4. CAPE-T2V: Captioner-Anchored Prompt Enhancement toward Two-Sided Conditioning Alignment in Text-to-Video Generation

    Aug 4, 2026Yizhuo Jia, Jingyun Hua, Yuanxing ZhangDiffusion TransformerPrompt Optimization for T2V Generation

    1Fudan University · 2Kling Team

  5. CultureVidBench: Benchmarking Cultural Understanding in Text-to-Video Generation

    Aug 3, 2026Xianjing Han, Yuhan Su, Yang Deng +3T2V GenerationVideo Generation

    Nanyang Technological University · Centrale Supélec · Singapore Management University +1

  6. Diagnosing Under-Development of Irreversible Processes in Video Generation

    Aug 1, 2026Jian Xu, Yanning Wu, Delu Zeng +2Physical Consistency in Video GenerationT2V Generation

  7. Temporal Concentration from Rollout Errors: Implicit Preference Optimization for Text-to-Video Diffusion

    Jul 30, 2026Henglin Liu, Fangyuan Kong, Jing Wang +7Diffusion Model AlignmentVideo Diffusion Models

    Tsinghua University · Kling Team, Kuaishou Technology · Sun Yat-sen University

  8. VideoCoCo: Code-as-CoT for Physically-Consistent Video Generation via an Agentic Dual-Engine System

    Jul 29, 2026Haodong Li, Tianfei Ren, Xiaoxiao Ma +25Physical Consistency in Video GenerationT2V Generation

    1CUHK · 2USTC · 3SCUT +8

  9. TPD: Temporal Prior Decoupling for Text-to-Video Diffusion Models

    Jul 29, 2026Taewon Kang, Matthias ZwickerDiffusion Model GuidanceVideo Diffusion Models

    University of Maryland at College Park, United States

  10. FilmBench: A Film-Grade Benchmark for Cinematic Video Generation

    Jul 27, 2026Shengyi Wang, Niantong Li, Guangzheng Hu +27Video-Reference Video GenerationT2V Generation

    Alibaba Group · Moku Lab, Hujing Digital Media & Entertainment Group · Beijing Film Academy

  11. GroupVideo: Multi-Identity Customized Text-to-Video Generation

    Jul 23, 2026Xinyang Song, Libin Wang, Jianxin Sun +4Video Diffusion ModelsT2V Generation

    School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China · New Laboratory of Pattern Recognition and the State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China

  12. FilmWorld: Agentic Novel-to-Film Generation through Dynamic Cinematic World Modeling

    Jul 21, 2026Jialong Zuo, Haotong Zuo, Shiwei Zhang +5T2V GenerationLong Video Generation

    1Huazhong University of Science and Technology · 2Wan Team, Alibaba Group

  13. Moving Alphabet: A Controlled Study of Training Data for Text-to-Video Generation

    Jul 21, 2026Amber Yijia Zheng, Lu Liu, Raymond A. Yeh +1T2V Generation

    Meta Superintelligence Labs · Purdue University · Work done during an internship at Meta Superintelligence Labs

  14. Keyframe-Anchored Identity Preservation for Sequential-Action Video Generation

    Jul 20, 2026Zhenjie Liu, Binyan Chen, Hao Chen +2Action-Conditioned Video GenerationT2V Generation

    University of Science and Technology of China Hefei, China

  15. Between Safe Boundaries: Exploiting Temporal Consistency for Jailbreaking Text-To-Video Generation Models

    Jul 19, 2026Xingkai Peng, Jun Jiang, Jiayang Liu +2T2V GenerationBlack-Box Adversarial Attacks

    University of Science and Technology of China

  16. When Physical Preferences Meet Semantic Constraints: Physical and Semantic Direct Preference Optimization for Text-to-Video Generation

    Jul 18, 2026Siwei Meng, Yawei Luo, Shu Zhang +1Physical Consistency in Video GenerationDirect Preference Optimization

    Computer Science and Engineering · University of Nevada, Reno · Reno, NV, USA +5

  17. Inference-Time Concept Suppression and Video-Centric Evaluation for Text-to-Video Models

    Jul 15, 2026Wenxuan Chen, Wenjie FengVideo Diffusion ModelsT2V Generation

    University of Science and Technology of China

  18. Text2Sign: A Single-GPU Diffusion Baseline for Text-to-Sign Language Video Generation

    Jul 14, 2026Ruize XiaVideo Diffusion ModelsT2V Generation

    Independent Researcher

  19. Your Data Manifold is Secretly a Reward Model: Shell-LCC for Text-to-Video Generation

    Jun 29, 2026Shihao Zhang, Yunzhi Li, Yuguang Yan +4Reward ModelingDiffusion Model Guidance

    Huawei Central Research Institute · Guangdong University of Technology

  20. A Good Talk Does not Look Like a Summary, It Teaches You! Measuring Takeaways from Paper-to-Video Talks

    Jun 26, 2026Ishani Mondal, Aparna Garimella, Ananya Sai +2T2V GenerationScientific Communication

    University of Maryland, College Park · Adobe Research

  21. DomainShuttle: Freeform Open Domain Subject-driven Text-to-video Generation

    Jun 24, 2026Nan Chen, Yiyang Cai, Rongchang Xie +7T2V GenerationControllable Video Generation

    1Hong Kong University of Science and Technology

  22. DramaDirector: Geometry-Guided Short Drama Generation

    Jun 23, 2026Hengji Zhou, Sijie Liu, Jianrun Chen +3T2V GenerationVideo Generation

    Harbin Institute of Technology, Shenzhen · South China University of Technology · The Hong Kong University of Science and Technology (Guangzhou)

  23. Customizing Video Portraits via Identity-ActionDecoupling

    Jun 21, 2026Junxiong Lin, Haoran Wang, Xinji Mai +4Facial Expression SynthesisT2V Generation

    College of Intelligent Robotics and Advanced Manufacturing, Fudan University · The University of Hong Kong · College of Computer Science and Artificial Intelligence, Fudan University

  24. ChronoLock: Protecting Videos from Unauthorized Text-to-Video Personalization

    Jun 19, 2026Jiaming He, Jiashu Zhang, Guanyu Hou +4Video Diffusion ModelsT2V Generation

    Nanyang Technological University · Jilin University · The University of Manchester

  25. SpecLoR: Spectral Lookahead Rectification for Motion-Coherent Text-to-Video Generation

    Jun 10, 2026Xu Zhang, Yu Lu, Ruijie Quan +3Physical Consistency in Video GenerationT2V Generation

    ReLER, College of Artificial Intelligence, Zhejiang University · Huawei Central Research Institute

  26. Plan-and-Verify Video Reward Reasoning with Spatio-Temporal Scene Graph Grounding

    Jun 10, 2026Hyomin Kim, Junghye Kim, Joanie Hayoun Chung +4Reward ModelingT2V Generation

    Department of Artificial Intelligence, Korea University · Department of Statistics, Korea University

  27. CineDance: Towards Next-Generation Multi-Shot Long-Form Cinematic Audio-Video Generation

    Jun 8, 2026Yuheng Chen, Teng Hu, Yuji Wang +7Audio-Video GenerationT2V Generation

    Shanghai Jiao Tong University, Shanghai, China. · University of Electronic Science and Technology of China, Chengdu, China. · Zhejiang University, Hangzhou, China. +2

  28. Temporally Consistent and Controllable Video Generation of 2D Cine CMR via Latent Space Motion Modeling

    Jun 8, 2026Yiheng Cao, Gustavo Andrade-Miranda, Jiatian Zhang +2Latent Dynamics ModelingT2V Generation

    SyCoIA - IMT Mines Alès · Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, China · SyCoIA, IMT Mines Ales, Ales, France

  29. Activation Steering of Video Generation Models via Reduced-Order Linear Optimal Control

    Jun 3, 2026Jihoon Hong, Alice Chan, Qiyue Dai +2T2V GenerationVideo Generation

    Georgia Institute of Technology Atlanta, GA 30308

  30. Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generation

    Jun 1, 2026Yuheng Chen, Teng Hu, Yuji Wang +3Diffusion Model GuidanceVideo Diffusion Models

    Shanghai Jiao Tong University Shanghai, Shanghai, China · University of Electronic Science and Technology of China Chengdu, Sichuan, China · Zhejiang University Hangzhou, Zhejiang, China