T2V Generation

T2V: Text-to-Video

Ask about this topic

Overview

Text-to-video generation studies how to turn language into coherent video, enabling uses such as storytelling, instruction, and creative production. Most systems build on diffusion transformers or flow-matching models, with prompt refinement, inference-time guidance, reference conditioning, and preference-based post-training used to improve control. Evaluation combines visual-quality and prompt-alignment measures such as VBench and T2V-CompBench with targeted tests of physics, temporal events, identity, and spatial relations. Models can produce convincing appearances, but reliable motion, physical interactions, and fine-grained prompt compliance remain difficult, while inference cost and safety add deployment challenges.

Latest papers

CardsList

116 papers14 papers in the last four weeks, up 17% on the four weeks before. 0.1% of all new papers.

  1. Synthetic Realities: Evaluating Human Ability to Distinguish AIGenerated Videos from Real Footage

    Nov 1, 2026Danyal Sarfraz, Raja Mubashar Karim, KwanMyung KimVideo Generation EvaluationSynthetic Video Detection Benchmarks

    Design Department, Ulsan National Institute of Science & Technology (UNIST), Ulsan, South Korea · School of Art Design & Architecture (SADA), National University of Science & Technology, Islamabad, Pakistan

  2. WeVisCut: The Whole Editing Room in One Agent From Narration to Long-Form Video

    Oct 28, 2026Chenyu Mu, Wenming Weng, Qinrui Wang +8Agentic Video EditingLong Video Generation

    Xidian University · WeChat Vision, Tencent Inc.

  3. MEV: A Multi-Event Video Dataset for Long-Take Generation

    Oct 28, 2026Peiyuan Zhu, Shaoan Xie, Yifan Shen +4T2V GenerationLong-Horizon Video Generation

    Mohamed bin Zayed University of Artificial Intelligence · Carnegie Mellon University

  4. Direct Forcing: Single-Stage Training with Representation-Space Supervision for Few-Step Autoregressive Video Generation

    Oct 22, 2026Haojun Xu, Jie Huang, Chuyang Zhao +6T2V GenerationAutoregressive Video Generation

    Beihang University · JD Future Academy

  5. Code2Video-Compass: A Comprehensive Benchmark for General-Purpose Code-Based Video Generation across T2V, I2V, and V2V

    Oct 20, 2026Zhenghan Chen, Zekai Shao, Xin Lin +2Multimodal Video GenerationVideo Generation Evaluation

    Fudan University · Sun Yat-sen University

  6. ViMoLa: Discrete Motion Tokens for Language-Guided Video Generation

    Oct 18, 2026Bishoy Galoaa, Sarah OstadabbasT2V GenerationControllable Video Generation

    Northeastern University

  7. Temporal Specification Guidance for Text-to-Video Generation

    Oct 14, 2026Avishree Khare, Hideki Okamoto, Bardh Hoxha +2T2V GenerationControllable Video Generation

    University of Pennsylvania · Toyota Motor North America (R&D)

  8. VARI: Robust Text-to-Video Generation via Group-Structured Intent Alignment

    Oct 13, 2026Mingxuan Zhu, Hohei Chan, Shiyuan Liu +2T2V GenerationVideo Diffusion Models

    Shanghai Jiao Tong University · KlingAI · South China University of Technology

  9. FlowCred: Hierarchical Credit Assignment and Functional Coordination for Joint Text-to-Video Post-Training

    Oct 13, 2026Mingxuan Zhu, Yanwei Huang, Shiyuan Liu +4T2V GenerationPrompt Optimization for T2V Generation

    Shanghai Jiao Tong University · KlingAI · The Hong Kong University of Science and Technology +2

  10. Hierarchical Curriculum Learning for Surgical Video Generation: Focusing on Bilateral Axillo-Breast Approach Robotic Thyroidectomy Datasets

    Oct 13, 2026Youngbin Kong, Seungho Lee, Jae Kyung Shin +3Video GenerationT2V Generation

    Interdisciplinary Program in Medical Informatics, Seoul National University College of Medicine, Seoul, Republic of Korea · Department of Transdisciplinary Medicine, Seoul National University Hospital, Seoul, Republic of Korea · Department of Surgery, Seoul National University Hospital, Seoul, Republic of Korea +4

  11. EmoTrace-Bench: Diagnosing Emotional Expression in Text-to-Video Generation through Controlled Cues and Intensity

    Oct 11, 2026Yeheng Wang, Liudan Shi, Yi Zheng +5T2V GenerationVideo Generation Evaluation

    Communication University of China, Beijing, China · Kling Team, Beijing, China

  12. TIDE: Trajectory-Informed Skill Distillation for Efficient Text-to-Video Prompt Optimization

    Oct 10, 2026Chengxing Zhou, Yuliang Huang, Jingwei SongPrompt Optimization for T2V GenerationSkill Distillation

    Sun Yat-sen University, China · The University of Hong Kong, China

  13. TextVBench: Evaluating Text Rendering and Preservation in Video Generation

    Oct 9, 2026Ruiqiang Zhang, Hengyi Wang, Chang Liu +3Video Generation EvaluationT2V Generation

    Anhui Province Key Laboratory of Digital Security, University of Science and Technology of China

  14. PreCoG: Preview-Edit for Efficient Video Correction in Generation-Time

    Oct 9, 2026Yilai Liu, Wenqi Pei, Zhifeng Lu +3Efficient Video GenerationT2V Generation

    NICE Lab, The University of Hong Kong · Beijing University of Posts and Telecommunications

  15. Kandinsky 6.0 Video: Foundation Models for Synchronized Video and Audio Generation

    Oct 4, 2026Team Kandinsky, Julia Agafonova, Bulat Akhmatov +85Audio-Video GenerationVideo Diffusion Models

  16. FADE: Frame-Aware Diffusion-Transformer-based Multi-Concept Erasure for Video Unlearning

    Oct 2, 2026Yuchen Li, Kaiyuan Deng, Chaoran Feng +2Diffusion Model UnlearningMachine Unlearning

    Peking University · University of Arizona

  17. VDOT++: Unified Few-Step Video Generation via Unbalanced Optimal Transport Distillation

    Oct 2, 2026Yutong Wang, Xingtong Ge, Enhuai Liu +6Diffusion Model DistillationFew-Step Diffusion Sampling

    University of Sydney · Hong Kong University of Science and Technology · Shanghai AI Laboratory +1

  18. SkillPE: Creativity-Oriented Cinematic Skill Evolution for Text-to-Video Prompt Engineering

    Sep 28, 2026Yanwei Huang, Mingxuan Zhu, Shujie Li +3T2V GenerationVideo Generation

    HKUST · KlingAI · Shanghai Jiaotong University +1

  19. Carnator: Fast Text-to-Video Generation with Generation-Native Compatibility-Guided Cross-Request Reuse

    Sep 26, 2026Xingkun Yin, Xuebin Tang, Mingkun Xu +1Diffusion Model Inference AccelerationT2V Generation

    Department of Electrical and Computer Engineering, University of Hong Kong, Hong Kong SAR, China · Guangdong Institute of Intelligence Science and Technology, Zhuhai, China

  20. TempQ-Jail: Query-Constrained Candidate Ranking for Text-to-Video Jailbreak Attacks

    Sep 25, 2026Tianmeng Fang, Jiancheng Wang, Chen Wang +4Jailbreak AttacksMultimodal Jailbreak Attacks

    School of Computing and Information Systems, Master of IT in Business (MITB), Singapore Management University, Singapore 178903, Singapore · School of Computer Science and Technology, Anhui University, Hefei 230601, China · Department of Electrical and Computer Engineering, University of Miami, Coral Gables, FL 33146, United States +3

  21. NavGen: Visual Generative Models as a Scalable Data Engine for Embodied 3D Navigation

    Sep 25, 2026Xijie Huang, Yongyang Wan, Chengbin Dong +7Synthetic Data Generation for RoboticsSynthetic Data Generation

    Zhejiang University. · Differential Robotics.

  22. WanPE: Towards Cinematic Prompt Enhancement for Modern Text-to-Video Generation

    Sep 24, 2026Yubo Zhu, Yawen Shao, Ziyun Dai +27Prompt Optimization for T2V GenerationT2V Generation

    Nanjing University · Wan Team, Alibaba Group · University of Science and Technology of China +2

  23. MotionSpec: Spectral Trajectory Supervision for Motion-Consistent Video Generation

    Sep 23, 2026Ziqi Ni, Rui Li, Shiqi Jiang +1T2V GenerationTemporal Consistency in Video Generation

    Cardiff University · University of Science and Technology of China · East China Normal University

  24. CompAdapt: Adaptable Composite Motion Modeling for Physics-Consistent Text-to-Video Generation

    Sep 18, 2026Haoran Qin, Renlong Wu, Tianyu Huang +3Physical Consistency in Video GenerationT2V Generation

    Harbin Institute of Technology, China · Taobao, Alibaba Group, China

  25. Better Call CineCrew: Consistent Ultra-Long Narrative-to-Film Generation

    Sep 7, 2026Jiaben Chen, Sixun Dong, Qinhong Zhou +4Identity-Preserving Video GenerationLong Video Generation

    University of Massachusetts Amherst, Amherst, MA 01003, USA · Massachusetts Institute of Technology, Cambridge, MA 02139, USA

  26. DF26: We Cannot Tell Fake From Real Anymore

    Sep 7, 2026Severyn Shykula, Andrii Yermakov, Ivan Samarskyi +3T2V GenerationOOD Generalization

    Ukrainian Catholic University · Faculty of Electrical Engineering, Czech Technical University in Prague · Hover Inc., USA +1

  27. DSAQuant: Denoising-Stage-Aligned Quantization-Aware Training for Video Generation

    Sep 3, 2026Shuaiting Li, Zelin Gao, Haibin Shen +3Diffusion Model GuidanceVideo Diffusion Models

    1Robbyant · 2ZJU · 4HKUST +1

  28. NoisEasier: Test-Time Noise Optimization for Text-to-Video Generation

    Aug 31, 2026Yujiang Pu, Yu KongDiffusion Model GuidanceVideo Diffusion Models

    Michigan State University, East Lansing, MI 48824, USA

  29. On the Resilience of Text-to-Video Diffusion Models to Hardware Faults

    Aug 30, 2026Zachary Coalson, A M Aahad, Stella Doehring +2Video Diffusion ModelsT2V Generation

    Oregon State University, Corvallis, OR, USA.

  30. Identity-Preserving Text-to-Video Generation via Agentic Enhancement and Semantic Repair

    Aug 21, 2026Jiayi Gao, Changcheng Hua, Jiaqi Tang +2Prompt Optimization for T2V GenerationIdentity-Preserving Video Generation

    Wangxuan Institute of Computer Technology, Peking University Beijing, China