T2V Generation

T2V: Text-to-Video

Ask about this topic

Overview

Text-to-video generation studies how to turn language into coherent video, enabling uses such as storytelling, instruction, and creative production. Most systems build on diffusion transformers or flow-matching models, with prompt refinement, inference-time guidance, reference conditioning, and preference-based post-training used to improve control. Evaluation combines visual-quality and prompt-alignment measures such as VBench and T2V-CompBench with targeted tests of physics, temporal events, identity, and spatial relations. Models can produce convincing appearances, but reliable motion, physical interactions, and fine-grained prompt compliance remain difficult, while inference cost and safety add deployment challenges.

Latest papers

CardsList

110 papers14 papers in the last four weeks, up 75% on the four weeks before. 0.1% of all new papers.

  1. Temporal Specification Guidance for Text-to-Video Generation

    Oct 14, 2026Avishree Khare, Hideki Okamoto, Bardh Hoxha +2T2V GenerationControllable Video Generation

    University of Pennsylvania · Toyota Motor North America (R&D)

  2. VARI: Robust Text-to-Video Generation via Group-Structured Intent Alignment

    Oct 13, 2026Mingxuan Zhu, Hohei Chan, Shiyuan Liu +2T2V GenerationVideo Diffusion Models

    Shanghai Jiao Tong University · KlingAI · South China University of Technology

  3. FlowCred: Hierarchical Credit Assignment and Functional Coordination for Joint Text-to-Video Post-Training

    Oct 13, 2026Mingxuan Zhu, Yanwei Huang, Shiyuan Liu +4T2V GenerationPrompt Optimization for T2V Generation

    Shanghai Jiao Tong University · KlingAI · The Hong Kong University of Science and Technology +2

  4. Hierarchical Curriculum Learning for Surgical Video Generation: Focusing on Bilateral Axillo-Breast Approach Robotic Thyroidectomy Datasets

    Oct 13, 2026Youngbin Kong, Seungho Lee, Jae Kyung Shin +3Video GenerationT2V Generation

    Interdisciplinary Program in Medical Informatics, Seoul National University College of Medicine, Seoul, Republic of Korea · Department of Transdisciplinary Medicine, Seoul National University Hospital, Seoul, Republic of Korea · Department of Surgery, Seoul National University Hospital, Seoul, Republic of Korea +4

  5. EmoTrace-Bench: Diagnosing Emotional Expression in Text-to-Video Generation through Controlled Cues and Intensity

    Oct 11, 2026Yeheng Wang, Liudan Shi, Yi Zheng +5T2V GenerationVideo Generation Evaluation

    Communication University of China, Beijing, China · Kling Team, Beijing, China

  6. TIDE: Trajectory-Informed Skill Distillation for Efficient Text-to-Video Prompt Optimization

    Oct 10, 2026Chengxing Zhou, Yuliang Huang, Jingwei SongPrompt Optimization for T2V GenerationSkill Distillation

    Sun Yat-sen University, China · The University of Hong Kong, China

  7. TextVBench: Evaluating Text Rendering and Preservation in Video Generation

    Oct 9, 2026Ruiqiang Zhang, Hengyi Wang, Chang Liu +3Video Generation EvaluationT2V Generation

    Anhui Province Key Laboratory of Digital Security, University of Science and Technology of China

  8. PreCoG: Preview-Edit for Efficient Video Correction in Generation-Time

    Oct 9, 2026Yilai Liu, Wenqi Pei, Zhifeng Lu +3Efficient Video GenerationT2V Generation

    NICE Lab, The University of Hong Kong · Beijing University of Posts and Telecommunications

  9. Kandinsky 6.0 Video: Foundation Models for Synchronized Video and Audio Generation

    Oct 4, 2026Team Kandinsky, Julia Agafonova, Bulat Akhmatov +85Audio-Video GenerationVideo Diffusion Models

  10. FADE: Frame-Aware Diffusion-Transformer-based Multi-Concept Erasure for Video Unlearning

    Oct 2, 2026Yuchen Li, Kaiyuan Deng, Chaoran Feng +2Diffusion Model UnlearningMachine Unlearning

    Peking University · University of Arizona

  11. VDOT++: Unified Few-Step Video Generation via Unbalanced Optimal Transport Distillation

    Oct 2, 2026Yutong Wang, Xingtong Ge, Enhuai Liu +6Diffusion Model DistillationFew-Step Diffusion Sampling

    University of Sydney · Hong Kong University of Science and Technology · Shanghai AI Laboratory +1

  12. SkillPE: Creativity-Oriented Cinematic Skill Evolution for Text-to-Video Prompt Engineering

    Sep 28, 2026Yanwei Huang, Mingxuan Zhu, Shujie Li +3T2V GenerationVideo Generation

    HKUST · KlingAI · Shanghai Jiaotong University +1

  13. Carnator: Fast Text-to-Video Generation with Generation-Native Compatibility-Guided Cross-Request Reuse

    Sep 26, 2026Xingkun Yin, Xuebin Tang, Mingkun Xu +1Diffusion Model Inference AccelerationT2V Generation

    Department of Electrical and Computer Engineering, University of Hong Kong, Hong Kong SAR, China · Guangdong Institute of Intelligence Science and Technology, Zhuhai, China

  14. TempQ-Jail: Query-Constrained Candidate Ranking for Text-to-Video Jailbreak Attacks

    Sep 25, 2026Tianmeng Fang, Jiancheng Wang, Chen Wang +4Jailbreak AttacksMultimodal Jailbreak Attacks

    School of Computing and Information Systems, Master of IT in Business (MITB), Singapore Management University, Singapore 178903, Singapore · School of Computer Science and Technology, Anhui University, Hefei 230601, China · Department of Electrical and Computer Engineering, University of Miami, Coral Gables, FL 33146, United States +3

  15. NavGen: Visual Generative Models as a Scalable Data Engine for Embodied 3D Navigation

    Sep 25, 2026Xijie Huang, Yongyang Wan, Chengbin Dong +7Synthetic Data Generation for RoboticsSynthetic Data Generation

    Zhejiang University. · Differential Robotics.

  16. WanPE: Towards Cinematic Prompt Enhancement for Modern Text-to-Video Generation

    Sep 24, 2026Yubo Zhu, Yawen Shao, Ziyun Dai +27Prompt Optimization for T2V GenerationT2V Generation

    Nanjing University · Wan Team, Alibaba Group · University of Science and Technology of China +2

  17. MotionSpec: Spectral Trajectory Supervision for Motion-Consistent Video Generation

    Sep 23, 2026Ziqi Ni, Rui Li, Shiqi Jiang +1T2V GenerationTemporal Consistency in Video Generation

    Cardiff University · University of Science and Technology of China · East China Normal University

  18. CompAdapt: Adaptable Composite Motion Modeling for Physics-Consistent Text-to-Video Generation

    Sep 18, 2026Haoran Qin, Renlong Wu, Tianyu Huang +3Physical Consistency in Video GenerationT2V Generation

    Harbin Institute of Technology, China · Taobao, Alibaba Group, China

  19. Better Call CineCrew: Consistent Ultra-Long Narrative-to-Film Generation

    Sep 7, 2026Jiaben Chen, Sixun Dong, Qinhong Zhou +4Identity-Preserving Video GenerationLong Video Generation

    University of Massachusetts Amherst, Amherst, MA 01003, USA · Massachusetts Institute of Technology, Cambridge, MA 02139, USA

  20. DF26: We Cannot Tell Fake From Real Anymore

    Sep 7, 2026Severyn Shykula, Andrii Yermakov, Ivan Samarskyi +3T2V GenerationOOD Generalization

    Ukrainian Catholic University · Faculty of Electrical Engineering, Czech Technical University in Prague · Hover Inc., USA +1

  21. DSAQuant: Denoising-Stage-Aligned Quantization-Aware Training for Video Generation

    Sep 3, 2026Shuaiting Li, Zelin Gao, Haibin Shen +3Diffusion Model GuidanceVideo Diffusion Models

    1Robbyant · 2ZJU · 4HKUST +1

  22. NoisEasier: Test-Time Noise Optimization for Text-to-Video Generation

    Aug 31, 2026Yujiang Pu, Yu KongDiffusion Model GuidanceVideo Diffusion Models

    Michigan State University, East Lansing, MI 48824, USA

  23. On the Resilience of Text-to-Video Diffusion Models to Hardware Faults

    Aug 30, 2026Zachary Coalson, A M Aahad, Stella Doehring +2Video Diffusion ModelsT2V Generation

    Oregon State University, Corvallis, OR, USA.

  24. Identity-Preserving Text-to-Video Generation via Agentic Enhancement and Semantic Repair

    Aug 21, 2026Jiayi Gao, Changcheng Hua, Jiaqi Tang +2Prompt Optimization for T2V GenerationIdentity-Preserving Video Generation

    Wangxuan Institute of Computer Technology, Peking University Beijing, China

  25. The Temporal Moderation Gap: Text-to-Video Safety Filters Are Blind to Harm in Motion

    Aug 19, 2026Yuxin Cao, Fusen Guo, Yuezhong Wu +2Video Content ModerationMultimodal Content Moderation

    University of New South Wales Australia · Fuzhou University China

  26. MLLM-Guided Semantic Correction for Text-to-Video Generation

    Aug 17, 2026Junhao Chen, Zheqi Lv, Keting Yin +6T2V GenerationDiffusion Model Guidance

    School of Software Technology, Zhejiang University, Hangzhou 310027, China · College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China · AI System Innovation Lab, Huawei Cloud Computing Technology Co., Ltd., Hangzhou 310005, China

  27. Beyond Text Conditioning: A Systematic Study of MLLM-DiT Fusion for Video Generation

    Aug 14, 2026Yanbo Ding, Yijia Fan, Caihua Shan +8T2V GenerationVideo Diffusion Models

    Chinese Academy of Sciences · Microsoft Research · Sun Yat-sen University +3

  28. HPSD: Hybrid-Policy Self-Distillation for Text-Image-to-Video Diffusion Models

    Aug 13, 2026Jiazi Bu, Pengyang Ling, Yujie Zhou +10Image-to-Video GenerationVideo Diffusion Models

    Shanghai Jiao Tong University · S-Lab, Nanyang Technological University · Shanghai AI Laboratory +6

  29. Spatially-Grounded Text-to-Video Generation via Inference-Time Gradient-Free Optimization

    Aug 13, 2026Guillaume Jeanneret, Mathis Koroglu, Hugo Caselles-Dupré +2Diffusion TransformerT2V Generation

    ISIR - Sorbonne Université, France · Obvious Research, France · Valeo.ai, France

  30. SparSTAR: Sparse Attention for SpaceTime AutoRegressive Video Synthesis

    Aug 11, 2026Jongbeom Lee, Hyunwoo Yu, Jincheol Yang +2Image-to-Video GenerationSelf-Attention

    Sogang University Seoul, Republic of Korea