cs.CVNov 4, 2026

VA-TDM: A Unified View for Improving Few-Step Diffusion Models by Velocity Adversarial Distillation

Authors: Yihong Luo, Tianyu Pang, Tianyang Hu

Organizations: Hong Kong University of Science and Technology · The Chinese University of Hong Kong, Shenzhen

Abstract

Few-step distillation offers efficient generation with diffusion and flow models, but preserving quality with only a few sampling steps remains challenging. Distribution-matching methods via score distillation provide a strong foundation, yet they rely on accurately tracking the student's changing distribution. At intermediate generation steps in few-step sampling, student-score estimation can be difficult, and commonly used estimators may describe a different distribution from the one used to update the student. Flow matching allows a more flexible approach to supervision through velocity fields constructed from the student's sampling process. Building on this perspective, we introduce Velocity Adversarial Distillation (VAD), which uses a learned critic to compare student and teacher fields and turn their disagreement into feedback for learning. VAD unifies score distillation, Fisher-based matching, and moment matching, also explaining existing heuristic MMD updates and delivering new training objectives. We further develop VA-TDM, which follows trajectory distribution matching: providing supervision for partial denoising along the student trajectory. Beyond this, VA-TDM combines transition-aware online velocity learning and dual-form VAD supervision across intermediate student transitions. Extensive results show that VA-TDM is powerful for learning few-step generators, achieving state-of-the-art four-step performance in both text-to-image and text-to-video generation across various backbones and scaling effectively to 33B MiniMax-H3. In particular, our VA-TDM-H3 notably outperforms the few-step Fast-H3 and is closer to the original many-step H3 according to human preference.

Figures & tables

Appendix figures & tables5 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Simplifying and Improving On-Policy Distillation for Few-Step Diffusion

    Oct 13, 2026Jiawei Zhang, Ziyu Wan, Nanye Ma +5Diffusion Model DistillationDiffusion Distillation

  2. Reinforcing Few-step Generators via Reward-Tilted Distribution Matching

    May 25, 2026Yushi Huang, Xiangxin Zhou, Ruoyu Wang +3Diffusion Model AlignmentDiffusion Model Distillation

  3. VDOT++: Unified Few-Step Video Generation via Unbalanced Optimal Transport Distillation

    Oct 2, 2026Yutong Wang, Xingtong Ge, Enhuai Liu +6Diffusion Model DistillationFew-Step Diffusion Sampling