Distribution Matching Distillation

Also known as DMD

Overview

Distribution Matching Distillation transfers the behavior of a slow diffusion or flow-model teacher to a student that generates images, video, or other data in only a few steps. Many methods use teacher and student score estimates to form distribution-matching gradients, while alternatives learn density ratios adversarially or use consistency and flow-map objectives. Recent approaches also combine matching with diversity-preserving constraints, preference rewards, or temporal guidance for autoregressive video. The central tension is to gain speed without sacrificing sample quality, diversity, or long-range dynamics, especially when critic errors or limited student capacity distort training.

Latest papers

CardsList

34 papers7 papers in the last four weeks, down 30% on the four weeks before. 0.1% of all new papers.

  1. Few-Step Streaming Video Generation via Condition Shifting

    Nov 10, 2026Deyuan Liu, Jungang Li, Kaiwen Zheng +8Streaming Video GenerationDistribution Matching Distillation

  2. Disagreement-Aware Distribution Matching Distillation for Few-Step Diffusion Models

    Nov 9, 2026Zikai Zhou, Zhengpeng Xie, Shitong Shao +4Diffusion Model DistillationDistribution Matching Distillation

  3. Route-DMD: Distribution Matching Distillation with Task-Routed Mechanism for Speech Foundation Models

    Nov 5, 2026Yanru Huo, Zhikang Niu, Wenming Tu +7Speech Foundation ModelsDistribution Matching Distillation

  4. Intrinsic Distribution Matching

    Oct 29, 2026Deyuan Liu, Yansen Han, Kaiwen Zheng +7moment matchingT2I Generation

  5. Multi-Bandwidth Distribution Matching Distillation: On the Equivalence of Distribution Matching Distillation and Drifting Models

    Oct 7, 2026Jialin Zhu, Xing Liu, Feixiang He +1Distribution Matching DistillationDiffusion Model Distillation

  6. Consistent Distribution Matching for Data-Free Diffusion Distillation

    Oct 6, 2026Yuxiang Fu, Qi Yan, Zike Wu +4Diffusion Model DistillationDiffusion Model Inference Acceleration

  7. DuoMatching: Joint-Marginal Distribution Matching for Few-Step Video Generation

    Oct 2, 2026Jiahao Zhan, Yan Wang, Yongrui Ma +5Single-Step Video GenerationStreaming Video Generation

  8. DMAD: Distribution Matching as Adversarial Distillation for Fast Visual Generation

    Oct 1, 2026Zhengming Yu, Junkun Yuan, Haotian Yang +8Diffusion Model DistillationFew-Step Diffusion Sampling

  9. Distribution Matching Distillation for Continuous Diffusion Language Models

    Sep 30, 2026Paul Le Van Kiem, Dario Shariatian, Umut Simsekli +1Continuous Diffusion Language ModelsDiffusion Language Model Distillation

  10. DMA2^2: Pixel-space Distribution Matching with Adversarial and Anchor Losses

    Sep 29, 2026Xin Lin, Zhifei Zhang, Yuqian Zhou +6Diffusion Model DistillationPixel-Space Diffusion Models

  11. PDMD: Projected Distribution Matching Distillation for Video Diffusion Models

    Sep 28, 2026Zimo Wang, Junkun Yuan, Angtian Wang +9Video Diffusion ModelsDiffusion Model Distillation

  12. Spectral Amplitude Purification in Distribution Matching for Diffusion Distillation

    Sep 24, 2026Zhenyu Zhou, Can Wang, Chun Chen +2Diffusion Model DistillationFew-Step Diffusion Sampling

  13. Uncertainty DMD: Restoring Diversity in Few-Step Autoregressive Video Distillation

    Sep 10, 2026Zixuan Duan, Xunzhi Xiang, Yabo Chen +6Diffusion Model DistillationFew-Step Diffusion Sampling

  14. Joint Alignment and Distillation for Video Generation via Sample-Guided Distribution Matching

    Sep 3, 2026Jiuzhou Lin, Junlong Wu, Fei Zuo +11Video GenerationDiffusion Model Alignment

  15. DistillAlign: Coordinating Mode Covering and Mode Seeking in Autoregressive Video Distillation

    Jul 29, 2026Jiaxing Li, Kai Zou, Cindy Zhou +7Generative ModelingAutoregressive Video Generation

  16. CoDMD: Copula-aware Distribution Matching Distillation for Fast Video Generation

    Jun 20, 2026Wenhu Zhang, Kun Cheng, Changyuan Wang +7Video Diffusion ModelsDiffusion Model Distillation

  17. BiWM: Advancing Open-Source Interactive Video World Models with Bidirectional Autoregression

    Jun 8, 2026Shaohao Rui, Xiaofeng Mao, Zhanyu Zhang +5Action-Conditioned Video GenerationCamera-Controlled Video Generation

  18. Why Are DMD Students Lazy? Understanding the Copying Behavior in Few-Step Distillation

    Jun 1, 2026Shucheng Li, Iolo Jones, Alexander Tong +1Diffusion Model DistillationFew-Step Diffusion Sampling

  19. Reinforcing Few-step Generators via Reward-Tilted Distribution Matching

    May 25, 2026Yushi Huang, Xiangxin Zhou, Ruoyu Wang +3Diffusion Model AlignmentDiffusion Model Distillation

  20. Distribution Matching Distillation without Fake Score Network

    May 19, 2026Youngjoong Kim, Deokyeong Lee, Jaesik ParkDiffusion Model DistillationFew-Step Diffusion Sampling

  21. FlashMol: High-Quality Molecule Generation in as Few as Four Steps

    May 7, 2026Xinyuan Wei, Zian Li, Shaoheng Yan +2Diffusion DistillationFew-Step Diffusion Sampling

  22. Continuous-Time Distribution Matching for Few-Step Diffusion Distillation

    May 7, 2026Tao Liu, Hao Yan, Mengting Chen +8Diffusion DistillationFew-Step Diffusion Sampling

  23. Guiding Distribution Matching Distillation with Gradient-Based Reinforcement Learning

    Apr 21, 2026Linwei Dong, Ruoyu Guo, Ge Bai +3Diffusion Model DistillationFew-Step Diffusion Sampling