Diffusion Model Distillation

Ask about this topic

Momentum

24 papers in the last four weeks, up 300% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 131

All topics
CardsList

  1. Consistent Distribution Matching for Data-Free Diffusion Distillation

    Oct 6, 2026Yuxiang Fu, Qi Yan, Zike Wu +4Diffusion Model DistillationDiffusion Model Inference Acceleration

    University of British Columbia · Vector Institute for AI · Canada CIFAR AI Chair

  2. Two Halves are More than One: Phase-wise Velocity Distillation for Fast and High-Quality Image Generation

    Oct 6, 2026Zhen Guo, Rongyuan Wu, Qiaosi Yi +3Diffusion Model DistillationDiffusion Distillation

    Department of Computing, The Hong Kong Polytechnic University · OPPO Research Institute

  3. DMAD: Distribution Matching as Adversarial Distillation for Fast Visual Generation

    Oct 1, 2026Zhengming Yu, Junkun Yuan, Haotian Yang +8Diffusion Model DistillationFew-Step Diffusion Sampling

    Texas A&M University · Intelligent Creation, ByteDance

  4. Distribution Matching Distillation for Continuous Diffusion Language Models

    Sep 30, 2026Paul Le Van Kiem, Dario Shariatian, Umut Simsekli +1Diffusion Model DistillationDiffusion Language Models

    Inria, PSL Research University · Cohere · CMAP, Ecole Polytechnique

  5. Enhancing Autoregressive Video Generation via Representation Adversarial Distillation

    Sep 30, 2026Fangyu Lin, Xingtong Ge, Lunjie Zhu +8Long-Horizon Video GenerationDiffusion Model Distillation

    The Hong Kong University of Science and Technology · Vivix Group Limited · Zhejiang University

  6. GFD-OPD: Guidance-Folded On-Policy Distillation of Diffusion Models Across Scales

    Sep 30, 2026Zhenxing Zhang, Jiayan Teng, Wenxu Wu +6Diffusion Model GuidanceClassifier-Free Guidance

    Hefei University of Technology · Zhipu AI · Tsinghua University

  7. Diffusable Latents from Structure-Agnostic Distillation

    Sep 30, 2026Adrien Ramanana Rahary, Nicolas Dufour, Patrick Pérez +1Latent Diffusion ModelsDiffusion Model Distillation

    LIGM, ENPC, IP Paris, CNRS, UGE · Kyutai

  8. DMA2^2: Pixel-space Distribution Matching with Adversarial and Anchor Losses

    Sep 29, 2026Xin Lin, Zhifei Zhang, Yuqian Zhou +6Diffusion Model DistillationPixel-Space Diffusion Models

    UC San Diego · Adobe Research · University of Virginia +1

  9. LongLive-Plug: Once-for-All Distillation for Video Generation

    Sep 29, 2026Shuai Yang, Luozhou Wang, Wei Huang +9Video Diffusion ModelsDiffusion Model Distillation

    NVIDIA

  10. Rollout-Marginal Distillation for Long-Horizon Autoregressive Video Generation

    Sep 29, 2026Chenjian Gao, Zhihao Hu, Jianqi Ma +3Autoregressive DiffusionLong-Horizon Video Generation

    MMLab, The Chinese University of Hong Kong · Tencent AIPD

  11. Salt++: Context-Aligned Post-Training for Few-Step Streaming Multimodal Generation

    Sep 29, 2026Xingtong Ge, Yutong Wang, Lunjie Zhu +7Audio-Video GenerationVideo Diffusion Models

    The Hong Kong University of Science and Technology · Vivix Group Limited · The University of Sydney +1

  12. PDMD: Projected Distribution Matching Distillation for Video Diffusion Models

    Sep 28, 2026Zimo Wang, Junkun Yuan, Angtian Wang +9Video Diffusion ModelsDiffusion Model Distillation

    University of California, San Diego · ByteDance Inc.

  13. On-Policy Self-Distillation for Multi-Turn Image Editing

    Sep 28, 2026Liangbing Zhao, Le Zhuo, Mohamed ElhoseinyText-Guided Image EditingDiffusion Model Distillation

    KAUST · Krea AI

  14. d-OPD: Future-Aware On-Policy Distillation for Block Diffusion Language Models

    Sep 28, 2026Ruitao Liu, Qinghao Hu, Song HanDiffusion Model DistillationBlockwise Diffusion Language Models

    Tsinghua University · MIT · NVIDIA

  15. From Static to Dynamic: On-Policy Distillation from Image to Video Diffusion Models

    Sep 28, 2026Bingqing Jiang, Li Luo, Zichao Yu +3Cross-Modal Knowledge DistillationVideo Diffusion Models

    The University of Hong Kong · Cornell University

  16. AnyStep-WAM: Budget-Aligned Distillation and Adaptive Inference for World Action Models

    Sep 27, 2026Rui Wang, Xiangyu Wang, Donglin Yang +4Adaptive InferenceDiffusion Model Distillation

    Southern University of Science and Technology · Shenzhen Loop Area Institute · The University of Hong Kong

  17. Spectral Amplitude Purification in Distribution Matching for Diffusion Distillation

    Sep 24, 2026Zhenyu Zhou, Can Wang, Chun Chen +2Diffusion Model DistillationFew-Step Diffusion Sampling

    Zhejiang University · University of California, Berkeley

  18. ViRDM: Taming Representation Distribution Matching for Few-Step Causal Video Generation

    Sep 24, 2026Zichong Meng, Chongjian Ge, Chun-Hao P. Huang +2Diffusion Model DistillationDistribution Matching

    Northeastern University · Adobe Research

  19. DART: Distillation-Aware Reparameterization for Training-Free LoRA Reuse in Few-Step Video Diffusion Models

    Sep 17, 2026Shihong Li, Juntao Xu, JinCao +3Video Diffusion ModelsDiffusion Model Distillation

    University of Electronic Science and Technology of China · Tsinghua University · Harbin Institute of Technology +1

  20. DIDO: Distilling Interaction-Centric Dynamics into One-Step Denoising for World Action Models

    Sep 14, 2026Jing Lyu, Shuanghao Bai, Runze Xiao +11World Models for RoboticsDiffusion Model Distillation

    Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences · 3Beijing Academy of Artificial Intelligence (BAAI) +3

  21. Temporal Self-Distillation: Faster Inference in Discrete Diffusion Language Models

    Sep 14, 2026Shijian Xu, Andrea Miele, Metod Jazbec +3Diffusion Model DistillationDiffusion Language Model Inference

    University of Basel · University of Amsterdam · Johns Hopkins University

  22. CrossDistill: Balancing Quality and Diversity via Trajectory-Level Hybrid Few-Step Distillation

    Sep 13, 2026Yuxi Liu, Haoyu Li, Yixiang Cai +8Video Diffusion ModelsDiffusion Model Distillation

    Peking University, Melon Group · Alibaba Group · Tsinghua University

  23. Uncertainty DMD: Restoring Diversity in Few-Step Autoregressive Video Distillation

    Sep 11, 2026Zixuan Duan, Xunzhi Xiang, Yabo Chen +6Diffusion Model DistillationFew-Step Diffusion Sampling

    Nanjing University, Institute of Artificial Intelligence, China Telecom (TeleAI), China · Institute of Artificial Intelligence, China Telecom (TeleAI), China · Fudan University, Institute of Artificial Intelligence, China Telecom (TeleAI), China

  24. Decoupled Self-Forcing Distillation for Streaming Talking Head Generation

    Sep 9, 2026Yanru An, Ruiyan Wang, Wenwu Wei +7Audio-Video GenerationDiffusion Model Distillation

    Shanghai Jiao Tong University · Ant Group

  25. Mask Forcing: Improving Autoregressive Video Diffusion Distillation via Dual-Noise Masking Rollout

    Sep 8, 2026Zhuoran Zhao, Shengju Qian, Tongtong Liang +7Video Diffusion ModelsDiffusion Model Distillation

    1HKUST(GZ) · 2HKUST · 3LIGHTSPEED +3

  26. Flow3D-OPD: Multi-Teacher On-Policy Distillation for 3D Geometry Generation with Flow-Matching Diffusion Transformer

    Sep 7, 2026Zhiwei Ning, Zhen Zhou, Puhua Jiang +73D Mesh GenerationDiffusion Model Distillation

  27. Identity-Conditioned Latent Consistency Distillation for Face Synthesis

    Aug 31, 2026Tiago Kienen Chaves, Bernardo Biesseck, David MenottiSynthetic Data AugmentationLatent Diffusion Models

    Department of Informatics, Federal University of Paraná, Curitiba, Brazil · Federal Institute of Mato Grosso (IFMT), Pontes e Lacerda, MT, Brazil

  28. TurboT2VA: Fast Large-Scale Text-to-Video-Audio Generation via Score-Regularized Consistency Distillation

    Aug 25, 2026Xiaoda Yang, Yuxiang Liu, Kaiwen Zheng +12Audio-Video GenerationDiffusion Model Distillation

    Zhejiang University, Hangzhou, China · Tianjin University, Tianjin, China · Tsinghua University, Beijing, China +4

  29. Context-Matched Distillation: Teacher Causality for Autoregressive Video Distillation

    Aug 13, 2026Hmrishav Bandyopadhyay, Xuanchi Ren, Zijian Huang +7Long-Horizon Video GenerationDiffusion Model Distillation

    NVIDIA · SketchX, CVSSP, University of Surrey

  30. HPSD: Hybrid-Policy Self-Distillation for Text-Image-to-Video Diffusion Models

    Aug 13, 2026Jiazi Bu, Pengyang Ling, Yujie Zhou +10Image-to-Video GenerationVideo Diffusion Models

    Shanghai Jiao Tong University · S-Lab, Nanyang Technological University · Shanghai AI Laboratory +6

  31. DUET: A Diversity-Quality Duet of Distillation Experts for Two-Step Video Generation

    Aug 10, 2026Zian Li, Litong Gong, Borui Liao +6Video Diffusion ModelsDiffusion Model Distillation

    Institute for Artificial Intelligence, Peking University, Beijing, China · School of Intelligence Science and Technology, Peking University, Beijing, China · *Work done as an intern at Alibaba Group +3

  32. RL-Native Distillation: Exploiting Scored Trajectories for Few-Step Image Generation

    Aug 10, 2026Yuhan Li, Fangao Zeng, Sicong Kang +7Diffusion Model DistillationFew-Step Diffusion Sampling

    Shanghai Jiao Tong University · Taobao & Tmall group of Alibaba

  33. Distilling Physical Priors into Streaming World Models

    Aug 8, 2026Liangliang Zhao, Junying Wang, Danni Yang +5Physics-Informed Generative ModelingPhysical Consistency in Video Generation

    Fudan University, Shanghai, China · Shanghai AI Laboratory, Shanghai, China

  34. STEP-OPD: Rethinking Output Targets and Internal Dynamics in On-Policy Distillation for Diffusion Models

    Aug 5, 2026Qingyan Wei, Guangzhao Li, Xiaobing Tu +5Diffusion Model DistillationDiffusion-Based Image Generation

    Shanghai Jiao Tong University · Shanghai Innovation Institute · Alibaba Group

  35. Poly-OPD: Heterogeneous Multi-Teacher On-Policy Distillation for Capability-Selectable Flow Models

    Aug 5, 2026Siming Fu, Haojun Xu, Ruizhe He +9Diffusion Model DistillationMulti-Teacher Knowledge Distillation

    1Joy Future Academy · 2Zhejiang University · 3Beihang University

  36. Any-OPD: Heterogeneous On-Policy Distillation for Flow-Matching Models via Representation-Space Bridging

    Aug 4, 2026Siming Fu, Zheming Fu, Ruizhe He +7Flow MatchingDiffusion Model Distillation

    1Joy Future Academy · 2Zhejiang University

  37. OPTD: On-Policy Transition Distillation with Consistency-Guided Adaptive Compression for Few-Step Diffusion Language Models

    Aug 3, 2026Xiaocheng Lu, Hualei Zhang, Shuhan Guo +8Diffusion Model DistillationDiffusion Language Model Decoding

    HKUST · NWPU · PolyU

  38. TurboClear: One-Step Object-Effect Removal via Region-Calibrated Distribution Matching and Fusion

    Aug 2, 2026Jiawei Guo, Junxian Li, Yixin Tang +4Diffusion Model DistillationDiffusion-Based Image Editing

    1Shanghai Jiao Tong University · 2Honor Device Co., Ltd · 3Imperial College London

  39. WAM-Diff2: Hierarchical AR-to-Diffusion Distillation for Highly Efficient Autonomous Driving VLA

    Aug 2, 2026Zhihao Zhu, Hanlin Shang, Mingwang Xu +6End-to-End Autonomous DrivingDiffusion Model Distillation

    Fudan University · Yinwang Inttelligent Technology Co.,Ltd

  40. LeapTalk: Breaking the Latency-Quality Trade-off in Talking Head Generation

    Jul 29, 2026Rongxiang Zhang, Songhua LiuAudio-Video GenerationDiffusion Model Distillation

    School of Artificial Intelligence, Shanghai Jiao Tong University · 2Harbin Institute of Technology

  41. Parallel Decoding Distillation for Fast Image and Video Generation

    Jul 28, 2026Neta Shaul, Chao Liu, Arash Vahdat +1Video Diffusion ModelsDiffusion Model Distillation

    2Weizmann Institute of Science · 1NVIDIA

  42. Rethinking Classifier-Free Guidance in On-Policy Diffusion Distillation

    Jul 27, 2026Bingnan Li, Haozhe Wang, Haozhong Xiong +5Diffusion Model GuidanceClassifier-Free Guidance

    Qwen Business Unit of Alibaba

  43. Generative Video Compression with Adaptive Score Distillation

    Jul 24, 2026Naifu Xue, Zhaoyang Jia, Haosen Li +7Video Diffusion ModelsDiffusion Model Distillation

    Communication University of China, Beijing, China · Microsoft Research Asia · University of Science and Technology of China, Hefei, China +1

  44. Multi-Mask Diffusion Language Models for Few-Step Generation

    Jul 22, 2026Sijin Chen, Yinuo Ren, Heyang Zhao +3Masked Diffusion ModelsDiffusion Model Distillation

    ByteDance Seed · Princeton University · Stanford University +2

  45. ABOPD: Antibody CDR Design via On-Policy Distillation

    Jul 21, 2026Zhuo Yang, Jiaying He, Jiaqing Xie +5Diffusion Model DistillationOn-Policy Distillation

    Shanghai Innovation Institute · Southeast University · Zhejiang University +4

  46. Trace-Based On-Policy Distillation for Masked Diffusion Language Models

    Jul 18, 2026Haolin Ren, Ziyang Huang, Chenhao Yuan +2Masked Diffusion ModelsDiffusion Model Distillation

    Institute of Automation, Chinese Academy of Sciences, Beijing, China · University of Chinese Academy of Sciences, Beijing, China

  47. From Draft to Draft-Free: One-Step Video Object Removal via Privileged Distillation and Fast Planting

    Jul 16, 2026Zizhao Chen, Ping Wei, Guang Dai +2Video Diffusion ModelsDiffusion Model Distillation

    State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University · SGIT AI Lab, State Grid Corporation of China · Baidu +1

  48. IB-Flow: Information Bottleneck-Guided CFG Distillation for Few-Step Text-to-Image Generation

    Jul 10, 2026Yiting Wang, Jingyi Zhang, Wenhu Zhang +4Diffusion Model DistillationFew-Step Diffusion Sampling

    Tsinghua University · Wan Team, Alibaba Group · HKUST +1

  49. OPSD-V: On-Policy Self-Distillation for Post-Training Few-Step Autoregressive Video Generators

    Jul 9, 2026Hongyu Liu, Chun Wang, Feng Gao +6Video Diffusion ModelsAutoregressive Diffusion

    Meituan · HKUST · City University of Hong Kong

  50. Bridging Diffusion Pruning and Step Distillation with Teacher-Aligned Repair

    Jul 7, 2026Jincheng Ying, Li Wenlin, Minghui Xu +1Diffusion Model DistillationFew-Step Diffusion Sampling

    School of Big Data and Artificial Intelligence Guangdong University of Finance and Economics Guangzhou, China · School of Computer Science Shandong University Qingdao, China · GDUFE-UCM Joint Institute Guangdong University of Finance and Economics Guangzhou, China

  51. Dynamic-in-Few-Step: Unifying Dynamic Computation and Few-Step Distillation for Efficient Video Generation

    Jul 7, 2026Yu Cheng, Siyue Yao, Zhongang Qi +3Video Diffusion ModelsDiffusion Model Distillation

    Zhejiang University · BlueImage, vivo · Westlake University

  52. EMPURPLE: A Free Lunch for Diffusion Distillation based on the Information Bottleneck

    Jul 5, 2026Zilai Li, Lujia BaiDistribution ShiftDiffusion Model Distillation

    Independent researcher, University of Nottingham, Nottingham, UK

  53. Reward Lightning: Fast Video Generation via Homologous Preference Distillation

    Jul 4, 2026Jiaxiang Cheng, Bing Ma, Xuhua Ren +4Diffusion Model AlignmentReward Modeling

    Tencent Hunyuan, China

  54. A Decomposable Probe for Few-Step Diffusion Models: Prompt, Latent, and Score Selectivity across Backbone Families and Distillation Paradigms

    Jul 3, 2026Patrick Mu HaojiePrompt SensitivityRectified Flow

    Independent Researcher.

  55. DetailAnywhere: Fashion Detail Generation via Cross-Modal Feature Alignment Distillation

    Jul 2, 2026Zijun Li, Yimin Zhou, Jia Sun +12Diffusion Model DistillationConditional Image Generation

    1Kuaishou Technology · 2AIM for Health Lab, Monash University

  56. Cross-Space Distillation: Teaching One-Step Students with Modern Diffusion Teachers

    Jun 30, 2026Anh Nguyen, Ngan Nguyen, Duc Vu +11Diffusion Model DistillationCross-Architecture Knowledge Distillation

    Qualcomm AI Research† · University of Wisconsin–Madison · Johns Hopkins University +1

  57. SwiftAudio: Data-Efficient Caption-Only Distillation for One-Step Text-to-Audio Diffusion-based Generation

    Jun 30, 2026Binh Mai, Tran Quoc Bao Le, Hung Dinh +1Text-to-Audio GenerationDiffusion Model Distillation

    Posts and Telecommunications Institute of Technology, Hanoi, Vietnam

  58. Diffusion Fine-tuning with Rewarded Moment Matching Distillation

    Jun 29, 2026Alexis Jacq, Guillaume Couairon, Valentin De Bortoli +3Diffusion Model DistillationDiffusion Model Fine-Tuning

    1Google DeepMind

  59. Beyond Trajectory Matching: Reflow with Marginal Distribution Alignment

    Jun 28, 2026Chen Wang, Peiran Yun, Pan Xie +1Diffusion Model DistillationDistribution Matching

    Department of Statistics and Data Science, Tsinghua University · Department of Computer Science and Technology, Tsinghua University · Bytedance Inc

  60. Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Models

    Jun 24, 2026Kaiwen Zheng, Guande He, Min Zhao +7Action-Conditioned Video GenerationAutoregressive Diffusion

    Tsinghua University · UT Austin · NVIDIA