cs.CVMar 30, 2026

RdmR_\text{dm}: Re-conceptualizing Distribution Matching as a Reward for Diffusion Distillation

Authors: Linqian Fan, Peiqin Sun, Tiancheng Wen, Shun Lu, Chengru Song

Organizations: KlingAI Research · Tsinghua University

Abstract

Diffusion models achieve state-of-the-art generative performance but are fundamentally bottlenecked by their slow, iterative sampling process. While diffusion distillation techniques enable high-fidelity, few-step generation, traditional objectives often restrict the student's performance by anchoring it solely to the teacher. Recent approaches have attempted to break this ceiling by integrating Reinforcement Learning (RL), typically through a simple summation of distillation and RL objectives. In this work, we propose a novel paradigm by re-conceptualizing distribution matching as a reward, denoted as RdmR_\text{dm}. This unified perspective bridges the algorithmic gap between Diffusion Matching Distillation (DMD) and RL, providing several primary benefits. (1) Enhanced Optimization Stability: We introduce Group Normalized Distribution Matching (GNDM), which adapts standard RL group normalization to stabilize RdmR_\text{dm} estimation. By leveraging group-mean statistics, GNDM establishes a more robust and effective optimization direction. (2) Seamless Reward Integration: Our reward-centric formulation inherently supports adaptive weighting mechanisms, allowing for the fluid combination of DMD with external reward models. (3) Improved Sampling Efficiency: By aligning with RL principles, the framework readily incorporates Importance Sampling (IS), leading to a significant boost in sampling efficiency. Extensive experiments demonstrate that GNDM outperforms vanilla DMD, reducing the FID by 1.87. Furthermore, our multi-reward variant, GNDMR, surpasses existing baselines by striking an optimal balance between aesthetic quality and fidelity, achieving a peak HPS of 30.37 and a low FID-SD of 12.21. Ultimately, RdmR_\text{dm} provides a flexible, stable, and efficient framework for real-time, high-fidelity synthesis. Codes are coming soon.

Figures & tables

Appendix figures & tables4 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Distribution Matching Distillation Meets Reinforcement Learning

    Nov 17, 2025Dengyang Jiang, Dongyang Liu, Zanyi Wang +12Diffusion Model AlignmentDiffusion Model Distillation

  2. Guiding Distribution Matching Distillation with Gradient-Based Reinforcement Learning

    Apr 21, 2026Linwei Dong, Ruoyu Guo, Ge Bai +3Diffusion Model DistillationFew-Step Diffusion Sampling

  3. Diffusion Fine-tuning with Rewarded Moment Matching Distillation

    Jun 29, 2026Alexis Jacq, Guillaume Couairon, Valentin De Bortoli +3Diffusion Model DistillationDiffusion Model Fine-Tuning