Diffusion distillation accelerates image and video generation by compressing a pretrained teacher's iterative sampling process into a few network evaluations. Distribution-based methods achieve this by matching the student's output distribution to the teacher's. This matching is often driven by reverse-KL objectives, whose mode-seeking bias favors dominant teacher modes at the expense of diversity across samples. We introduce Posterior Matching Distillation (PMD), a new member of the distribution-based distillation family that combines mode-covering posterior sampling with any-step generation. At zero population loss, PMD recovers the teacher's full posterior of clean images at each trained noise level. Its stochastic student supports any-step sampling budgets within the trained timestep grid without further training. To learn these posteriors, PMD matches exponentially reweighted averages of student samples conditioned on a fixed noisy state to corresponding teacher posterior means. Under Gaussian corruption, exponentially tilted posterior mean is a single teacher evaluation at a shifted input. We prove that, matching tilted means over an open neighborhood uniquely identifies the full posterior. PMD thus supervises the entire conditional distribution through a family of mean constraints, without any auxiliary student-score network. Experiments on SDXL and FLUX.2 [klein] 4B demonstrate that PMD achieves the best FID among 4-step methods on both models, while maintaining competitive or leading performance across prompt-alignment and perceptual-quality metrics.
Figures & tables
Figure 2: Tilt=Shift Identity. (Left) Estimating a tilted posterior mean requires multiple stochastic reverse-diffusion trajectories from the same noisy state, followed by exponential reweighting of the resulting clean samples. (Right) Under Gaussian corruption, the same mean is obtained with a single frozen-teacher evaluation at a shifted noisy input.
Figure 3: Exponential Tilting of the Teacher Posterior. Starting from the original teacher posterior q(x∣zt) , exponential reweighting by exp(λ⊤x) changes the relative prominence of its modes. Under Gaussian corruption, each tilted posterior is equivalent to the posterior at a shifted noisy state, qλ(x∣zt)=q(x∣zt+ρtλ) . Varying λ over an open neighborhood Br emphasizes different modes, producing a family of tilted means that uniquely characterizes the original posterior.
Figure 4: PMD Training Framework. A noisy state zt is obtained through the student’s on-policy sampling process. The frozen teacher is evaluated at the shifted input zt+ρtλ , yielding the tilted posterior mean Tλ=Dt(zt+ρtλ,t) . Conditioned on the same zt , the stochastic student generates multiple clean-image predictions using independent random inputs. These predictions are combined into an exponentially weighted mean, which is compared with the teacher target Tλ . PMD minimizes the resulting posterior-matching discrepancy through the loss LPMD , encouraging the student to recover the teacher’s conditional posterior distribution.
Figure 5: Qualitative Comparison and Any-Step Generation. PMD demonstrates greater conditional diversity than RTDMD [ 22 ] on FLUX.2 [klein] 4B (cat) and DMD2 [ 61 ] on SDXL (woman). The bottom row shows diverse PMD samples generated with both four and two sampling steps using the same model, without retraining.
Table 1: Quantitative Comparison of Image Generation Methods. Performance comparison on SDXL and FLUX.2 [klein] 4B at 1024×1024 resolution. HPSv3, PickScore, CLIP-S, and FID are evaluated using 10K prompts from MS-COCO 2014 [ 29 ] . Best and second-best results among four-step methods are highlighted in bold and underlined, respectively.