Diffusion-free Score Matching for Exact Conditional Sampling
Organizations: TU Graz Graz Center for Machine Learning (GraML)
Abstract
The success of modern score-based generative models is largely driven by diffusion-based training, which learns a collection of time-indexed score fields corresponding to progressively noisier versions of the data distribution. While such models achieve impressive sample quality, leveraging them for sound probabilistic inference---particularly sampling from arbitrary conditionals of the model---remains challenging. This difficulty arises because conditioning information is only available for clean data and not for the higher noise levels required to generate exact conditional samples. In this paper, we introduce DIffusion-free SCOre matching (DISCO), a principled approach that sidesteps the need for time-dependent score fields altogether. Our method is based on an objective that, while reminiscent of diffusion-based training, estimates only a single score of the (slightly perturbed) data distribution, for which the exact conditional score is readily obtained. In experiments, DISCO is competitive with state-of-the-art diffusion models in terms of sample quality. More importantly, DISCO yields a more faithful representation of the underlying data distribution and---crucially---enables accurate sampling from arbitrary conditionals, outperforming standard heuristic samplers. This capability opens the door to principled and flexible probabilistic reasoning with score-based models.
Figures & tables
| CIFAR-10 | Wide | Narrow | Super-Resolve 2x | Altern. Lines | Half | Expand | ||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Method | LPIPS | SSIM | LPIPS | SSIM | LPIPS | SSIM | LPIPS | SSIM | LPIPS | SSIM | LPIPS | SSIM |
| Replacement | 0.255 | 0.658 | 0.064 | 0.916 | 0.431 | 0.516 | 0.187 | 0.767 | 0.296 | 0.549 | 0.607 | 0.094 |
| Grad. Guidance | 0.203 | 0.732 | 0.036 | 0.943 | 0.196 | 0.727 | 0.082 | 0.860 | 0.262 | 0.600 | 0.581 | 0.125 |
| DPS | 0.190 | 0.752 | 0.032 | 0.948 | 0.130 | 0.793 | 0.065 | 0.882 | 0.261 | 0.614 | 0.552 | 0.210 |
| RePaint | 0.225 | 0.732 | 0.078 | 0.914 | 0.339 | 0.676 | 0.184 | 0.806 | 0.285 | 0.593 | 0.627 | 0.140 |
| TDS | 0.232 | 0.760 | 0.053 | 0.937 | 0.255 | 0.746 | 0.124 | 0.857 | 0.308 | 0.623 | 0.630 | 0.230 |
| Dataset | EDM | EDM Masked | DISCO |
|---|---|---|---|
| CIFAR-10 | 1.97 | 2.85 | 3.18 |
| FFHQ-64 | 2.39 | 3.18 | 2.54 |
Appendix figures & tables9 assets
Supplementary material from the paper’s appendix.
Appendix
| Batch size | Moons | Checkerboard | Rings |
|---|---|---|---|
| 64 | |||
| 128 | |||
| 256 | |||
| 512 | |||
| Full dataset |
| Batch size | Moons | Checkerboard | Rings |
|---|---|---|---|
| 64 | |||
| 128 | |||
| 256 | |||
| 512 | |||
| Full dataset |
Score-Based Generative Modeling
Score-based generative modeling learns data-distribution gradients to generate samples through reverse diffusion, flows, and related stochastic dynamics.
See all 122 papers