RBF-Solver: A Multistep Sampler for Diffusion Probabilistic Models via Radial Basis Functions
Organizations: SteAI · MODULABS · Korea University · SoftAI · SBS · Bogonet
Abstract
Diffusion probabilistic models (DPMs) are widely adopted for their outstanding generative fidelity, yet their sampling is computationally demanding. Polynomial-based multistep samplers mitigate this cost by accelerating inference; however, despite their theoretical accuracy guarantees, they generate the sampling trajectory according to a predefined scheme, providing no flexibility for further optimization. To address this limitation, we propose RBF-Solver, a multistep diffusion sampler that interpolates model evaluations with Gaussian radial basis functions (RBFs). By leveraging learnable shape parameters in Gaussian RBFs, RBF-Solver explicitly follows optimal sampling trajectories. At first order, it reduces to the Euler method (DDIM). At second order or higher, as the shape parameters approach infinity, RBF-Solver converges to the Adams method, ensuring its compatibility with existing samplers. Owing to the locality of Gaussian RBFs, RBF-Solver maintains high image fidelity even at fourth order or higher, where previous samplers deteriorate. For unconditional generation, RBF-Solver consistently outperforms polynomial-based samplers in the high-NFE regime (NFE >= 15). On CIFAR-10 with the Score-SDE model, it achieves an FID of 2.87 with 15 function evaluations and further improves to 2.48 with 40 function evaluations. For conditional ImageNet 256 x 256 generation with the Guided Diffusion model at a guidance scale 8.0, substantial gains are achieved in the low-NFE range (5-10), yielding a 16.12-33.73% reduction in FID relative to polynomial-based samplers.
Figures & tables
| NFE | ||||||||
| 5 | 10 | 15 | 20 | 25 | 30 | 35 | 40 | |
| Adams Method | 110.02 | 26.94 | 21.07 | 19.49 | 18.97 | 18.59 | 18.41 | 18.33 |
| RBF-Solver w/o Constant | 112.54 | 26.43 | 20.85 | 19.54 | 18.95 | 18.51 | 18.31 | 18.16 |
| Adams Pred. + RBF Corr. | 111.29 | 26.81 | 20.93 | 19.32 | 18.73 | 18.32 | 18.17 | 18.07 |
| RBF Pred. + Adams Corr. | 117.63 | 26.30 | 21.00 | 19.45 | 18.94 | 18.58 | 18.40 | 18.33 |
| RBF-Solver | 116.55 | 26.64 | 20.89 | 19.30 | 18.72 | 18.31 | 18.17 | 18.07 |
| NFE | ||||||||
| 5 | 10 | 15 | 20 | 25 | 30 | 35 | 40 | |
| Shared- | 116.37 | 26.07 | 21.02 | 19.46 | 18.95 | 18.58 | 18.40 | 18.28 |
| Split- / Indep. | 117.35 | 26.86 | 20.91 | 19.33 | 18.73 | 18.32 | 18.17 | 18.08 |
| Split- / Joint | 116.55 | 26.64 | 20.89 | 19.30 | 18.72 | 18.31 | 18.17 | 18.07 |
| NFE = 10 | NFE = 20 | NFE = 30 | NFE = 40 | |||||
| RBF-Solver | UniPC | RBF-Solver | UniPC | RBF-Solver | UniPC | RBF-Solver | UniPC | |
| 26.47 | 27.75 | 19.30 | 19.51 | 18.31 | 18.60 | 18.07 | 18.34 | |
| 24.72 | 33.60 | 18.67 | 19.37 | 18.08 | 18.39 | 17.95 | 18.25 | |
| 25.37 | 40.55 | 18.58 | 20.25 | 17.92 | 18.48 | 17.92 | 18.27 | |
| 25.30 | 40.55 | 18.44 | 29.93 | 17.99 | 23.89 | 17.79 | 20.69 | |
| 26.39 | 55.96 | 18.62 | 58.40 | 18.52 | 68.87 | 18.97 | 80.48 | |
Appendix figures & tables26 assets
Supplementary material from the paper’s appendix.
Appendix
| Series | NFE | ||||||||||
| 5 | 6 | 8 | 10 | 12 | 15 | 20 | 25 | 30 | 35 | 40 | |
| Model Trajectory | 27.37 | 11.39 | 5.97 | 4.68 | 4.76 | 3.54 | 2.91 | 2.73 | 2.65 | 2.61 | 2.61 |
| Target Trajectory | 26.65 | 13.05 | 5.32 | 4.13 | 3.84 | 3.02 | 2.66 | 2.56 | 2.51 | 2.50 | 2.49 |
| Series | NFE | ||||||||||
| 5 | 6 | 8 | 10 | 12 | 15 | 20 | 25 | 30 | 35 | 40 | |
| 26.34 | 16.34 | 5.28 | 4.11 | 3.80 | 3.01 | 2.66 | 2.56 | 2.51 | 2.50 | 2.49 | |
| 26.65 | 13.05 | 5.32 | 4.13 | 3.84 | 3.02 | 2.66 | 2.56 | 2.51 | 2.50 | 2.49 | |
| 26.64 | 12.45 | 5.36 | 4.16 | 3.92 | 3.02 | 2.66 | 2.56 | 2.51 | 2.50 | 2.50 | |
| Series | NFE | ||||||||||
| 5 | 6 | 8 | 10 | 12 | 15 | 20 | 25 | 30 | 35 | 40 | |
| 116.69 | 70.58 | 35.68 | 26.57 | 22.37 | 20.89 | 19.30 | 18.73 | 18.33 | 18.18 | 18.09 | |
| 116.55 | 70.68 | 34.15 | 26.47 | 22.72 | 20.89 | 19.30 | 18.72 | 18.31 | 18.17 | 18.07 | |
| 116.75 | 70.60 | 35.13 | 26.64 | 22.36 | 20.88 | 19.28 | 18.73 | 18.30 | 18.15 | 18.07 | |
| NFE | CIFAR-10 | ImageNet 64 64 | ImageNet 128 128 | ImageNet 256 256 |
| 5 | ||||
| 6 | ||||
| 8 | ||||
| 10 | ||||
| 12 | ||||
| 15 |
| Dataset | Model | # Eval. samples | Section |
| Unconditional | |||
| CIFAR-10 32 32 [ 28 ] | Score-SDE [ 3 ] | 50k | Appendix I.1.1 |
| CIFAR-10 32 32 [ 28 ] | EDM [ 34 ] | 50k | Appendix I.1.2 |
| ImageNet 64 64 [ 40 ] | Improved-Diffusion [ 41 ] | 50k | Appendix I.1.3 |
| Conditional | |||
| ImageNet 128 128 [ 29 ] | Guided-Diffusion [ 4 ] | 50k | Appendix I.2.1 |
| Model | NFE | ||||||||||
| 5 | 6 | 8 | 10 | 12 | 15 | 20 | 25 | 30 | 35 | 40 | |
| DPM-Solver++ (3) | 28.50 | 13.46 | 5.32 | 4.01 | 4.04 | 3.32 | 2.89 | 2.75 | 2.68 | 2.65 | 2.62 |
| UniPC– (3) | 23.69 | 10.38 | 5.15 | 3.96 | 3.93 | 3.05 | 2.73 | 2.64 | 2.60 | 2.59 | 2.57 |
| RBF-Solver (3) | 26.65 | 13.05 | 5.32 | 4.13 | 3.84 | 3.02 | 2.66 | 2.56 | 2.51 | 2.50 | 2.49 |
| RBF-Solver (4) | 20.17 | 12.45 | 5.71 | 4.26 | 3.90 | 2.87 | 2.60 | 2.54 | 2.49 | 2.49 | 2.48 |
| Model | NFE | ||||||||||
| 5 | 6 | 8 | 10 | 12 | 15 | 20 | 25 | 30 | 35 | 40 | |
| DPM-Solver++ (3) | 24.54 | 11.87 | 4.36 | 2.91 | 2.45 | 2.17 | 2.05 | 2.02 | 2.01 | 2.00 | 2.00 |
| UniPC- (3) | 23.75 | 12.74 | 4.22 | 3.01 | 2.41 | 2.08 | 2.01 | 2.00 | 2.00 | 2.00 | 2.00 |
| UniPC- (3) | 23.52 | 11.11 | 3.86 | 2.85 | 2.37 | 2.07 | 2.01 | 2.00 | 1.99 | 1.99 | 1.99 |
| RBF-Solver (3) | 22.25 | 10.78 | 3.77 | 2.88 | 2.37 | 2.06 | 1.99 | 1.98 | 1.98 | 1.98 | 1.98 |
| RBF-Solver (4) | 14.91 | 7.67 | 4.90 | 3.71 | 2.50 | 2.05 | 2.00 | 1.99 | 1.99 | 1.99 | 1.98 |
| Model | NFE | ||||||||||
| 5 | 6 | 8 | 10 | 12 | 15 | 20 | 25 | 30 | 35 | 40 | |
| DPM-Solver++ (3) | 110.23 | 66.00 | 38.48 | 28.95 | 24.59 | 21.62 | 19.94 | 19.36 | 18.91 | 18.70 | 18.57 |
| UniPC- (3) | 109.81 | 65.06 | 35.11 | 27.75 | 24.30 | 21.15 | 19.51 | 18.98 | 18.60 | 18.42 | 18.34 |
| RBF-Solver (3) | 116.55 | 70.68 | 34.15 | 26.47 | 22.72 | 20.89 | 19.30 | 18.72 | 18.31 | 18.17 | 18.07 |
| RBF-Solver (4) | 126.26 | 76.92 | 31.71 | 24.72 | 21.70 | 19.61 | 18.67 | 18.30 | 18.08 | 17.99 | 17.95 |
| NFE | |||||||||
| 5 | 6 | 8 | 10 | 12 | 15 | 20 | 25 | ||
| Guidance Scale = 2.0 | |||||||||
| DPM-Solver++ (2) | 15.32 | 10.60 | 7.16 | 6.01 | 5.41 | 4.93 | 4.50 | 4.30 | |
| UniPC- (2) | 13.43 | 9.19 | 6.50 | 5.69 | 5.23 | 4.85 | 4.48 | 4.29 | |
| RBF-Solver (2) | 12.83 | 8.80 | 6.34 | 5.61 | 5.22 | 4.85 | 4.49 | 4.28 | |
| RBF-Solver (3) | 12.19 | 8.15 | 5.98 | 5.51 | 5.16 | 4.84 | 4.51 | 4.30 | |
| NFE | ||||||||||
| 5 | 6 | 8 | 10 | 12 | 15 | 20 | 25 | 30 | ||
| Guidance Scale = 2.0 | ||||||||||
| DPM-Solver++ (2) | 16.27 | 12.59 | 9.62 | 8.54 | 8.11 | 7.68 | 7.44 | 7.33 | 7.27 | |
| UniPC- (2) | 15.00 | 11.53 | 9.05 | 8.20 | 7.83 | 7.62 | 7.36 | 7.23 | 7.23 | |
| RBF-Solver (2) | 15.05 | 11.45 | 9.11 | 8.28 | 7.87 | 7.71 | 7.43 | 7.31 | 7.28 | |
| RBF-Solver (3) | 14.77 | 11.11 | 9.00 | 8.40 | 8.05 | 7.78 | 7.45 | 7.31 | 7.28 | |
| Dataset | Model | Compared Samplers | Section |
| Unconditional | |||
| CIFAR-10 32 32 [ 28 ] | Score-SDE [ 3 ] | DPM-Solver-v3 [ 39 ] , DC-Solver [ 38 ] | J.2.1 |
| CIFAR-10 32 32 [ 28 ] | EDM [ 34 ] | DPM-Solver-v3 [ 39 ] , DC-Solver [ 38 ] | J.2.2 |
| CIFAR-10 32 32 [ 28 ] | EDM [ 34 ] | AMED-Solver, AMED-Plugin [ 37 ] | J.2.3 |
| FFHQ 64 64 [ 47 ] | EDM [ 34 ] | AMED-Solver, AMED-Plugin [ 37 ] | J.2.4 |
| Conditional | |||
| Method | Parameter Type | Param. Count | Dataset Size | Offline Tuning Time * | Additional Network |
| DPM-Solver-v3 [ 39 ] | Empirical Model Stats. | 1.1M–295M | 1k–4k | 11 h / 8 GPUs | ✗ |
| AMED-Solver [ 37 ] | Neural-Net Weights | 9k | 10k | 3 h / 1 GPU | ✓ |
| DC-Solver [ 38 ] | Compensation Ratios | 10 | 5 min / 1 GPU | ✗ | |
| RBF-Solver (Ours) | Shape Parameters | 128 | 1 min - 1 h / 1 GPU ** | ✗ |
| Model | NFE | ||||||||||
| 5 | 6 | 8 | 10 | 12 | 15 | 20 | 25 | 30 | 35 | 40 | |
| DPM-Solver-v3 (3) | 12.76 | 7.39 | 3.93 | 3.39 | 3.23 | 2.89 | 2.69 | 2.62 | 2.58 | 2.58 | 2.57 |
| DC-Solver (3) | 48.27 | 22.65 | 6.46 | 4.64 | 5.51 | 4.39 | 3.86 | 2.68 | 2.59 | 2.52 | 2.48 |
| RBF-Solver (3) | 26.65 | 13.05 | 5.32 | 4.13 | 3.84 | 3.02 | 2.66 | 2.56 | 2.51 | 2.50 | 2.49 |
| RBF-Solver (4) | 20.17 | 12.45 | 5.71 | 4.26 | 3.90 | 2.87 | 2.60 | 2.54 | 2.49 | 2.49 | 2.48 |
| Model | NFE | ||||||||||
| 5 | 6 | 8 | 10 | 12 | 15 | 20 | 25 | 30 | 35 | 40 | |
| DPM-Solver-v3 (3) | 12.19 | 8.56 | 3.50 | 2.51 | 2.23 | 2.10 | 2.02 | 2.00 | 2.00 | 1.99 | 1.99 |
| DC-Solver (3) | 29.69 | 12.52 | 5.21 | 2.88 | 3.15 | 2.37 | 2.07 | 2.16 | 2.15 | 2.11 | 2.17 |
| RBF-Solver (3) | 22.25 | 10.78 | 3.77 | 2.88 | 2.37 | 2.06 | 1.99 | 1.98 | 1.98 | 1.98 | 1.98 |
| RBF-Solver (4) | 14.91 | 7.67 | 4.88 | 3.71 | 2.50 | 2.05 | 2.00 | 1.99 | 1.99 | 1.98 | 1.98 |
| Model | NFE | |||||||||
| 5 | 7 | 9 | 11 | 15 | 21 | 25 | 31 | 35 | 41 | |
| AMED-Solver (2) | 7.28 | 4.20 | 3.78 | 4.00 | 3.40 | 3.35 | 3.26 | 3.06 | 2.95 | 2.62 |
| AMED-Plugin (4) | 6.77 | 3.80 | 2.66 | 2.31 | 2.00 | 1.97 | 1.99 | 2.07 | 2.01 | 1.99 |
| RBF-Solver (3) | 22.63 | 5.94 | 3.43 | 2.68 | 2.08 | 2.00 | 1.99 | 1.98 | 1.98 | 1.97 |
| RBF-Solver (4) | 15.01 | 5.29 | 5.06 | 3.01 | 2.09 | 2.01 | 1.99 | 1.98 | 1.98 | 1.97 |
| Model | NFE | |||||||||
| 5 | 7 | 9 | 11 | 15 | 21 | 25 | 31 | 35 | 41 | |
| AMED-Solver (2) | 14.80 | 8.82 | 6.30 | 5.29 | 4.40 | 3.85 | 3.53 | 3.33 | 3.21 | 2.93 |
| AMED-Plugin (4) | 12.48 | 6.64 | 4.24 | 3.70 | 2.93 | 2.61 | 2.57 | 2.53 | 2.50 | 2.55 |
| RBF-Solver (3) | 19.58 | 7.07 | 4.61 | 3.49 | 2.70 | 2.42 | 2.37 | 2.34 | 2.34 | 2.34 |
| RBF-Solver (4) | 15.58 | 7.93 | 8.71 | 4.19 | 2.60 | 2.34 | 2.30 | 2.29 | 2.30 | 2.31 |
| NFE | |||||||||
| 5 | 6 | 8 | 10 | 12 | 15 | 20 | 25 | ||
| Guidance Scale = 2.0 | |||||||||
| DPM-Solver-v3 (2) | 14.75 | 10.99 | 8.79 | 8.05 | 7.74 | 7.61 | 7.35 | 7.23 | |
| DC-Solver (3) | 15.78 | 11.60 | 9.29 | 8.19 | 7.77 | 7.61 | 7.46 | 7.47 | |
| RBF-Solver (2) | 15.05 | 11.45 | 9.11 | 8.28 | 7.87 | 7.71 | 7.43 | 7.31 | |
| RBF-Solver (3) | 14.77 | 11.11 | 9.00 | 8.40 | 8.05 | 7.78 | 7.45 | 7.31 | |