SNaP: One-Step Posterior Sampling for Noisy Inverse Problems
Organizations: WashU · UW-Madison
Abstract
Diffusion and flow-matching models can produce high-quality posterior samples for inverse problems, but typically require tens to thousands of network evaluations per draw. MeanFlow enables one-step generation, yet applying it to inverse problems leaves no intermediate steps at which to enforce measurement consistency. We introduce SNaP, a one-step MeanFlow posterior sampler for linear inverse problems with Gaussian noise. Its central innovation is a measurement-adapted source: a Gaussian distribution whose mean and anisotropic covariance are determined by the measurement operator, observation, and noise level. The source anchors well-measured directions while preserving variation where the measurements are weak or uninformative. We show that the exact conditional flow transports this source to the true posterior. Across natural-image restoration and multi-coil MRI, SNaP produces diverse, high-quality samples with one network evaluation per draw, 30 to 2250 faster than iterative samplers.
Figures & tables
| Method | NFE | Deblurring | Super-resolution | Random inpainting | Box inpainting | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | ||
| Degraded | – | 27.26 | 0.838 | 0.214 | 11.67 | 0.182 | 0.859 | 11.98 | 0.198 | 1.070 | 22.33 | 0.754 | 0.217 |
| MSE regressor | 1 | 35.74 | 0.953 | 0.029 | 34.17 | 0.945 | 0.033 | 34.42 | 0.955 | 0.022 | – | – | – |
| PnP-GS | 23 | 33.97 | 0.924 | 0.041 | 31.23 | 0.890 | 0.065 | 29.17 | 0.874 | 0.066 | – | – | – |
| DDRM | 20 | 35.02 | 0.946 | 0.027 | 32.24 | 0.927 | 0.027 | 32.40 | 0.942 | 0.029 | – | – | – |
| Method | NFE | Gaussian deblurring | Super-resolution | Box inpainting | |||
|---|---|---|---|---|---|---|---|
| FID | FID | FID | |||||
| MSE regressor | 1 | 22.06 | – | 24.76 | – | – | – |
| DDRM | 20 | 20.26 | 0.31 | 18.94 | 0.19 | – | – |
| Flower1-OT | 100 | 17.86 | 0.23 | 23.79 | 0.24 | 18.72 | 0.24 |
| DPS | 1000 | 18.25 | 0.64 | 19.94 | 0.67 | 15.42 | 2.15 |
| SNaP (ours) | 1 | 15.80 | 1.03 | 16.80 | 0.99 | 15.53 | 1.08 |
| dB | dB | dB | dB | ||||||
| Method | NFE | PSNR | SSIM | PSNR | SSIM | PSNR | SSIM | PSNR | SSIM |
| Zero-filled | — | 25.35 | 0.791 | 25.37 | 0.793 | 21.98 | 0.694 | 21.99 | 0.694 |
| Wavelet | — | 26.57 | 0.672 | 27.75 | 0.768 | 23.02 | 0.551 | 23.81 | 0.643 |
| TV | — | 26.19 | 0.798 | 26.27 | 0.799 | 22.62 | 0.689 | 22.66 | 0.691 |
| MSE regressor | 1 | 33.80 | 0.909 | 33.85 | 0.912 | 30.71 | 0.875 | 30.73 | 0.878 |
| CelebA, Gaussian deblurring | |||||
|---|---|---|---|---|---|
| DPS | OT-ODE | Flower | DDRM | SNaP | |
| NFE | |||||
| Time / sample (s) | 27.014 | 6.575 | 2.614 | 0.360 | 0.012 |
| Slowdown vs. ours | – | ||||
| fastMRI brain, multi-coil | |||||
| CSGM | DAPS | PnP-DM | DPS | SNaP | |
| Source | PSNR | LPIPS | PSNR | LPIPS | |
|---|---|---|---|---|---|
| 35.85 | 0.030 | 35.86 | 0.030 | 0.00 | |
| 35.83 | 0.030 | 35.84 | 0.030 | 0.00 | |
| (ours) | 32.90 | 0.018 | 35.91 | 0.030 | 1.03 |
Appendix figures & tables24 assets
Supplementary material from the paper’s appendix.
Appendix
| Method | NFE | Deblurring | Super-resolution | Random inpainting | Box inpainting | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | ||
| Degraded | – | 24.39 | 0.532 | 0.543 | 11.98 | 0.212 | 0.900 | 13.25 | 0.214 | 1.091 | 21.57 | 0.736 | 0.214 |
| MSE regressor | 1 | 29.82 | 0.806 | 0.289 | 29.16 | 0.817 | 0.201 | 33.23 | 0.915 | 0.066 | – | – | – |
| PnP-GS | 23 | 28.39 | 0.787 | 0.387 | 24.44 | 0.639 | 0.411 | 29.89 | 0.841 | 0.123 | – | – | – |
| PnP-Flow5 | 500–2500 | 29.01 | 0.785 | 0.312 | 28.01 | 0.791 | 0.167 | 34.47 | 0.933 | 0.044 | 27.14 | 0.900 | 0.127 |
| Measurement noise | PSNR | SSIM | LPIPS | input PSNR | Gain |
|---|---|---|---|---|---|
| 34.29 | 0.940 | 0.020 | 29.96 | +4.33 | |
| 34.15 | 0.939 | 0.019 | 29.62 | +4.53 | |
| 33.89 | 0.936 | 0.018 | 29.12 | +4.77 | |
| 33.50 | 0.930 | 0.017 | 28.52 | +4.98 | |
| 32.90 | 0.919 | 0.018 | 27.81 | +5.09 |
| PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | |
|---|---|---|---|---|---|---|---|---|---|
| 32.941 | 0.9198 | 0.0190 | 32.922 | 0.9187 | 0.0186 | 32.512 | 0.9060 | 0.0244 | |
| 34.966 | 0.9463 | 0.0209 | 34.948 | 0.9457 | 0.0181 | 34.588 | 0.9385 | 0.0197 | |
| 35.688 | 0.9537 | 0.0275 | 35.663 | 0.9532 | 0.0234 | 35.323 | 0.9475 | 0.0249 | |
| 35.913 | 0.9558 | 0.0300 | 35.885 | 0.9553 | 0.0256 | 35.552 | 0.9500 | 0.0273 | |
| PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | |
|---|---|---|---|---|---|---|---|---|---|
| 32.567 | 0.9130 | 0.0216 | 32.941 | 0.9198 | 0.0190 | 32.976 | 0.9210 | 0.0189 | |
| 34.679 | 0.9429 | 0.0197 | 34.966 | 0.9463 | 0.0209 | 34.976 | 0.9465 | 0.0206 | |
| 35.438 | 0.9513 | 0.0266 | 35.688 | 0.9537 | 0.0275 | 35.682 | 0.9536 | 0.0268 | |
| 35.676 | 0.9537 | 0.0296 | 35.913 | 0.9558 | 0.0300 | 35.902 | 0.9557 | 0.0292 | |
| PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 32.941 | 0.9198 | 0.0190 | 33.084 | 0.9211 | 0.0172 | 33.037 | 0.9205 | 0.0172 | 32.992 | 0.9200 | 0.0173 | |
| 34.966 | 0.9463 | 0.0209 | 35.044 | 0.9469 | 0.0206 | 35.001 | 0.9465 | 0.0206 | 34.942 | 0.9458 | 0.0210 | |
| 35.688 | 0.9537 | 0.0275 | 35.729 | 0.9540 | 0.0275 | 35.688 | 0.9536 | 0.0276 | 35.621 | 0.9529 | 0.0281 | |
| 35.913 | 0.9558 | 0.0300 | 35.943 | 0.9561 | 0.0302 | 35.902 | 0.9557 | 0.0303 | 35.833 | 0.9550 | 0.0308 | |
| Method | Aligned (parity) | Rotated (discriminating) |
|---|---|---|
| SNaP | ||
| VFM (joint) | ||
| VFM (frozen ) |
| NullFlow | SNaP | ||||||
|---|---|---|---|---|---|---|---|
| Test | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | |
| mean (post) | mean ( SNaP ) | (observed, null) post SNaP | |||
|---|---|---|---|---|---|
| mean (post) | mean ( SNaP ) | (observed, null) post SNaP | |||
|---|---|---|---|---|---|
| (diag) | error | ||
|---|---|---|---|
| closed form | — | ||
| RTO equation 13 | , |
| direction | posterior | one-step SNaP | source |
|---|---|---|---|
| (observed, ) | |||
| (null, ) |
| Problem | structure | Cost | Notes |
|---|---|---|---|
| Inpainting (random) | free | diagonal | |
| Inpainting (box) | free | identical structure | |
| MRI, single-coil | free | diagonal in -space | |
| SR, average-pool | free | disjoint rows of norm | |
| Deblurring, Gaussian | diag. in Fourier | 2 FFTs | |
| Deblurring, uniform | diag. in Fourier | 2 FFTs | has exact zeros |