Posterior sampling by source-space MCMC via prior-based few-step transport maps
Organizations: Division of Mathematical Sciences, School of Physical and Mathematical Sciences, Nanyang Technological University, Singapore. · Department of Computer Science, Faculty of Science, University of Helsinki, Finland.
Abstract
Bayesian inference increasingly uses informative but implicit priors represented only by samples, such as historical ensembles, simulator outputs, and pretrained generative models. The same computational problem appears in the test-time guidance task (generalized Bayes), where an explicit positive weight, e.g., an exponentiated reward, tilts an implicit prior. We develop a framework for source-space generalized Bayesian inference that combines inexpensive few-step prior transports with posterior stability guarantees. Specifically, we represent the prior using a one- or few-step improved MeanFlow (iMF) map and perform posterior sampling in its Gaussian source space. We establish Wasserstein error bounds between the exact and learned posteriors in terms of the joint population iMF and auxiliary-velocity loss, decomposed into training suboptimality and model-class approximation error. In the iMF source space, we adopt parallel tempering with preconditioned Crank-Nicolson updates and introduce a hybrid variant that incorporates split Hamiltonian Monte Carlo to improve sampling efficiency. Synthetic experiments show that the proposed framework can approximate posterior distributions accurately and efficiently, while CLIP-guided ImageNet experiments demonstrate its ability to steer a pretrained iMF image prior toward text-specified preferences.
Figures & tables
| Method | Bin TV | Coord. ESS | Coord. ESS/s | Time (s) | |
|---|---|---|---|---|---|
| Banana | |||||
| DPS | — | — | |||
| FM+SPT+pCN | |||||
| iMF+SPT+pCN | |||||
| iMF+SPT+hybrid | |||||
| Sine | |||||
| Method | Mean CLIP reward | Sampling time (h) | Mean sweep time (s) |
|---|---|---|---|
| Golden retriever: “A photograph of a golden retriever running through fallen autumn leaves.” | |||
| Best-of-K | 0.2864 | 2.49 | – |
| SiT+SPT+pCN | 0.3122 | 10.51 | 370.89 |
| iMF+SPT+pCN | 0.3809 | 2.40 | 5.75 |
| iMF+SPT+hybrid | 0.3824 | 10.95 | 26.28 |
| Bald eagle: “A photograph of a bald eagle soaring above snow-capped mountains, wings spread wide.” | |||
Appendix figures & tables11 assets
Supplementary material from the paper’s appendix.
Appendix
| Method | Mean CLIP reward | Sampling time (h) | Mean sweep time (s) |
|---|---|---|---|
| Golden retriever : “A photograph of a golden retriever running through fallen autumn leaves.” | |||
| Best-of-K | 0.2864 | 2.49 | – |
| SiT+SPT+pCN | 0.3122 | 10.51 | 370.89 |
| iMF+SPT+pCN | 0.3809 | 2.40 | 5.75 |
| iMF+SPT+hybrid | 0.3824 | 10.95 | 26.28 |
| Golden retriever : “A beautiful professional photograph of a golden retriever in a sunlit meadow, sharp focus, natural colors.” | |||