cs.LGNov 10, 2026

Thompson Sampling using Prior-fitted Diffusion Transformers

Authors: Sihwa Park, Jingsen Zhu, Vinamr Jain, Sheng-Yen Chou, Alexander Terenin

Organizations: Cornell University

Abstract

Thompson sampling is natural randomized strategy for optimizing unknown functions in a black-box manner. In continuous global optimization, Thompson sampling has largely been restricted to Gaussian process priors, as these are essentially the only class for which computing the posterior distribution has been tractable in practice. In this work, we introduce prior-fitted diffusion transformers, which are diffusion models that perform Thompson sampling in-context at inference time, after being pre-trained using the prior-fitted network paradigm. To apply these models, we develop a set of practical non-Gaussian priors for general black-box functions---including those that have characteristics that cannot be achieved under Gaussianity, such as priors over unimodal functions. We also quantify the tradeoff between model size and the number of pre-training iterations, and show that these models follow scaling laws akin to those observed in transformers defined over other modalities. Across a set of global optimization benchmarks, we show that prior-fitted diffusion transformers with non-Gaussian priors can achieve improved performance compared to traditional pipelines built on Gaussian processes.

Figures & tables

Appendix figures & tables12 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Improving Bayesian Optimization via Training-Aware Conditional Diffusion Models

    Jun 7, 2026Yilin Zheng, Haowei Wang, Szu Hui Ng +1Bayesian OptimizationBlack-Box Optimization

  2. Transformers Learn the Optimal DDPM Denoiser for Multi-Token GMMs

    Apr 11, 2026Hongkang Li, Hancheng Min, Rene VidalDiffusion ModelsDiffusion-Based Denoising