Finite-Time Online Sample Complexity for Conditional Diffusion Models
Organizations: Department of Electrical and Computer Engineering, Ohio State Univeristy · Department of Computer Science and Information Systems, BITS Pilani · Department of Computer Science, University of Central Florida · Edwardson School of Industrial Engineering, Purdue University
Abstract
We study the finite-time training and sampling error of conditional diffusion models trained by online stochastic-gradient denoising score matching. Rather than assuming access to an exact empirical or population risk minimizer, we analyze the score network produced after a finite number of stochastic-gradient updates under an explicit localized Polyak--Łojasiewicz (PL) condition, stochastic-gradient regularity, and a trajectory-containment assumption. Our analysis separates the network approximation complexity from the online training-sample budget and propagates both errors through the reverse diffusion process. Under anisotropic smoothness, a joint intrinsic-dimensional structure for the data and conditioning variables, sub-exponential tails, and explicit approximation-class compatibility, we obtain a conditional score approximation error of order
where denotes the approximation complexity, and are the intrinsic response and conditioning dimensions, and are their corresponding smoothness exponents. For online denoising samples used by SGD, the finite-time optimization error is controlled explicitly in terms of the PL, smoothness, gradient-noise, and initialization constants. Combining these ingredients with reverse-process stability yields a total-variation bound that decomposes into terminal-initialization, time-discretization, approximation/localization, and finite-time optimization errors.
Figures & tables
| Reference | Conditional | Intrinsic dimension | Gradient training | Sampling bound |
|---|---|---|---|---|
| Fu et al. (2024) | Yes | No | No | Yes |
| Tang et al. (2025) | Yes | Yes | No | Yes |
| Hu et al. (2025) | Yes | Yes | No | Yes |
| Li (2025) | Yes | No | No | Yes |
| Gaur et al. (2026) | No | No | Finite-time SGD | Yes |
| Han et al. (2024) | No | No | GD with early stopping | No (training only) |
Appendix figures & tables9 assets
Supplementary material from the paper’s appendix.
Appendix
Conditional Diffusion Models
Conditional diffusion models generate or infer data by steering iterative denoising with observations, labels, text, physical constraints, or other inputs.
See all 295 papers