Data Free Training of Diffusion Models for Lattice Field Theories
Organizations: Berlin Institute for the Foundations of Learning and Data (BIFOLD), Germany · Technische Universität Berlin, Germany · Deutsches Elektronen-Synchrotron (DESY), Platanenallee 6, 15738 Zeuthen, Germany · Computation-Based Science and Technology Research Center, The Cyprus Institute, Nicosia, Cyprus · RIKEN Center for Advanced Intelligence Project (AIP), Japan
Abstract
Sampling equilibrium field configurations remains a major computational bottleneck in lattice field theory, motivating the development of generative samplers that can produce independent configurations. Diffusion models are promising for this purpose, but their standard denoising score matching objective requires samples from the target distribution, seemingly reintroducing the original sampling problem. Here, we show that diffusion models can instead be trained from their own generated samples using the target score identity, provided access to the unnormalized probability density. Importance-weighted formulations of this identity yield a consistent target throughout training, while unweighted variants define a self-consistent fixed-point training scheme. We benchmark the different approaches in two-dimensional theory and identify effective choices that enable efficient training and sampling across the symmetric, critical, and broken phases. Ultimately, our data-free training approach achieves comparable performance to training on HMC reference data.
Figures & tables
| phase | ESS (%) | ||||
|---|---|---|---|---|---|
| 4 | symmetric | 99.8 | |||
| critical | 98.8 | ||||
| broken | 98.9 | ||||
| 8 | symmetric | 99.0 | |||
| critical | 96.7 | ||||
| broken | 97.4 |