cs.LGSep 26, 2026

SIMANF: Sample Free Learning of Unnormalized Distributions via Simulated Annealing in Normalizing Flows

Authors: Vikas Kanaujia

Organizations: Mahindra University Department of Electrical and Computer Engineering Hyderabad, Telangana, India

Abstract

Efficiently learning and sampling from high dimensional, multimodal unnormalized distributions without target samples remains a challenging problem. Although normalizing flows can generate samples efficiently, training based on the reverse KL divergence using only the unnormalized target density may suffer from mode collapse. We introduce SIMANF, a sample free framework that integrates simulated annealing with normalizing flows. SIMANF progressively transforms the target distribution from a smooth initial form to the original target distribution and trains the flow sequentially across these stages. By transferring the learned representation between stages, the method promotes mode coverage while progressively capturing finer features of the target distribution. Following annealing, a final refinement stage combines the reverse KL divergence with an importance weighted forward KL objective using samples generated by the flow. SIMANF requires no target samples during training and uses only the unnormalized density. We demonstrate its effectiveness on Many-Well distributions and high dimensional Scalar Phi4 lattice field theory distribution.

Figures & tables

Explore similar work

CardsList
  1. FUND: Density Flow for Sampling Unnormalised Distributions

    Sep 26, 2026Vikas Kanaujia, Vipul AroraSampling from Unnormalized DistributionsBoltzmann Sampling

  2. Neural Sampling with Reweighted Normalizing Flows via the Wasserstein--Fisher--Rao JKO Scheme

    Oct 7, 2026Chenguang Duan, Johannes Hertrich, Gabriele SteidlSampling from Unnormalized DistributionsBoltzmann Sampling