cs.LGApr 15, 2026

Universality of Gaussian-Mixture Reverse Kernels in Conditional Diffusion

Authors: Nafiz Ishtiaque, Syed Arefinul Haque, Kazi Ashraful Alam, Fatima Jahara

Organizations: Center for Mathematics and Interdisciplinary Sciences, Fudan University, Shanghai 200433, China · Shanghai Institute for Mathematics and Interdisciplinary Sciences (SIMIS), Shanghai 200433, China · Northeastern University, Boston, MA 02115, USA · Infectious Diseases Division, icddr,b, Dhaka 1212, Bangladesh · 

Abstract

We prove that conditional diffusion models whose reverse kernels are finite Gaussian mixtures with ReLU-network logits can approximate suitably regular target distributions arbitrarily well in context-averaged conditional KL divergence, up to an irreducible terminal mismatch that typically vanishes with increasing diffusion horizon. A path-space decomposition reduces the output error to this mismatch plus per-step reverse-kernel errors; assuming each reverse kernel factors through a finite-dimensional feature map, each step becomes a static conditional density approximation problem, solved by composing Norets' Gaussian-mixture theory with quantitative ReLU bounds. Under exact terminal matching the resulting neural reverse-kernel class is dense in conditional KL.

Explore similar work

CardsList
  1. Finite-Sample Guarantees for Fully Discrete Conditional Diffusion Models

    Oct 9, 2026Qiuyun ZhuConditional Diffusion ModelsDiffusion Sampling

  2. From Score Approximation to Distribution Approximation in Score-Based Diffusion Models

    Jul 24, 2026Lan V. TruongScore-Based Generative ModelingDiffusion Models

  3. Learning Transition Kernels of Jump-Diffusion Processes with Conditional Diffusion Models

    Oct 6, 2026Yuzhen Zhao, Yating Liu, Quentin GuibertStochastic Differential EquationsConditional Distribution Estimation