stat.MLAug 19, 2026

Theoretical Study on the Evidential Learning-based Variational Autoencoder

Authors: Ge Wang

Organizations: Rensselaer Polytechnic Institute, Troy, New York, USA

Abstract

A normal--inverse-gamma (NIG) latent hierarchy has four parameters, but its induced latent law does not identify all four. For σ2∼InvGamma(α,β)σ^2\sim\mathrm{InvGamma}(α,β), μ∣σ2∼N(γ,σ2/ν)μ\midσ^2\sim\mathcal{N}(γ,σ^2/ν), and z∣μ,σ2∼N(μ,σ2)z\midμ,σ^2\sim\mathcal{N}(μ,σ^2), the marginal law of zz depends on (ν,β)(ν,β) only through c=β(1+1/ν)c=β(1+1/ν). Hence the reconstruction-visible parameter space is the three-dimensional quotient (γ,α,c)(γ,α,c), with a one-dimensional fiber degree of freedom. For a fixed hierarchical variational objective, exact partial minimization of the forward KL divergence to a complete NIG prior selects a unique prior-relative representative on each fiber, yielding an exact three-coordinate reduction with the same optimum as the four-coordinate objective. Writing ρ0=2β0/ν0ρ_0=2β_0/ν_0 and T=c/{α[(γ−γ0)2+ρ0]}T=c/\{α[(γ-γ_0)^2+ρ_0]\}, we show that inverse canonical allocation 1/νcan1/ν_{\rm can} is an explicit strictly increasing function of TT. For α>1α>1, the ratio uepi/uvar=1/νcanu_{\rm epi}/u_{\rm var}=1/ν_{\rm can} is therefore determined by the quotient state and prior; for rank-only use under a common calibration, TT contains the same coordinatewise ordinal information. The residual prior gauge is characterized rather than eliminated: (γ0,ρ0)(γ_0,ρ_0) govern ordinal dependence, while (ν0,α0)(ν_0,α_0) determine numerical calibration and the analytic ceiling of 1/νcan1/ν_{\rm can}.

Explore similar work

CardsList
  1. Variational Learning of Fractional Posteriors

    Mar 29, 2026Kian Ming A. Chai, Edwin V. BonillaBayesian InferenceVariational Inference

  2. Predictive variational inference: Learn the predictively optimal posterior distribution

    Oct 18, 2024Jinlin Lai, Antonio Linero, Yuling YaoModel MisspecificationVariational Inference

  3. λ\mathbfλ-VAE: Variance Equalization for Posterior Collapse

    Jul 6, 2026Girum DemisseVariational AutoencodersPosterior Collapse