cs.LGMay 21, 2026

Posterior Collapse as Automatic Spectral Pruning

Authors: Johannes Hirn

Organizations: 1Image Processing Laboratory (IPL), Universitat de València, Paterna, València 46980, Spain∗

Abstract

We show that posterior collapse in ββ-VAEs implements automatic spectral pruning. A latent mode collapses if its contribution to reconstruction is below the cutoff set by ββ. Equilibrium solutions with different ββ thus reveal a cascade of collapses as latent modes decouple from least to most useful. We derive this as a consequence of the loss via a Landau stability analysis. We define a latent-rescaling-invariant order parameter that ranks active latent modes and whose collapse thresholds identify which effective variables to inspect first. In the linear Gaussian case, the collapse spectrum, utility spectrum, and normalized PCA spectrum coincide, and each collapse follows a mean-field law. We test these predictions on the WorldClim dataset.

Explore similar work

CardsList