stat.MLNov 12, 2026

Stochastic Kernel Mode Decomposition: Information, Uncertainty, and Conditional Regime Inference

Authors: Boumediene Hamzi, Houman Owhadi

Organizations: The Alan Turing Institute, London NW1 2DB, UK · Department of Computing and Mathematical Sciences, California Institute of Technology, Pasadena, CA 91125, USA

Abstract

When do mode energies preserve regime information as measurement quality changes? Stochastic Kernel Mode Decomposition (sKMD) fits joint regime laws on signed KMD mode coordinates and transfers the reference mode posterior to regime probabilities and conditional reconstructions. For centered Gaussian regimes with independently varying known noise variances, fixed coordinate energies retain the full regime posterior precisely when all classes share their cross-covariances and class variances can differ only at isolated vertices of the covariance graph. We extend the characterization to nonzero means and show that freely varying correlated noise forces a fixed linear log-odds decoder to retain the full quadratic feature span even for two distinct centered regimes. At fixed quality, a three-regime example has no sufficient two-energy basis. Its smallest Bayes log-loss gap over bases of condition number at most κκ has sharp order κ−1κ^{-1}. Exact Bayes energy posteriors supply numerical gap estimates for specified bases. Additional bounds relate feature compression, independently learned mode spans and sensor-noise error to log loss. Two controlled experiments with 64 independent panels each show that signed information can improve prediction over energy summaries, while integration gives small gains over strong signed controls and depends on how the competing point rule is calibrated and how accurately observation noise is measured.

Figures & tables

Appendix figures & tables4 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. A Compositional Kernel Model for Feature Learning

    Sep 17, 2025Feng Ruan, Keli Liu, Michael JordanKernel Ridge RegressionKernel Regression

  2. Conditional KRR: Injecting Unpenalized Features into Kernel Methods with Applications to Kernel Thresholding

    May 25, 2026Rustem Takhanov, Zhenisbek AssylbekovKernel Ridge RegressionKernel Regression

  3. DeRegiME: Deep Regime Mixtures for Probabilistic Forecasting under Distribution Shift

    May 19, 2026Kieran Wood, Stefan Zohren, Stephen J. RobertsDistribution Shift RobustnessTime Series Forecasting