cs.LGNov 5, 2026

All roads lead to Markov kernel networks: A representation theorem for discretization-stable learning

Authors: S David Mis, Trevor Teolis, Ivan Dokmanić, Matti Lassas, Maarten V. de Hoop

Organizations: Rice University · University of Basel · University of Helsinki

Abstract

Operator learning seeks to approximate function-to-function maps in a way that remains stable when the input discretization changes, a property sometimes called "discretization invariance". We consider a quantitative refinement of this idea, called uniform discretization stability\textit{uniform discretization stability}, which builds on a common representation of input functions and their discretizations as probability measures and provides a Hölder bound relating output changes to the Wasserstein distance between these measures. Our main result is a representation theorem showing all uniformly discretization stable operators can be written exactly as a stable Markov kernel network\textit{stable Markov kernel network}---an abstract architecture that is a joint generalization of transformers, Fourier neural operators (FNO), Flowers, and other successful learned operators. Our representation theorem characterizes a design space for discretization-stable operator learning; designing new architectures becomes a question of which parts of a Markov kernel network to parameterize, and how. We further show that the read kernels of these networks can be realized as solutions of regularized variational problems, with particular choices of costs and regularizers recovering the kernels of transformers, FNO, Flowers, their hybrids, and beyond. This variational formulation provides a systematic approach to architecture design, together with sufficient conditions for uniform discretization stability.

Figures & tables

Appendix figures & tables2 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Function graph transformers universally approximate operators between function spaces

    May 18, 2026Takashi Furuya, David Mis, Ivan Dokmanić +2Transformer Neural OperatorTransformer Attention

  2. Kernel Methods for Learning Operators with Multiple Inputs and Outputs

    Aug 12, 2026Adrien Weihs, Chunyang Liao, Jingmin Sun +1Kernel MethodsPDE Operator Learning

  3. A Kernel-based Stochastic Approximation Framework for Nonlinear Operator Learning

    Sep 14, 2025Jia-Qi Yang, Lei ShiStochastic ApproximationReproducing Kernel Hilbert Spaces