Overview

Universal approximation asks when neural networks and related models can approximate target functions, operators, or probability transformations, a prerequisite for learning what those models can express. Common approaches prove density under conditions on activation functions and depth, derive error rates for smoothness classes, and study architectures such as residual networks, invariant models, Kolmogorov–Arnold networks, and signature-based models. Results now extend beyond compact finite-dimensional domains to derivatives, path-dependent processes, variable-size sets, partial differential equations, and measure-valued maps. A central tension is that universality may fail or require substantial resources under restrictions such as narrow architectures, small embeddings, atomic inputs, finite precision, or physical noise, making quantitative and practical guarantees important open concerns.

Latest papers

CardsList

32 papers3 papers in the last four weeks, level with the four weeks before. 0.0% of all new papers.

  1. DL101 The Representation Capability of Neural Network Models

    Nov 17, 2026Fernando BerzalNeural Network ExpressivityNeural Network Approximation Theory

  2. Universal Approximation Theorem for Metaplectic Neural Operators

    Nov 10, 2026Ahmed Abdeljawad, Malek Yacine RezougUniversal ApproximationNeural Operators

  3. Wavelength Diversity Expands the Expressive Power of Optical Computing

    Oct 16, 2026Shiqi Chen, Che-Yung Shen, Parnian Ghapandar Kashani +2Photonic ComputingUniversal Approximation

  4. Kolmogorov-Arnold Classifier Systems as Universal Approximators

    Sep 29, 2026Hiroki Shiraishi, Hisao Ishibuchi, Masaya NakataUniversal ApproximationFunction Approximation

  5. Universal Approximation of Measure-to-Measure Operators by Pushforwards

    Sep 28, 2026Takashi Furuya, Nicholas H. Nelsen, Frank ColeTransformerUniversal Approximation

  6. Kolmogorov--Arnold stability for discontinuous functions

    Sep 7, 2026Sviatoslav V. DzhenzherAdversarial RobustnessKolmogorov-Arnold Networks

  7. Expressivity In Multimodal Contrastive Learning

    Aug 17, 2026Andrew Stuart, Florian WolfMultimodal Contrastive LearningNeural Network Expressivity

  8. A Single Atom in Front of a Mirror is a Universal Reservoir Computer

    Aug 11, 2026Peter J. Ehlers, Phi Hung Nguyen, Kanu Sinha +4Reservoir ComputingUniversal Approximation

  9. Universal Function Approximation via Diffractive Optical Processors: Physical Limits, Error Bounds, and Learnability

    Aug 5, 2026Md Sadman Sakib Rahman, Che-Yung Shen, Aydogan OzcanDiffractive Neural NetworksUniversal Approximation

  10. Minimum Block Width for Universal Approximation by Residual Neural Networks with Inner Width One

    Jul 6, 2026Qi Zhou, Xuan Zhou, Xiao-Song YangReLU Neural NetworksResidual Learning

  11. Algorithmic Foundations of Deep Learning: Complexity-Theoretic Rates and a Characterization of Universal Approximation

    Jun 25, 2026Anastasis Kratsios, Simone Brugiapaglia, Bum Jun Kim +2Universal ApproximationNeural Network Approximation Theory

  12. EML Trees Are Universal Approximators

    Jun 22, 2026Joe Germany, Elie Abdo, Joseph BakarjiUniversal ApproximationNeural Network Approximation Theory

  13. Learning universal approximations for partial differential equations with Physics-Informed Broad Learning System

    Jun 18, 2026Zhiwen Yu, Derong Yang, Liujian Zhang +5PDE SolvingUniversal Approximation

  14. Sobolev Approximation by Fixed-Size Neural Networks with Arbitrary Accuracy

    Jun 15, 2026Baicheng Li, Haizhao Yang, Shijun ZhangNeural Network Activation FunctionsUniversal Approximation

  15. Any-Dimensional Invariant Universality

    May 22, 2026Shengtai Yao, Eitan Levin, Mateo DíazUniversal ApproximationNeural Network Approximation Theory

  16. Approximation Theory for Neural Networks: Old and New

    May 20, 2026Soumendu Sundar Mukherjee, Himasish TalukdarUniversal ApproximationNeural Network Approximation Theory

  17. Embedding Dimension Lower Bounds for Universality of Deep Sets and Janossy Pooling

    May 8, 2026Ali Syed, Aditya Nambiar, Jonathan W. SiegelRepresentation LearningDeep Sets

  18. Progressive Approximation in Deep Residual Networks: Theory and Validation

    Apr 27, 2026Wei Wang, Xiao-Yong Wei, Qing LiEfficient Neural Network InferenceResidual Learning

  19. Universal Approximation Constraints of Narrow ResNets: The Tunnel Effect

    Mar 30, 2026Christian Kuehn, Sara-Viola Kuntz, Tobias WöhrerUniversal ApproximationNeural Network Approximation Theory

  20. Neural Networks With Dense Computational Graphs Are Not Universal Approximators

    Feb 7, 2026Levi Rauchwerger, Stefanie Jegelka, Ron LevieNeural Network Approximation TheoryUniversal Approximation

  21. Autonomous-Flow-Based Generation

    Nov 13, 2025Hossein Rouhvarzi, Anastasis KratsiosUniversal ApproximationContinuous Normalizing Flows