math.NASep 4, 2026

Shallow neural network approximation in mixed Sobolev spaces

Authors: Yuwen Li, Guozhi Zhang

Organizations: School of Mathematical Sciences, Zhejiang University, 866 Yuhangtang Road, Hangzhou 310058, Zhejiang, China

Abstract

We investigate the best L2L_2 approximation of mixed Sobolev spaces by shallow neural networks with nn neurons and general activation functions. We first establish an activation-independent Fourier-block principle: if an activation has univariate approximation order ρρ in the sense of the Fourier-block property, then the global approximation rate has algebraic order min⁡{α,ρ}\min\{α,ρ\} for target functions of mixed smoothness αα, up to explicit logarithmic factors. To verify this property for concrete activations, we introduce a structured univariate approximation condition that implies the Fourier-block property with explicit parameters. For ReLUk\mathrm{ReLU}^k, a matching algebraic lower bound identifies min⁡{α,k+1}\min\{α,k+1\} as the optimal algebraic approximation exponent in any dimension, up to logarithmic factors in the upper bound. The framework also yields the exponent min⁡{α,k+1}\min\{α,k+1\} for cardinal B-splines and soft-ReLUk\mathrm{ReLU}^k, and the full mixed-smoothness exponent αα for ELU and cosine activations, again up to logarithmic~factors.

Figures & tables

Explore similar work

CardsList
  1. Approximation and learning of anisotropic and mixed smooth functions by deep ReLU neural networks

    May 29, 2026Yunfei Yang, Jun FanReLU Neural NetworksNeural Network Approximation Theory

  2. Configuration-Dependent Lower Bounds for Approximation by Shallow ReLUk^k Networks on the Sphere

    Oct 5, 2025Tong Mao, Jinchao XuShallow Neural NetworksNeural Network Approximation Theory

  3. Sobolev Approximation by Fixed-Size Neural Networks with Arbitrary Accuracy

    Jun 15, 2026Baicheng Li, Haizhao Yang, Shijun ZhangNeural Network Activation FunctionsUniversal Approximation