Shallow neural network approximation in mixed Sobolev spaces
Not on the map. Why?
Abstract (arXiv)
We investigate the best L2 approximation of mixed Sobolev spaces by shallow neural networks with n neurons and general activation functions. We first establish an activation-independent Fourier-block principle: if an activation has univariate approximation order ρ in the sense of the Fourier-block property, then the global approximation rate has algebraic order minα,ρ for target functions of mixed smoothness α, up to explicit logarithmic factors. To verify this property for concrete activations, we introduce a structured univariate approximation condition that implies the Fourier-block property with explicit parameters. For ReLUk, a matching algebraic lower bound identifies minα,k+1 as the optimal algebraic approximation exponent in any dimension, up to logarithmic factors in the upper bound. The framework also yields the exponent minα,k+1 for cardinal B-splines and soft-ReLUk, and the full mixed-smoothness exponent α for ELU and cosine activations, again up to logarithmic~factors.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 77 references that are in the map. First posted on arXiv 4 Sep 2026.
Builds on
19 of 77 references.
References · 19
- 2016Error bounds for approximations with deep ReLU networkscited by 567
- 2014Breaking the Curse of Dimensionality with Convex Neural Networkscited by 329
- 2017Optimal approximation of piecewise smooth functions using deep ReLU neural networkscited by 176
- 2018Adaptivity of deep ReLU network for learning in Besov and mixed smooth Besov spaces: optimal rate and curse of dimensionalitycited by 160
- 2019A Function Space View of Bounded Norm Infinite Width ReLU Nets: The Multivariate Casecited by 113
- 2019How do infinite width bounded norm networks look in function space?cited by 105
- 2019Error bounds for approximations with deep ReLU neural networks in Ws,p normscited by 95
- 2017Optimal Approximation with Sparsely Connected Deep Neural Networkscited by 90
- 2021Sharp Bounds on the Approximation Rates, Metric Entropy, and n-widths of Shallow Neural Networkscited by 86
- 2016Approximation by Combinations of ReLU and Squared ReLU Ridge Functions with ℓ1 and ℓ0 Controlscited by 84
- 2019A Theoretical Analysis of Deep Neural Networks and Parametric PDEscited by 74
- 2015Neural Network with Unbounded Activation Functions is Universal Approximatorcited by 63
7 more
- 2020Representation formulas and pointwise properties for Barron functionscited by 62
- 2021Characterization of the Variation Spaces Corresponding to Shallow Neural Networkscited by 48
- 2023Rates of Approximation by ReLU Shallow Neural Networkscited by 12
- 2025Higher Order Approximation Rates for ReLU CNNs in Korobov Spacescited by 4
- 2025Some Super-approximation Rates of ReLU Neural Networks for Korobov Functionscited by 3
- 2026Approximation and learning of anisotropic and mixed smooth functions by deep ReLU neural networkscited by 3
- 2025Configuration-Dependent Lower Bounds for Approximation by Shallow ReLUk Networks on the Spherecited by 1
Built on by
Not cited yet.