mlsanityData to 7 Oct 2026

Configuration-Dependent Lower Bounds for Approximation by Shallow ReLUk Networks on the Sphere

arXiv 2510.04060 ↗First posted 5 Oct 2025math.NA cs.LG cs.NAcited by 1

Not on the map. Why?

Abstract (arXiv)

We establish two related but logically distinct results for shallow ReLUk neural networks on the unit sphere SSd. First, for an arbitrary set of inner neural-network parameters, the best L2(SSd) approximation of a fixed target function with smoothness r>tfracd+2k+12 admits an asymptotic lower bound given by a constant multiple of n-1/2underlinehk+1/2, where underlineh denotes the antipodal separation distance of the normalized inner-parameter set. This lower bound depends explicitly on the parameter configuration through underlineh and applies without additional assumptions on the parameters. Second, for antipodally quasi-uniform parameters, underlinehsimeq n-1/d, and the lower bound establishes the exact saturation order n^-fracd+2k+12d for such parameter families: a target function with regularity greater than fracd+2k+12 and satisfying the required parity condition can be approximated at this rate, whereas approximation at any strictly faster rate forces the target function to be zero. Our results therefore place linearized neural-network approximation within the classical saturation framework and show that, although ReLUk network spaces can outperform finite elements of the same degree, this advantage is intrinsically limited.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 9 of its 39 references that are in the map. First posted on arXiv 5 Oct 2025.

Builds on

9 of 39 references.

References · 9

  1. 2016Error bounds for approximations with deep ReLU networkscited by 567
  2. 2014Breaking the Curse of Dimensionality with Convex Neural Networkscited by 329
  3. 2021Sharp Bounds on the Approximation Rates, Metric Entropy, and n-widths of Shallow Neural Networkscited by 86
  4. 2016Approximation by Combinations of ReLU and Squared ReLU Ridge Functions with ℓ1 and ℓ0 Controlscited by 84
  5. 2023Rates of Approximation by ReLU Shallow Neural Networkscited by 12
  6. 2023Optimal Approximation of Zonoids and Uniform Approximation by Shallow Neural Networkscited by 11
  7. 2023Expressivity and Approximation Properties of Deep Neural Networks with ReLUk Activationcited by 8
  8. 2024Approximation Rates for Shallow ReLUk Neural Networks on Sobolev Spaces via the Radon Transformcited by 6
  9. 2023Tractability of approximation by general shallow networkscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.