Sobolev Approximation of Deep ReLU Networks in Log-Barron Space
Not on the map. Why?
Abstract (arXiv)
Universal approximation theorems show that neural networks can approximate any continuous function; however, the number of parameters may grow exponentially with the ambient dimension, so these results do not fully explain the practical success of deep models on high-dimensional data. Barron space theory addresses this: if a target function belongs to a Barron space, a two-layer network with n parameters achieves an O(n-1/2) approximation error in L2. Yet classical Barron spaces mathscrBs+1 still require stronger regularity than Sobolev spaces Hs, and existing depth-sensitive results often assume constraints such as sL ≤ 1/2. In this paper, we introduce a log-weighted Barron space mathscrBlog, which requires a strictly weaker assumption than mathscrBs for any s>0. For this new function space, we first study embedding properties and carry out a statistical analysis via the Rademacher complexity. Then we prove that functions in mathscrBlog can be approximated by deep ReLU networks with explicit depth dependence. We then define a family mathscrBs,log, establish approximation bounds in the H1 norm, and identify maximal depth scales under which these rates are preserved. Our results clarify how depth reduces regularity requirements for efficient representation, offering a more precise explanation for the performance of deep architectures beyond the classical Barron setting, and for their stable use in high-dimensional problems used today.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 11 of its 26 references that are in the map. First posted on arXiv 3 Jan 2026.
Builds on
11 of 26 references.
References · 11
- 2016Error bounds for approximations with deep ReLU networkscited by 567
- 2017The Expressive Power of Neural Networks: A View from the Widthcited by 318
- 2016Benefits of depth in neural networkscited by 248
- 2019Universal Approximation with Deep Narrow Networkscited by 198
- 2016Why and When Can Deep -- but Not Shallow -- Networks Avoid the Curse of Dimensionality: a Reviewcited by 155
- 2020Minimum Width for Universal Approximationcited by 92
- 2021Sharp Bounds on the Approximation Rates, Metric Entropy, and n-widths of Shallow Neural Networkscited by 86
- 2020Representation formulas and pointwise properties for Barron functionscited by 62
- 2021On the Representation of Solutions to Elliptic PDEs in Barron Spacescited by 25
- 2022A general approximation lower bound in Lp norm, with applications to feed-forward neural networkscited by 12
- 2023Neural Hilbert Ladders: Multi-Layer Neural Networks in Function Spacecited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.