mlsanityData to 7 Oct 2026

Space-Time Approximation with Shallow Neural Networks in Fourier Lebesgue spaces

arXiv 2312.08461 ↗First posted 13 Dec 2023cs.LG math.FA stat.MLcited by 5

Not on the map. Why?

Abstract (arXiv)

Approximation capabilities of shallow neural networks (SNNs) form an integral part in understanding the properties of deep neural networks (DNNs). In the study of these approximation capabilities some very popular classes of target functions are the so-called spectral Barron spaces. This spaces are of special interest when it comes to the approximation of partial differential equation (PDE) solutions. It has been shown that the solution of certain static PDEs will lie in some spectral Barron space. In order to alleviate the limitation to static PDEs and include a time-domain that might have a different regularity than the space domain, we extend the notion of spectral Barron spaces to anisotropic weighted Fourier-Lebesgue spaces. In doing so, we consider target functions that have two blocks of variables, among which each block is allowed to have different decay and integrability properties. For these target functions we first study the inclusion of anisotropic weighted Fourier-Lebesgue spaces in the Bochner-Sobolev spaces. With that we can now also measure the approximation error in terms of an anisotropic Sobolev norm, namely the Bochner-Sobolev norm. We use this observation in a second step where we establish a bound on the approximation rate for functions from the anisotropic weighted Fourier-Lebesgue spaces and approximation via SNNs in the Bochner-Sobolev norm.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 18 of its 57 references that are in the map. First posted on arXiv 13 Dec 2023.

Builds on

18 of 57 references.

References · 18

  1. 2014Breaking the Curse of Dimensionality with Convex Neural Networkscited by 329
  2. 2020Implicit Bias of Gradient Descent for Wide Two-layer Neural Networks Trained with the Logistic Losscited by 267
  3. 2019A Function Space View of Bounded Norm Infinite Width ReLU Nets: The Multivariate Casecited by 113
  4. 2019How do infinite width bounded norm networks look in function space?cited by 105
  5. 2021Sharp Bounds on the Approximation Rates, Metric Entropy, and n-widths of Shallow Neural Networkscited by 86
  6. 2016Approximation by Combinations of ReLU and Squared ReLU Ridge Functions with ℓ1 and ℓ0 Controlscited by 84
  7. 2020Representation formulas and pointwise properties for Barron functionscited by 62
  8. 2021Characterization of the Variation Spaces Corresponding to Shallow Neural Networkscited by 48
  9. 2021Random feature neural networks learn Black-Scholes type PDEs without curse of dimensionalitycited by 34
  10. 2020Neural network approximation and estimation of classifiers with classification boundary in a Barron classcited by 28
  11. 2016Risk Bounds for High-dimensional Ridge Function Combinations Including Neural Networkscited by 26
  12. 2021On the Representation of Solutions to Elliptic PDEs in Barron Spacescited by 25
6 more
  1. 2020Complexity Measures for Neural Networks with General Activation Functions Using Path-based Normscited by 19
  2. 2021A Priori Generalization Error Analysis of Two-Layer Neural Networks for Solving High Dimensional Schr"odinger Eigenvalue Problemscited by 19
  3. 2022Neural Network Approximations of PDEs Beyond Linearity: A Representational Perspectivecited by 15
  4. 2022Lp sampling numbers for the Fourier-analytic Barron spacecited by 6
  5. 2021Integral representations of shallow neural network with Rectified Power Unit activation functioncited by 2
  6. 2023Bochner integrals and neural networkscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 1; 2025: 1; 2026: 2.

5 papers.