A three layer neural network can represent any multivariate function
Not on the map. Why?
Abstract (arXiv)
In 1987, Hecht-Nielsen showed that any continuous multivariate function can be implemented by a certain type three-layer neural network. This result was very much discussed in neural network literature. In this paper we prove that not only continuous functions but also all discontinuous functions can be implemented by such neural networks.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). First posted on arXiv 5 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 1; 2023: 2; 2024: 2; 2025: 2; 2026: 2.
10 papers.
- 2021Physics-enhanced deep surrogates for partial differential equationscited by 18
- 2022JAX-DIPS: Neural bootstrapping of finite discretization methods and application to elliptic problems with discontinuitiescited by 7
- 2023Conformalized Deep Splines for Optimal and Efficient Prediction Setscited by 5
- 2024On the Anatomy of Attentioncited by 3
- 2025Distance-Aware Error for Spline Networks: A Bottom-Up Approach to Uncertaintycited by 2
- 2023Data Topology-Dependent Upper Bounds of Neural Network Widthscited by 1
- 2024Generalizable autoregressive modeling of time series through functional narrativescited by 1
- 2025Kolmogorov GAM Networks are all you need!cited by 1
- 2026SharpNet: Enhancing MLPs to Represent Functions with Controlled Non-differentiabilitycited by 0
- 2026Structure-Preserving Reconstruction of Convex Lipschitz Functionals on Hilbert Spaces from Finite Samplescited by 0
- 2026Structure-Preserving Reconstruction of Convex Lipschitz Functionals on Hilbert Spaces from Finite Samples8 May 2026
- 2026SharpNet: Enhancing MLPs to Represent Functions with Controlled Non-differentiability27 Jan 2026
- 2025Distance-Aware Error for Spline Networks: A Bottom-Up Approach to Uncertainty8 Jan 2025
- 2025Kolmogorov GAM Networks are all you need!1 Jan 2025
- 2024Generalizable autoregressive modeling of time series through functional narratives10 Oct 2024
- 2024On the Anatomy of Attention2 Jul 2024
- 2023Conformalized Deep Splines for Optimal and Efficient Prediction Sets1 Nov 2023
- 2023Data Topology-Dependent Upper Bounds of Neural Network Widths25 May 2023
- 2022JAX-DIPS: Neural bootstrapping of finite discretization methods and application to elliptic problems with discontinuities25 Oct 2022
- 2021Physics-enhanced deep surrogates for partial differential equations10 Nov 2021