Error bounds for deep ReLU networks using the Kolmogorov--Arnold superposition theorem
Not on the map. Why?
Abstract (arXiv)
We prove a theorem concerning the approximation of multivariate functions by deep ReLU networks, for which the curse of the dimensionality is lessened. Our theorem is based on a constructive proof of the Kolmogorov--Arnold superposition theorem, and on a subset of multivariate continuous functions whose outer superposition functions can be efficiently approximated by deep ReLU networks.
Key facts. Cited by 49 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 5; 2023: 8; 2024: 8; 2025: 9; 2026: 8.
49 papers.
Sort:
- 2024KAN: Kolmogorov-Arnold Networkscited by 634
- 2023Specformer: Spectral Graph Neural Networks Meet Transformerscited by 102
- 2021On the approximation of functions by tanh neural networkscited by 81
- 2024A Survey on Kolmogorov-Arnold Networkcited by 67
- 2022ExSpliNet: An interpretable and expressive spline-based neural networkcited by 33
- 2023Deep Network Approximation: Beyond ReLU to Diverse Activation Functionscited by 33
- 2021Besov Function Approximation and Binary Classification on Low-Dimensional Manifolds Using Convolutional Residual Networkscited by 32
- 2024Physics Informed Kolmogorov-Arnold Neural Networks for Dynamical Analysis via Efficent-KAN and WAV-KANcited by 25
- 2021Reproducing Activation Function for Deep Learningcited by 19
- 2023On the Kolmogorov neural networkscited by 19
- 2022Neural Network Architecture Beyond Width and Depthcited by 17
- 2021The Discovery of Dynamics via Linear Multistep Methods and Deep Learning: Error Estimationcited by 14
37 more
- 2021Convergence of Deep ReLU Networkscited by 14
- 2021Convergence of Deep Convolutional Neural Networkscited by 13
- 2023On the Optimal Expressive Power of ReLU DNNs and Its Application in Approximation with Kolmogorov Superposition Theoremcited by 13
- 2021Solving PDEs on Unknown Manifolds with Machine Learningcited by 12
- 2021Deep Network Approximation in Terms of Intrinsic Parameterscited by 12
- 2024KANICE: Kolmogorov-Arnold Networks with Interactive Convolutional Elementscited by 12
- 2023Deep Nonparametric Estimation of Intrinsic Data Structures by Chart Autoencoders: Generalization Error and Robustnesscited by 10
- 2021Stationary Density Estimation of Ito Diffusions Using Deep Learningcited by 9
- 2021Deep Neural Networks with ReLU-Sine-Exponential Activations Break Curse of Dimensionality in Approximation on H"older Classcited by 7
- 2022Benefits of Overparameterized Convolutional Residual Networks: Function Approximation under Smoothness Constraintcited by 6
- 2023On Enhancing Expressive Power via Compositions of Single Fixed-Size ReLU Networkcited by 6
- 2023Uniform Convergence of Deep Neural Networks with Lipschitz Continuous Activation Functions and Variable Widthscited by 5
- 2024KAN we improve on HEP classification tasks? Kolmogorov-Arnold Networks applied to an LHC physics examplecited by 4
- 2025Fourier Multi-Component and Multi-Layer Neural Networks: Unlocking High-Frequency Potentialcited by 4
- 2025KAC: Kolmogorov-Arnold Classifier for Continual Learningcited by 4
- 2024Structured and Balanced Multi-Component and Multi-Layer Neural Networkscited by 3
- 2021Analysis of Structured Deep Kernel Networkscited by 2
- 2023Approximating Langevin Monte Carlo with ResNet-like Neural Network architecturescited by 2
- 2025Distance-Aware Error for Spline Networks: A Bottom-Up Approach to Uncertaintycited by 2
- 2024Generative Modeling: A Reviewcited by 2
- 2025Concurrent training methods for Kolmogorov-Arnold networks: Disjoint datasets and FPGA implementationcited by 2
- 2022Convergence Analysis of Deep Residual Networkscited by 1
- 2025Kolmogorov GAM Networks are all you need!cited by 1
- 2025A Kolmogorov-Arnold Neural Model for Cascading Extremescited by 1
- 2026Multigrade Neural Network Approximationcited by 1
- 2026Layer-wise Lipschitz-Product Control for Deep Kolmogorov--Arnold Network Representations of Compositionally Structured Functionscited by 1
- 2022Convergence of Deep Neural Networks with General Activation Functions and Poolingcited by 0
- 2024Learnability of high-dimensional targets by two-parameter models and gradient flowcited by 0
- 2025Identifying Unknown Stochastic Dynamics via Finite expression methodscited by 0
- 2025Worst-Case Distance-Aware Error Bounds for Neural Networkscited by 0
- 2025Kolmogorov-Arnold graph neural networks for chemically informed prediction tasks on inorganic nanomaterialscited by 0
- 2026Fully Kolmogorov-Arnold Deep Model in Medical Image Segmentationcited by 0
- 2026Geometric Kolmogorov--Arnold Network (GeoKAN)cited by 0
- 2026Adaptive RBF-KAN: A Comparative Evaluation of Dynamic Shape Parameters in Kolmogorov-Arnold Networkscited by 0
- 2026Deep Learning for Reflected BSDEs: Regularization and Error Analysiscited by 0
- 2026Neural Approximation by Function Composition: Rigidity and Doubly Exponential Convergencecited by 0
- 2026SW-KAN: Kolmogorov-Arnold Networks with Stieltjes-Wigert q-Orthogonal Polynomialscited by 0
- 2026Neural Approximation by Function Composition: Rigidity and Doubly Exponential Convergence22 Sep 2026
- 2026SW-KAN: Kolmogorov-Arnold Networks with Stieltjes-Wigert q-Orthogonal Polynomials3 Sep 2026
- 2026Deep Learning for Reflected BSDEs: Regularization and Error Analysis27 Jun 2026
- 2026Adaptive RBF-KAN: A Comparative Evaluation of Dynamic Shape Parameters in Kolmogorov-Arnold Networks20 May 2026
- 2026Geometric Kolmogorov--Arnold Network (GeoKAN)7 May 2026
- 2026Layer-wise Lipschitz-Product Control for Deep Kolmogorov--Arnold Network Representations of Compositionally Structured Functions29 Apr 2026
- 2026Fully Kolmogorov-Arnold Deep Model in Medical Image Segmentation3 Feb 2026
- 2026Multigrade Neural Network Approximation23 Jan 2026
- 2025Kolmogorov-Arnold graph neural networks for chemically informed prediction tasks on inorganic nanomaterials22 Dec 2025
- 2025Concurrent training methods for Kolmogorov-Arnold networks: Disjoint datasets and FPGA implementation21 Dec 2025
- 2025Worst-Case Distance-Aware Error Bounds for Neural Networks24 Oct 2025
- 2025A Kolmogorov-Arnold Neural Model for Cascading Extremes19 May 2025
37 more
- 2025Identifying Unknown Stochastic Dynamics via Finite expression methods9 Apr 2025
- 2025KAC: Kolmogorov-Arnold Classifier for Continual Learning27 Mar 2025
- 2025Fourier Multi-Component and Multi-Layer Neural Networks: Unlocking High-Frequency Potential26 Feb 2025
- 2025Distance-Aware Error for Spline Networks: A Bottom-Up Approach to Uncertainty8 Jan 2025
- 2025Kolmogorov GAM Networks are all you need!1 Jan 2025
- 2024Generative Modeling: A Review24 Dec 2024
- 2024A Survey on Kolmogorov-Arnold Network9 Nov 2024
- 2024KANICE: Kolmogorov-Arnold Networks with Interactive Convolutional Elements22 Oct 2024
- 2024KAN we improve on HEP classification tasks? Kolmogorov-Arnold Networks applied to an LHC physics example5 Aug 2024
- 2024Physics Informed Kolmogorov-Arnold Neural Networks for Dynamical Analysis via Efficent-KAN and WAV-KAN25 Jul 2024
- 2024Structured and Balanced Multi-Component and Multi-Layer Neural Networks30 Jun 2024
- 2024KAN: Kolmogorov-Arnold Networks30 Apr 2024
- 2024Learnability of high-dimensional targets by two-parameter models and gradient flow26 Feb 2024
- 2023Approximating Langevin Monte Carlo with ResNet-like Neural Network architectures6 Nov 2023
- 2023On the Kolmogorov neural networks31 Oct 2023
- 2023On the Optimal Expressive Power of ReLU DNNs and Its Application in Approximation with Kolmogorov Superposition Theorem10 Aug 2023
- 2023Deep Network Approximation: Beyond ReLU to Diverse Activation Functions13 Jul 2023
- 2023Uniform Convergence of Deep Neural Networks with Lipschitz Continuous Activation Functions and Variable Widths2 Jun 2023
- 2023Deep Nonparametric Estimation of Intrinsic Data Structures by Chart Autoencoders: Generalization Error and Robustness17 Mar 2023
- 2023Specformer: Spectral Graph Neural Networks Meet Transformers2 Mar 2023
- 2023On Enhancing Expressive Power via Compositions of Single Fixed-Size ReLU Network29 Jan 2023
- 2022Benefits of Overparameterized Convolutional Residual Networks: Function Approximation under Smoothness Constraint9 Jun 2022
- 2022Neural Network Architecture Beyond Width and Depth19 May 2022
- 2022Convergence Analysis of Deep Residual Networks13 May 2022
- 2022Convergence of Deep Neural Networks with General Activation Functions and Pooling13 May 2022
- 2022ExSpliNet: An interpretable and expressive spline-based neural network3 May 2022
- 2021Deep Network Approximation in Terms of Intrinsic Parameters15 Nov 2021
- 2021Convergence of Deep Convolutional Neural Networks28 Sep 2021
- 2021Stationary Density Estimation of Ito Diffusions Using Deep Learning9 Sep 2021
- 2021Besov Function Approximation and Binary Classification on Low-Dimensional Manifolds Using Convolutional Residual Networks7 Sep 2021
- 2021Convergence of Deep ReLU Networks27 Jul 2021
- 2021Solving PDEs on Unknown Manifolds with Machine Learning12 Jun 2021
- 2021Analysis of Structured Deep Kernel Networks15 May 2021
- 2021On the approximation of functions by tanh neural networks18 Apr 2021
- 2021The Discovery of Dynamics via Linear Multistep Methods and Deep Learning: Error Estimation21 Mar 2021
- 2021Deep Neural Networks with ReLU-Sine-Exponential Activations Break Curse of Dimensionality in Approximation on H"older Class28 Feb 2021
- 2021Reproducing Activation Function for Deep Learning13 Jan 2021
- 2024KAN: Kolmogorov-Arnold Networkscited by 634
- 2023Specformer: Spectral Graph Neural Networks Meet Transformerscited by 102
- 2021On the approximation of functions by tanh neural networkscited by 81
- 2024A Survey on Kolmogorov-Arnold Networkcited by 67
- 2022ExSpliNet: An interpretable and expressive spline-based neural networkcited by 33
- 2023Deep Network Approximation: Beyond ReLU to Diverse Activation Functionscited by 33
- 2021Besov Function Approximation and Binary Classification on Low-Dimensional Manifolds Using Convolutional Residual Networkscited by 32
- 2024Physics Informed Kolmogorov-Arnold Neural Networks for Dynamical Analysis via Efficent-KAN and WAV-KANcited by 25
- 2021Reproducing Activation Function for Deep Learningcited by 19
- 2023On the Kolmogorov neural networkscited by 19
- 2022Neural Network Architecture Beyond Width and Depthcited by 17
- 2021The Discovery of Dynamics via Linear Multistep Methods and Deep Learning: Error Estimationcited by 14
12 most cited of 49 All 49 (JSON)
- 2026Neural Approximation by Function Composition: Rigidity and Doubly Exponential Convergence22 Sep 2026
- 2026SW-KAN: Kolmogorov-Arnold Networks with Stieltjes-Wigert q-Orthogonal Polynomials3 Sep 2026
- 2026Deep Learning for Reflected BSDEs: Regularization and Error Analysis27 Jun 2026
- 2026Adaptive RBF-KAN: A Comparative Evaluation of Dynamic Shape Parameters in Kolmogorov-Arnold Networks20 May 2026
- 2026Geometric Kolmogorov--Arnold Network (GeoKAN)7 May 2026
- 2026Layer-wise Lipschitz-Product Control for Deep Kolmogorov--Arnold Network Representations of Compositionally Structured Functions29 Apr 2026
- 2026Fully Kolmogorov-Arnold Deep Model in Medical Image Segmentation3 Feb 2026
- 2026Multigrade Neural Network Approximation23 Jan 2026
- 2025Kolmogorov-Arnold graph neural networks for chemically informed prediction tasks on inorganic nanomaterials22 Dec 2025
- 2025Concurrent training methods for Kolmogorov-Arnold networks: Disjoint datasets and FPGA implementation21 Dec 2025
- 2025Worst-Case Distance-Aware Error Bounds for Neural Networks24 Oct 2025
- 2025A Kolmogorov-Arnold Neural Model for Cascading Extremes19 May 2025
12 newest of 49 All 49 (JSON)