Exponential Convergence of the Deep Neural Network Approximation for Analytic Functions
Not on the map. Why?
Abstract (arXiv)
We prove that for analytic functions in low dimension, the convergence rate of the deep neural network approximation is exponential.
Key facts. Cited by 38 papers in the map (data through 14 Oct 2026). First posted on arXiv 1 Jul 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 10; 2023: 6; 2024: 4; 2025: 1; 2026: 5.
38 papers.
Sort:
- 2021Optimal Approximation Rate of ReLU Networks in terms of Width and Depthcited by 96
- 2021On the approximation of functions by tanh neural networkscited by 81
- 2021Deep Network Approximation: Achieving Arbitrary Accuracy with Fixed Number of Neuronscited by 41
- 2022Nonlinear Reconstruction for Operator Learning of PDEs with Discontinuitiescited by 30
- 2021Reproducing Activation Function for Deep Learningcited by 19
- 2021Lyapunov-Net: A Deep Neural Network Architecture for Lyapunov Function Approximationcited by 16
- 2021Convergence of Deep ReLU Networkscited by 15
- 2021Neural Network Approximation of Refinable Functionscited by 15
- 2021Convergence of Deep Convolutional Neural Networkscited by 13
- 2023On the Optimal Expressive Power of ReLU DNNs and Its Application in Approximation with Kolmogorov Superposition Theoremcited by 13
- 2021ReLU Deep Neural Networks from the Hierarchical Basis Perspectivecited by 12
- 2021Solving PDEs on Unknown Manifolds with Machine Learningcited by 12
26 more
- 2022Structural Causal 3D Reconstructioncited by 12
- 2024Random Projection Neural Networks of Best Approximation: Convergence theory and practical applicationscited by 11
- 2021Deep Neural Networks with ReLU-Sine-Exponential Activations Break Curse of Dimensionality in Approximation on H"older Classcited by 7
- 2022Embedding Principle in Depth for the Loss Landscape Analysis of Deep Neural Networkscited by 7
- 2022Physics-Informed Neural Network Method for Parabolic Differential Equations with Sharply Perturbed Initial Conditionscited by 7
- 2024Learning smooth functions in high dimensions: from sparse polynomials to deep neural networkscited by 7
- 2023Better NTK Conditioning: A Free Lunch from (ReLU) Nonlinear Activation in Wide Neural Networkscited by 6
- 2023Uniform Convergence of Deep Neural Networks with Lipschitz Continuous Activation Functions and Variable Widthscited by 5
- 2022Theoretical guarantees for the advantage of GNNs over NNs in generalizing bandlimited functions on Euclidean cubescited by 4
- 2023What Makes Data Suitable for a Locally Connected Neural Network? A Necessary and Sufficient Condition Based on Quantum Entanglementcited by 4
- 2023Compelling ReLU Networks to Exhibit Exponentially Many Linear Regions at Initialization and During Trainingcited by 4
- 2025One model to solve them all: 2BSDE families via neural operatorscited by 4
- 2021Analytic function approximation by path norm regularized deep networkscited by 3
- 2023Transferability of Graph Neural Networks using Graphon and Sampling Theoriescited by 3
- 2022Qualitative neural network approximation over R and C: Elementary proofs for analytic and polynomial activationcited by 2
- 2024Optimal Neural Network Approximation for High-Dimensional Continuous Functionscited by 2
- 2022Convergence Analysis of Deep Residual Networkscited by 1
- 2022Parameter Convex Neural Networkscited by 1
- 2024N-Adaptive Ritz Method: A Neural Network Enriched Partition of Unity for Boundary Value Problemscited by 1
- 2022A Note on Machine Learning Approach for Computational Imagingcited by 0
- 2022Convergence of Deep Neural Networks with General Activation Functions and Poolingcited by 0
- 2026Efficient Approximation to Analytic and Lp functions by Height-Augmented ReLU Networkscited by 0
- 2026A Composite Activation Function for Learning Stable Binary Representationscited by 0
- 2026Approximation of Analytic Functions by ReLU Neural Networks with Adjustable Depth and Widthcited by 0
- 2026Spectral Convergence of Random Feature Method in Multiple Dimensionscited by 0
- 2026Neural Approximation by Function Composition: Rigidity and Doubly Exponential Convergencecited by 0
- 2026Neural Approximation by Function Composition: Rigidity and Doubly Exponential Convergence22 Sep 2026
- 2026Spectral Convergence of Random Feature Method in Multiple Dimensions3 Sep 2026
- 2026Approximation of Analytic Functions by ReLU Neural Networks with Adjustable Depth and Width12 Jul 2026
- 2026A Composite Activation Function for Learning Stable Binary Representations12 May 2026
- 2026Efficient Approximation to Analytic and Lp functions by Height-Augmented ReLU Networks11 Mar 2026
- 2025One model to solve them all: 2BSDE families via neural operators3 Nov 2025
- 2024Optimal Neural Network Approximation for High-Dimensional Continuous Functions4 Sep 2024
- 2024Learning smooth functions in high dimensions: from sparse polynomials to deep neural networks4 Apr 2024
- 2024Random Projection Neural Networks of Best Approximation: Convergence theory and practical applications17 Feb 2024
- 2024N-Adaptive Ritz Method: A Neural Network Enriched Partition of Unity for Boundary Value Problems16 Jan 2024
- 2023Compelling ReLU Networks to Exhibit Exponentially Many Linear Regions at Initialization and During Training29 Nov 2023
- 2023On the Optimal Expressive Power of ReLU DNNs and Its Application in Approximation with Kolmogorov Superposition Theorem10 Aug 2023
26 more
- 2023Transferability of Graph Neural Networks using Graphon and Sampling Theories25 Jul 2023
- 2023Uniform Convergence of Deep Neural Networks with Lipschitz Continuous Activation Functions and Variable Widths2 Jun 2023
- 2023Better NTK Conditioning: A Free Lunch from (ReLU) Nonlinear Activation in Wide Neural Networks15 May 2023
- 2023What Makes Data Suitable for a Locally Connected Neural Network? A Necessary and Sufficient Condition Based on Quantum Entanglement20 Mar 2023
- 2022Nonlinear Reconstruction for Operator Learning of PDEs with Discontinuities3 Oct 2022
- 2022Physics-Informed Neural Network Method for Parabolic Differential Equations with Sharply Perturbed Initial Conditions18 Aug 2022
- 2022Structural Causal 3D Reconstruction20 Jul 2022
- 2022Theoretical guarantees for the advantage of GNNs over NNs in generalizing bandlimited functions on Euclidean cubes13 Jun 2022
- 2022Parameter Convex Neural Networks11 Jun 2022
- 2022Embedding Principle in Depth for the Loss Landscape Analysis of Deep Neural Networks26 May 2022
- 2022Convergence Analysis of Deep Residual Networks13 May 2022
- 2022Convergence of Deep Neural Networks with General Activation Functions and Pooling13 May 2022
- 2022Qualitative neural network approximation over R and C: Elementary proofs for analytic and polynomial activation25 Mar 2022
- 2022A Note on Machine Learning Approach for Computational Imaging24 Feb 2022
- 2021Convergence of Deep Convolutional Neural Networks28 Sep 2021
- 2021Lyapunov-Net: A Deep Neural Network Architecture for Lyapunov Function Approximation27 Sep 2021
- 2021Neural Network Approximation of Refinable Functions28 Jul 2021
- 2021Convergence of Deep ReLU Networks27 Jul 2021
- 2021Deep Network Approximation: Achieving Arbitrary Accuracy with Fixed Number of Neurons6 Jul 2021
- 2021Solving PDEs on Unknown Manifolds with Machine Learning12 Jun 2021
- 2021ReLU Deep Neural Networks from the Hierarchical Basis Perspective10 May 2021
- 2021On the approximation of functions by tanh neural networks18 Apr 2021
- 2021Analytic function approximation by path norm regularized deep networks5 Apr 2021
- 2021Deep Neural Networks with ReLU-Sine-Exponential Activations Break Curse of Dimensionality in Approximation on H"older Class28 Feb 2021
- 2021Optimal Approximation Rate of ReLU Networks in terms of Width and Depth28 Feb 2021
- 2021Reproducing Activation Function for Deep Learning13 Jan 2021
- 2021Optimal Approximation Rate of ReLU Networks in terms of Width and Depthcited by 96
- 2021On the approximation of functions by tanh neural networkscited by 81
- 2021Deep Network Approximation: Achieving Arbitrary Accuracy with Fixed Number of Neuronscited by 41
- 2022Nonlinear Reconstruction for Operator Learning of PDEs with Discontinuitiescited by 30
- 2021Reproducing Activation Function for Deep Learningcited by 19
- 2021Lyapunov-Net: A Deep Neural Network Architecture for Lyapunov Function Approximationcited by 16
- 2021Convergence of Deep ReLU Networkscited by 15
- 2021Neural Network Approximation of Refinable Functionscited by 15
- 2021Convergence of Deep Convolutional Neural Networkscited by 13
- 2023On the Optimal Expressive Power of ReLU DNNs and Its Application in Approximation with Kolmogorov Superposition Theoremcited by 13
- 2021ReLU Deep Neural Networks from the Hierarchical Basis Perspectivecited by 12
- 2021Solving PDEs on Unknown Manifolds with Machine Learningcited by 12
12 most cited of 38 All 38 (JSON)
- 2026Neural Approximation by Function Composition: Rigidity and Doubly Exponential Convergence22 Sep 2026
- 2026Spectral Convergence of Random Feature Method in Multiple Dimensions3 Sep 2026
- 2026Approximation of Analytic Functions by ReLU Neural Networks with Adjustable Depth and Width12 Jul 2026
- 2026A Composite Activation Function for Learning Stable Binary Representations12 May 2026
- 2026Efficient Approximation to Analytic and Lp functions by Height-Augmented ReLU Networks11 Mar 2026
- 2025One model to solve them all: 2BSDE families via neural operators3 Nov 2025
- 2024Optimal Neural Network Approximation for High-Dimensional Continuous Functions4 Sep 2024
- 2024Learning smooth functions in high dimensions: from sparse polynomials to deep neural networks4 Apr 2024
- 2024Random Projection Neural Networks of Best Approximation: Convergence theory and practical applications17 Feb 2024
- 2024N-Adaptive Ritz Method: A Neural Network Enriched Partition of Unity for Boundary Value Problems16 Jan 2024
- 2023Compelling ReLU Networks to Exhibit Exponentially Many Linear Regions at Initialization and During Training29 Nov 2023
- 2023On the Optimal Expressive Power of ReLU DNNs and Its Application in Approximation with Kolmogorov Superposition Theorem10 Aug 2023
12 newest of 38 All 38 (JSON)