Penalized deep neural networks estimator with general loss functions under weak dependence
Not on the map. Why?
Abstract (arXiv)
This paper carries out sparse-penalized deep neural networks predictors for learning weakly dependent processes, with a broad class of loss functions. We deal with a general framework that includes, regression estimation, classification, times series prediction, cdots The psi-weak dependence structure is considered, and for the specific case of bounded observations, θ_∞-coefficients are also used. In this case of θ_∞-weakly dependent, a non asymptotic generalization bound within the class of deep neural networks predictors is provided. For learning both psi and θ_∞-weakly dependent processes, oracle inequalities for the excess risk of the sparse-penalized deep neural networks estimators are established. When the target function is sufficiently smooth, the convergence rate of these excess risk is close to O(n-1/3). Some simulation results are provided, and application to the forecast of the particulate matter in the Vit'oria metropolitan area is also considered.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 13 of its 26 references that are in the map. First posted on arXiv 10 May 2023.
Builds on
13 of 26 references.
References · 13
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017Nonparametric regression using deep neural networks with ReLU activation functioncited by 431
- 2019Deep ReLU network approximation of functions on a manifoldcited by 73
- 2018Fast convergence rates of deep neural networks for classificationcited by 46
- 2019Smooth function approximation by deep neural networks with general activation functionscited by 29
- 2020Nonconvex sparse regularization for deep neural networks and its optimalitycited by 21
- 2020Advantage of Deep Neural Networks for Estimating Functions with Singularity on Hypersurfacescited by 17
- 2022Theoretical analysis of deep neural networks for temporally dependent observationscited by 16
- 2020On the rate of convergence of a deep recurrent neural network estimate in a regression problem with dependent datacited by 14
- 2020Estimation error analysis of deep learning on the regression problem on the variable exponent Besov spacecited by 13
- 2022Adaptive deep learning for nonlinear time series modelscited by 11
- 2023Excess risk bound for deep learning under weak dependencecited by 9
1 more
Built on by
Citing papers per year: 2024: 2.
2 papers.