Statistical Optimality of Divide and Conquer Kernel-based Functional Linear Regression
Not on the map. Why?
Abstract (arXiv)
Previous analysis of regularized functional linear regression in a reproducing kernel Hilbert space (RKHS) typically requires the target function to be contained in this kernel space. This paper studies the convergence performance of divide-and-conquer estimators in the scenario that the target function does not necessarily reside in the underlying RKHS. As a decomposition-based scalable approach, the divide-and-conquer estimators of functional linear regression can substantially reduce the algorithmic complexities in time and memory. We develop an integral operator approach to establish sharp finite sample upper bounds for prediction with divide-and-conquer estimators under various regularity conditions of explanatory variables and target function. We also prove the asymptotic optimality of the derived rates by building the mini-max lower bounds. Finally, we consider the convergence of noiseless estimators and show that the rates can be arbitrarily fast under mild conditions.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 16 of its 47 references that are in the map. First posted on arXiv 20 Nov 2022.
Builds on
16 of 47 references.
References · 16
- 2018Gaussian Processes and Kernel Methods: A Review on Connections and Equivalencescited by 192
- 2017Sobolev Norm Learning Rates for Regularized Least-Squares Algorithmcited by 114
- 2018Statistical Optimality of Stochastic Gradient Descent on Hard Learning Problems through Multiple Passescited by 69
- 2016Optimal Rates For Regularization Of Statistical Inverse Learning Problemscited by 68
- 2013Divide and Conquer Kernel Ridge Regression: A Distributed Algorithm with Minimax Optimal Ratescited by 65
- 2018Optimal Rates for Spectral Algorithms with Least-Squares Regression over Hilbert Spacescited by 59
- 2014Learning Theory for Distribution Regressioncited by 48
- 2016Distributed learning with regularized least squarescited by 42
- 2020Tight Nonparametric Convergence Rates for Stochastic Gradient Descent under the Noiseless Linear Modelcited by 39
- 2018Optimal Convergence for Distributed Learning with Stochastic Gradient Methods and Spectral Algorithmscited by 22
- 2022Distribution Regression with Sliced Wasserstein Kernelscited by 18
- 2019Kernel Truncated Randomized Ridge Regression: Optimal Rates and Low Noise Accelerationcited by 12
4 more
- 2022Capacity dependent analysis for functional online learning algorithmscited by 10
- 2020Optimal Rates of Distributed Regression with Imperfect Kernelscited by 3
- 2022Coefficient-based Regularized Distribution Regressioncited by 2
- 2021Optimal prediction for kernel-based semi-functional linear regressioncited by 1
Built on by
Citing papers per year: 2023: 4; 2024: 2; 2025: 2.
8 papers.
- 2023On the Optimality of Misspecified Spectral Algorithmscited by 28
- 2023On the Optimality of Misspecified Kernel Ridge Regressioncited by 20
- 2025Learning Curves of Stochastic Gradient Descent in Kernel Regressioncited by 4
- 2023Distributed Gradient Descent for Functional Learningcited by 2
- 2023On regularized polynomial functional regressioncited by 1
- 2024Spectral Algorithms on Manifolds through Diffusioncited by 1
- 2024Distributed Learning with Discretely Observed Functional Datacited by 1
- 2025Theory of Decentralized Robust Kernel-Based Learningcited by 0
- 2025Theory of Decentralized Robust Kernel-Based Learning5 Jun 2025
- 2025Learning Curves of Stochastic Gradient Descent in Kernel Regression28 May 2025
- 2024Distributed Learning with Discretely Observed Functional Data3 Oct 2024
- 2024Spectral Algorithms on Manifolds through Diffusion6 Mar 2024
- 2023On regularized polynomial functional regression6 Nov 2023
- 2023Distributed Gradient Descent for Functional Learning12 May 2023
- 2023On the Optimality of Misspecified Kernel Ridge Regression12 May 2023
- 2023On the Optimality of Misspecified Spectral Algorithms27 Mar 2023