mlsanityData to 14 Oct 2026

Statistical Optimality of Divide and Conquer Kernel-based Functional Linear Regression

arXiv 2211.10968 ↗First posted 20 Nov 2022stat.ML cs.LGcited by 8

Not on the map. Why?

Abstract (arXiv)

Previous analysis of regularized functional linear regression in a reproducing kernel Hilbert space (RKHS) typically requires the target function to be contained in this kernel space. This paper studies the convergence performance of divide-and-conquer estimators in the scenario that the target function does not necessarily reside in the underlying RKHS. As a decomposition-based scalable approach, the divide-and-conquer estimators of functional linear regression can substantially reduce the algorithmic complexities in time and memory. We develop an integral operator approach to establish sharp finite sample upper bounds for prediction with divide-and-conquer estimators under various regularity conditions of explanatory variables and target function. We also prove the asymptotic optimality of the derived rates by building the mini-max lower bounds. Finally, we consider the convergence of noiseless estimators and show that the rates can be arbitrarily fast under mild conditions.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 16 of its 47 references that are in the map. First posted on arXiv 20 Nov 2022.

Builds on

16 of 47 references.

References · 16

  1. 2018Gaussian Processes and Kernel Methods: A Review on Connections and Equivalencescited by 192
  2. 2017Sobolev Norm Learning Rates for Regularized Least-Squares Algorithmcited by 114
  3. 2018Statistical Optimality of Stochastic Gradient Descent on Hard Learning Problems through Multiple Passescited by 69
  4. 2016Optimal Rates For Regularization Of Statistical Inverse Learning Problemscited by 68
  5. 2013Divide and Conquer Kernel Ridge Regression: A Distributed Algorithm with Minimax Optimal Ratescited by 65
  6. 2018Optimal Rates for Spectral Algorithms with Least-Squares Regression over Hilbert Spacescited by 59
  7. 2014Learning Theory for Distribution Regressioncited by 48
  8. 2016Distributed learning with regularized least squarescited by 42
  9. 2020Tight Nonparametric Convergence Rates for Stochastic Gradient Descent under the Noiseless Linear Modelcited by 39
  10. 2018Optimal Convergence for Distributed Learning with Stochastic Gradient Methods and Spectral Algorithmscited by 22
  11. 2022Distribution Regression with Sliced Wasserstein Kernelscited by 18
  12. 2019Kernel Truncated Randomized Ridge Regression: Optimal Rates and Low Noise Accelerationcited by 12
4 more
  1. 2022Capacity dependent analysis for functional online learning algorithmscited by 10
  2. 2020Optimal Rates of Distributed Regression with Imperfect Kernelscited by 3
  3. 2022Coefficient-based Regularized Distribution Regressioncited by 2
  4. 2021Optimal prediction for kernel-based semi-functional linear regressioncited by 1

Built on by

Cited by year

Citing papers per year: 2023: 4; 2024: 2; 2025: 2.

8 papers.