mlsanityData to 14 Oct 2026

Solving Ridge Regression using Sketched Preconditioned SVRG

arXiv 1602.02350 ↗First posted 7 Feb 2016cs.LGcited by 15

Not on the map. Why?

Abstract (arXiv)

We develop a novel preconditioning method for ridge regression, based on recent linear sketching methods. By equipping Stochastic Variance Reduced Gradient (SVRG) with this preconditioning process, we obtain a significant speed-up relative to fast stochastic methods such as SVRG, SDCA and SAG.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). First posted on arXiv 7 Feb 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 2; 2022: 1; 2023: 3; 2024: 6; 2025: 1; 2026: 2.

15 papers.

Sort:

  1. 2024Recent and Upcoming Developments in Randomized Numerical Linear Algebra for Machine Learningcited by 11
  2. 2022Stochastic Variance-Reduced Newton: Accelerating Finite-Sum Minimization with Large Batchescited by 9
  3. 2023Robust, randomized preconditioning for kernel ridge regressioncited by 9
  4. 2024Fine-grained Analysis and Faster Algorithms for Iteratively Solving Linear Systemscited by 7
  5. 2021ParK: Sound and Efficient Kernel Ridge Regression by Feature Space Partitionscited by 6
  6. 2024Faster Linear Systems and Matrix Norm Approximation via Multi-level Sketched Preconditioningcited by 4
  7. 2024Revisiting Matrix Sketching in Linear Bandits: Achieving Sublinear Regret via Dyadic Block Sketchingcited by 4
  8. 2026Decoupling Variance and Scale-Invariant Updates in Adaptive Gradient Descent for Unified Vector and Matrix Optimizationcited by 4
  9. 2024Improving Implicit Regularization of SGD with Preconditioning for Least Square Problemscited by 3
  10. 2024Second-order Information Promotes Mini-Batch Robustness in Variance-Reduced Gradientscited by 3
  11. 2021Faster Randomized Methods for Orthogonality Constrained Problemscited by 2
  12. 2025Approaching Optimality for Solving Dense Linear Systems with Low-Rank Structurecited by 2
3 more
  1. 2023Sharpened Lazy Incremental Quasi-Newton Methodcited by 1
  2. 2023On the Noise Sensitivity of the Randomized SVDcited by 0
  3. 2026The Advantages of Fresh Sketching for Ridge Regressioncited by 0