Ridge Regularization: an Essential Concept in Data Science
Not on the map. Why?
Abstract (arXiv)
Ridge or more formally ℓ2 regularization shows up in many areas of statistics and machine learning. It is one of those essential devices that any good data scientist needs to master for their craft. In this brief ridge fest I have collected together some of the magic and beauty of ridge that my colleagues and I have encountered over the past 40 years in applied statistics.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 2; 2023: 3; 2024: 5; 2025: 3; 2026: 4.
19 papers.
Sort:
By area:
- 2023Intriguing Properties of Data Attribution on Diffusion Modelscited by 47
- 2024Diffusion Attribution Score: Evaluating Training Data Influence in Diffusion Modelscited by 21
- 2023Subsample Ridge Ensembles: Equivalences and Generalized Cross-Validationcited by 11
- 2023Generalized equivalences between subsampling and ridge regularizationcited by 10
- 2024Failures and Successes of Cross-Validation for Early-Stopped Gradient Descentcited by 4
- 2024Precision Cancer Classification and Biomarker Identification from mRNA Gene Expression via Dimensionality Reduction and Explainable AIcited by 2
- 2022Smooth Nested Simulation: Bridging Cubic and Square Root Convergence Rates in High Dimensionscited by 1
- 2025When majority rules, minority loses: bias amplification of gradient descentcited by 1
- 2025SLIM-LLMs: Modeling of Style-Sensory Language RelationshipsThrough Low-Dimensional Representationscited by 1
- 2026Efficient Benchmarking Is Just Feature Selection and Multiple Regressioncited by 1
- 2021The Efficient Shrinkage Path: Maximum Likelihood of Minimum MSE Riskcited by 0
- 2021InfoGram and Admissible Machine Learningcited by 0
7 more
- 2022Smart Journey in Istanbul: A Mobile Application in Smart Cities for Traffic Estimation by Harnessing Time Seriescited by 0
- 2024LiteNeXt: A Novel Lightweight ConvMixer-based Model with Self-embedding Representation Parallel for Medical Image Segmentationcited by 0
- 2024Model-free Distortion Canceling and Control of Quantum Devicescited by 0
- 2025Helix 1.0: An Open-Source Framework for Reproducible and Interpretable Machine Learning on Tabular Scientific Datacited by 0
- 2026Finite-Sample Inference for Sparsely Permuted Linear Regressioncited by 0
- 2026Statistical comparisons of time-series feature sets on classification taskscited by 0
- 2026QuaSAR: Quantization Compensation via Stable Activation-Aware Rank Truncationcited by 0
- 2026QuaSAR: Quantization Compensation via Stable Activation-Aware Rank Truncation14 Aug 2026
- 2026Statistical comparisons of time-series feature sets on classification tasks3 Aug 2026
- 2026Efficient Benchmarking Is Just Feature Selection and Multiple Regression25 May 2026
- 2026Finite-Sample Inference for Sparsely Permuted Linear Regression21 Jan 2026
- 2025SLIM-LLMs: Modeling of Style-Sensory Language RelationshipsThrough Low-Dimensional Representations4 Aug 2025
- 2025Helix 1.0: An Open-Source Framework for Reproducible and Interpretable Machine Learning on Tabular Scientific Data23 Jul 2025
- 2025When majority rules, minority loses: bias amplification of gradient descent19 May 2025
- 2024Diffusion Attribution Score: Evaluating Training Data Influence in Diffusion Models24 Oct 2024
- 2024Precision Cancer Classification and Biomarker Identification from mRNA Gene Expression via Dimensionality Reduction and Explainable AI8 Oct 2024
- 2024Model-free Distortion Canceling and Control of Quantum Devices13 Jul 2024
- 2024LiteNeXt: A Novel Lightweight ConvMixer-based Model with Self-embedding Representation Parallel for Medical Image Segmentation4 Apr 2024
- 2024Failures and Successes of Cross-Validation for Early-Stopped Gradient Descent26 Feb 2024
7 more
- 2023Intriguing Properties of Data Attribution on Diffusion Models1 Nov 2023
- 2023Generalized equivalences between subsampling and ridge regularization29 May 2023
- 2023Subsample Ridge Ensembles: Equivalences and Generalized Cross-Validation25 Apr 2023
- 2022Smart Journey in Istanbul: A Mobile Application in Smart Cities for Traffic Estimation by Harnessing Time Series13 Dec 2022
- 2022Smooth Nested Simulation: Bridging Cubic and Square Root Convergence Rates in High Dimensions9 Jan 2022
- 2021InfoGram and Admissible Machine Learning17 Aug 2021
- 2021The Efficient Shrinkage Path: Maximum Likelihood of Minimum MSE Risk9 Mar 2021
- 2023Subsample Ridge Ensembles: Equivalences and Generalized Cross-Validationcited by 11
- 2023Generalized equivalences between subsampling and ridge regularizationcited by 10
- 2024Failures and Successes of Cross-Validation for Early-Stopped Gradient Descentcited by 4
- 2024Precision Cancer Classification and Biomarker Identification from mRNA Gene Expression via Dimensionality Reduction and Explainable AIcited by 2
- 2022Smooth Nested Simulation: Bridging Cubic and Square Root Convergence Rates in High Dimensionscited by 1
- 2025When majority rules, minority loses: bias amplification of gradient descentcited by 1
- 2025SLIM-LLMs: Modeling of Style-Sensory Language RelationshipsThrough Low-Dimensional Representationscited by 1
- 2026Efficient Benchmarking Is Just Feature Selection and Multiple Regressioncited by 1
- 2021The Efficient Shrinkage Path: Maximum Likelihood of Minimum MSE Riskcited by 0
- 2021InfoGram and Admissible Machine Learningcited by 0
- 2022Smart Journey in Istanbul: A Mobile Application in Smart Cities for Traffic Estimation by Harnessing Time Seriescited by 0
- 2024LiteNeXt: A Novel Lightweight ConvMixer-based Model with Self-embedding Representation Parallel for Medical Image Segmentationcited by 0
12 most cited of 17 All 17 (JSON)
- 2026QuaSAR: Quantization Compensation via Stable Activation-Aware Rank Truncation14 Aug 2026
- 2026Statistical comparisons of time-series feature sets on classification tasks3 Aug 2026
- 2026Efficient Benchmarking Is Just Feature Selection and Multiple Regression25 May 2026
- 2026Finite-Sample Inference for Sparsely Permuted Linear Regression21 Jan 2026
- 2025SLIM-LLMs: Modeling of Style-Sensory Language RelationshipsThrough Low-Dimensional Representations4 Aug 2025
- 2025Helix 1.0: An Open-Source Framework for Reproducible and Interpretable Machine Learning on Tabular Scientific Data23 Jul 2025
- 2025When majority rules, minority loses: bias amplification of gradient descent19 May 2025
- 2024Precision Cancer Classification and Biomarker Identification from mRNA Gene Expression via Dimensionality Reduction and Explainable AI8 Oct 2024
- 2024Model-free Distortion Canceling and Control of Quantum Devices13 Jul 2024
- 2024LiteNeXt: A Novel Lightweight ConvMixer-based Model with Self-embedding Representation Parallel for Medical Image Segmentation4 Apr 2024
- 2024Failures and Successes of Cross-Validation for Early-Stopped Gradient Descent26 Feb 2024
- 2023Generalized equivalences between subsampling and ridge regularization29 May 2023
12 newest of 17 All 17 (JSON)