On Coresets for Logistic Regression
Not on the map. Why?
Abstract (arXiv)
Coresets are one of the central methods to facilitate the analysis of large data sets. We continue a recent line of research applying the theory of coresets to logistic regression. First, we show a negative result, namely, that no strongly sublinear sized coresets exist for logistic regression. To deal with intractable worst-case instances we introduce a complexity measure μ(X), which quantifies the hardness of compressing a data set for logistic regression. μ(X) has an intuitive statistical interpretation that may be of independent interest. For data sets with bounded μ(X)-complexity, we show that a novel sensitivity sampling scheme produces the first provably sublinear (1±varepsilon)-coreset. We illustrate the performance of our method by comparing to uniform sampling as well as to state of the art methods in the area. The experiments are conducted on real world benchmark data for logistic regression.
Key facts. Cited by 65 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 11; 2023: 20; 2024: 11; 2025: 7; 2026: 6.
65 papers.
Sort:
- 2021Deep Learning on a Data Diet: Finding Important Examples Early in Trainingcited by 529
- 2023From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction Tuningcited by 301
- 2022DeepCore: A Comprehensive Library for Coreset Selection in Deep Learningcited by 146
- 2023Dataset Distillation with Convexified Implicit Gradientscited by 46
- 2021Coresets for Classification -- Simplified and Strengthenedcited by 28
- 2025A Coreset Selection of Coreset Selection Literature: Introduction and Recent Advancescited by 28
- 2023Repeated Random Sampling for Minimizing the Time-to-Accuracy of Learningcited by 26
- 2022Towards Optimal Lower Bounds for k-median and k-means Coresetscited by 23
- 2022Pruning Neural Networks via Coresets and Convex Geometry: Towards No Assumptionscited by 20
- 2023NLU on Data Diets: Dynamic Data Subset Selection for NLP Classification Taskscited by 19
- 2021Oblivious sketching for logistic regressioncited by 18
- 2021A Unified Approach to Coreset Learningcited by 18
38 more
- 2022New Coresets for Projective Clustering and Applicationscited by 16
- 2022Online Lewis Weight Samplingcited by 15
- 2021Adversarial Robustness of Streaming Algorithms through Importance Samplingcited by 13
- 2022Active Learning for Single Neuron Models with Lipschitz Non-Linearitiescited by 12
- 2022p-Generalized Probit Regression and Scalable Maximum Likelihood Estimation via Sketching and Coresetscited by 11
- 2023Data pruning and neural scaling laws: fundamental limitations of score-based algorithmscited by 11
- 2024Agnostic Active Learning of Single Index Models with Linear Sample Complexitycited by 11
- 2021Coresets for Decision Trees of Signalscited by 10
- 2023Almost Linear Constant-Factor Sketching for ℓ1 and Logistic Regressioncited by 8
- 2023Federated Wasserstein Distancecited by 8
- 2021A Novel Sequential Coreset Method for Gradient Descent Algorithmscited by 7
- 2022An Empirical Evaluation of k-Means Coresetscited by 7
- 2021Robust and Fully-Dynamic Coreset for Continuous-and-Bounded Learning (With Outliers) Problemscited by 6
- 2022Coresets for Data Discretization and Sine Wave Fittingcited by 6
- 2022Obstacle Aware Sampling for Path Planningcited by 6
- 2023Optimal Sketching Bounds for Sparse Linear Regressioncited by 6
- 2023Improved Active Learning via Dependent Leverage Score Samplingcited by 6
- 2024Scalable Learning of Item Response Theory Modelscited by 6
- 2021Introduction to Coresets: Approximated Meancited by 5
- 2023ORBSLAM3-Enhanced Autonomous Toy Drones: Pioneering Indoor Explorationcited by 5
- 2024Sketchy Moment Matching: Toward Fast and Provable Data Selection for Finetuningcited by 5
- 2023A Coreset Learning Reality Checkcited by 4
- 2023Leveraging Importance Weights in Subset Selectioncited by 4
- 2023Feature Space Sketching for Logistic Regressioncited by 4
- 2023AutoCoreset: An Automatic Practical Coreset Construction Frameworkcited by 4
- 2024No Dimensional Sampling Coresets for Classificationcited by 4
- 2025A Tight VC-Dimension Analysis of Clustering Coresets with Applicationscited by 4
- 2023On the Size and Approximation Error of Distilled Setscited by 3
- 2023Sketching Multidimensional Time Series for Fast Discord Miningcited by 3
- 2024Optimal bounds for ℓp sensitivity sampling via ℓ2 augmentationcited by 3
- 2024Turnstile ℓp leverage score sampling with applicationscited by 3
- 2026CoLA: A Choice Leakage Attack Framework to Expose Privacy Risks in Subset Trainingcited by 2
- 2022Coresets for Relational Data and The Applicationscited by 1
- 2023Randomized Greedy Algorithms and Composable Coreset for k-Center Clustering with Outlierscited by 1
- 2023Simple Weak Coresets for Non-Decomposable Classification Measurescited by 1
- 2024A Provably Accurate Randomized Sampling Algorithm for Logistic Regressioncited by 1
- 2024Data subsampling for Poisson regression with pth-root-linkcited by 1
- 2025Improving Model Classification by Optimizing the Training Datasetcited by 1
50 most cited of 65 All 65 (JSON)
- 2026Beyond Worst-Case Coreset Bounds for k-Clustering via Determinantal Sampling6 Sep 2026
- 2026MADS: Model-Aware Diverse Core Set Selection for Instruction Tuning29 May 2026
- 2026CoLA: A Choice Leakage Attack Framework to Expose Privacy Risks in Subset Training14 Apr 2026
- 2026Scalable Learning of Multivariate Distributions via Coresets20 Mar 2026
- 2026Position: Stop Preaching and Start Practising Data Frugality for Responsible Development of AI23 Feb 2026
- 2026Deterministic Coreset for Lp Subspace1 Jan 2026
- 2025Data-Efficient Training by Evolved Sampling27 Sep 2025
- 2025Improving Model Classification by Optimizing the Training Dataset22 Jul 2025
- 2025Monotone Classification with Relative Approximations12 Jun 2025
- 2025A Coreset Selection of Coreset Selection Literature: Introduction and Recent Advances23 May 2025
- 2025Importance Sampling for Nonlinear Models18 May 2025
- 2025Near-Polynomially Competitive Active Logistic Regression7 Mar 2025
38 more
- 2025A Tight VC-Dimension Analysis of Clustering Coresets with Applications11 Jan 2025
- 2024The Space Complexity of Approximating Logistic Loss3 Dec 2024
- 2024Data subsampling for Poisson regression with pth-root-link30 Oct 2024
- 2024Reciprocal Learning12 Aug 2024
- 2024Sketchy Moment Matching: Toward Fast and Provable Data Selection for Finetuning8 Jul 2024
- 2024Turnstile ℓp leverage score sampling with applications1 Jun 2024
- 2024Optimal bounds for ℓp sensitivity sampling via ℓ2 augmentation1 Jun 2024
- 2024Salutary Labeling with Zero Human Annotation27 May 2024
- 2024Agnostic Active Learning of Single Index Models with Linear Sample Complexity15 May 2024
- 2024Scalable Learning of Item Response Theory Models1 Mar 2024
- 2024A Provably Accurate Randomized Sampling Algorithm for Logistic Regression26 Feb 2024
- 2024No Dimensional Sampling Coresets for Classification7 Feb 2024
- 2023ORBSLAM3-Enhanced Autonomous Toy Drones: Pioneering Indoor Exploration20 Dec 2023
- 2023Simple Weak Coresets for Non-Decomposable Classification Measures15 Dec 2023
- 2023Computing Approximate ℓp Sensitivities7 Nov 2023
- 2023Sketching Multidimensional Time Series for Fast Discord Mining5 Nov 2023
- 2023Improved Active Learning via Dependent Leverage Score Sampling8 Oct 2023
- 2023Federated Wasserstein Distance3 Oct 2023
- 2023From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction Tuning23 Aug 2023
- 2023NLU on Data Diets: Dynamic Data Subset Selection for NLP Classification Tasks5 Jun 2023
- 2023Sharper Bounds for ℓp Sensitivity Sampling1 Jun 2023
- 2023Repeated Random Sampling for Minimizing the Time-to-Accuracy of Learning28 May 2023
- 2023On the Size and Approximation Error of Distilled Sets23 May 2023
- 2023AutoCoreset: An Automatic Practical Coreset Construction Framework19 May 2023
- 2023Optimal Sketching Bounds for Sparse Linear Regression5 Apr 2023
- 2023Almost Linear Constant-Factor Sketching for ℓ1 and Logistic Regression31 Mar 2023
- 2023Feature Space Sketching for Logistic Regression24 Mar 2023
- 2023Data pruning and neural scaling laws: fundamental limitations of score-based algorithms14 Feb 2023
- 2023Dataset Distillation with Convexified Implicit Gradients13 Feb 2023
- 2023Leveraging Importance Weights in Subset Selection28 Jan 2023
- 2023A Coreset Learning Reality Check15 Jan 2023
- 2023Randomized Greedy Algorithms and Composable Coreset for k-Center Clustering with Outliers7 Jan 2023
- 2022Active Learning for Single Neuron Models with Lipschitz Non-Linearities24 Oct 2022
- 2022Coresets for Relational Data and The Applications9 Oct 2022
- 2022Pruning Neural Networks via Coresets and Convex Geometry: Towards No Assumptions18 Sep 2022
- 2022Online Lewis Weight Sampling17 Jul 2022
- 2022An Empirical Evaluation of k-Means Coresets3 Jul 2022
- 2022DeepCore: A Comprehensive Library for Coreset Selection in Deep Learning18 Apr 2022
50 newest of 65 All 65 (JSON)
- 2021Deep Learning on a Data Diet: Finding Important Examples Early in Trainingcited by 529
- 2023From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction Tuningcited by 301
- 2022DeepCore: A Comprehensive Library for Coreset Selection in Deep Learningcited by 146
- 2023Dataset Distillation with Convexified Implicit Gradientscited by 46
- 2021Coresets for Classification -- Simplified and Strengthenedcited by 28
- 2025A Coreset Selection of Coreset Selection Literature: Introduction and Recent Advancescited by 28
- 2023Repeated Random Sampling for Minimizing the Time-to-Accuracy of Learningcited by 26
- 2022Towards Optimal Lower Bounds for k-median and k-means Coresetscited by 23
- 2022Pruning Neural Networks via Coresets and Convex Geometry: Towards No Assumptionscited by 20
- 2023NLU on Data Diets: Dynamic Data Subset Selection for NLP Classification Taskscited by 19
- 2021Oblivious sketching for logistic regressioncited by 18
- 2021A Unified Approach to Coreset Learningcited by 18
12 most cited of 65 All 65 (JSON)
- 2026Beyond Worst-Case Coreset Bounds for k-Clustering via Determinantal Sampling6 Sep 2026
- 2026MADS: Model-Aware Diverse Core Set Selection for Instruction Tuning29 May 2026
- 2026CoLA: A Choice Leakage Attack Framework to Expose Privacy Risks in Subset Training14 Apr 2026
- 2026Scalable Learning of Multivariate Distributions via Coresets20 Mar 2026
- 2026Position: Stop Preaching and Start Practising Data Frugality for Responsible Development of AI23 Feb 2026
- 2026Deterministic Coreset for Lp Subspace1 Jan 2026
- 2025Data-Efficient Training by Evolved Sampling27 Sep 2025
- 2025Improving Model Classification by Optimizing the Training Dataset22 Jul 2025
- 2025Monotone Classification with Relative Approximations12 Jun 2025
- 2025A Coreset Selection of Coreset Selection Literature: Introduction and Recent Advances23 May 2025
- 2025Importance Sampling for Nonlinear Models18 May 2025
- 2025Near-Polynomially Competitive Active Logistic Regression7 Mar 2025
12 newest of 65 All 65 (JSON)