Introduction to Core-sets: an Updated Survey
Not on the map. Why?
Abstract (arXiv)
In optimization or machine learning problems we are given a set of items, usually points in some metric space, and the goal is to minimize or maximize an objective function over some space of candidate solutions. For example, in clustering problems, the input is a set of points in some metric space, and a common goal is to compute a set of centers in some other space (points, lines) that will minimize the sum of distances to these points. In database queries, we may need to compute such a some for a specific query set of k centers. However, traditional algorithms cannot handle modern systems that require parallel real-time computations of infinite distributed streams from sensors such as GPS, audio or video that arrive to a cloud, or networks of weaker devices such as smartphones or robots. Core-set is a "small data" summarization of the input "big data", where every possible query has approximately the same answer on both data sets. Generic techniques enable efficient coreset changedmaintenance of streaming, distributed and dynamic data. Traditional algorithms can then be applied on these coresets to maintain the approximated optimal solutions. The challenge is to design coresets with provable tradeoff between their size and approximation error. This survey summarizes such constructions in a retrospective way, that aims to unified and simplify the state-of-the-art.
Key facts. Cited by 45 papers in the map (data through 13 Oct 2026). First posted on arXiv 18 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 5; 2023: 11; 2024: 9; 2025: 6; 2026: 7.
45 papers.
Sort:
By area:
- 2022Training Data Influence Analysis and Estimation: A Surveycited by 134
- 2023Dataset Distillation: A Comprehensive Reviewcited by 126
- 2023Improved Distribution Matching for Dataset Condensationcited by 124
- 2024Learning Dynamics of LLM Finetuningcited by 95
- 2023Anchor Points: Benchmarking Models with Much Fewer Examplescited by 84
- 2022Submodularity In Machine Learning and Artificial Intelligencecited by 37
- 2023MIM4DD: Mutual Information Maximization for Dataset Distillationcited by 21
- 2021A Unified Approach to Coreset Learningcited by 18
- 2021Adversarial Robustness of Streaming Algorithms through Importance Samplingcited by 13
- 2021Dimensionality Reduction for Wasserstein Barycentercited by 13
- 2025Does Training with Synthetic Data Truly Protect Privacy?cited by 12
- 2021ℓ_∞-Robustness and Beyond: Unleashing Efficient Adversarial Trainingcited by 11
33 more
- 2022Adversarial Coreset Selection for Efficient Robust Trainingcited by 9
- 2021Coresets for Time Series Clusteringcited by 8
- 2021Data Summarization via Bilevel Optimizationcited by 7
- 2023Visual DNA: Representing and Comparing Images using Distributions of Neuron Activationscited by 7
- 2023Dataset Distillation Meets Provable Subset Selectioncited by 7
- 2024Unknown Domain Inconsistency Minimization for Domain Generalizationcited by 7
- 2021Robust and Fully-Dynamic Coreset for Continuous-and-Bounded Learning (With Outliers) Problemscited by 6
- 2023Data-Efficient Training of CNNs and Transformers with Coresets: A Stability Perspectivecited by 6
- 2025From Benchmarks to Skills: Low-Rank Factors for LLM Evaluationcited by 6
- 2023Machine Learning and the Future of Bayesian Computationcited by 4
- 2023Coreset selection can accelerate quantum machine learning models with provable generalizationcited by 4
- 2024Settling Time vs. Accuracy Tradeoffs for Clustering Big Datacited by 4
- 2024Decomposed Distribution Matching in Dataset Condensationcited by 3
- 2025Data Selection for ERMscited by 3
- 2023Simple, Scalable and Effective Clustering via One-Dimensional Projectionscited by 2
- 2024General bounds on the quality of Bayesian coresetscited by 2
- 2022One-pass additive-error subset selection for ℓp subspace approximationcited by 1
- 2024Using Low-Discrepancy Points for Data Compression in Machine Learning: An Experimental Comparisoncited by 1
- 2025Large Language Models are Demonstration Pre-Selectors for Themselvescited by 1
- 2025Accumulative SGD Influence Estimation for Data Attributioncited by 1
- 2026GRACE: A Dynamic Coreset Selection Framework for Large Language Model Optimizationcited by 1
- 2022CAFE: Learning to Condense Dataset by Aligning Featurescited by 0
- 2023Composable Core-sets for Diversity Approximation on Multi-Dataset Streamscited by 0
- 2024Online Algorithms with Limited Data Retentioncited by 0
- 2024Unsupervised Domain Adaptation Via Data Pruningcited by 0
- 2024Theoretically Grounded Pruning of Large Ground Sets for Constrained, Discrete Optimizationcited by 0
- 2025Ordered Semantically Diverse Sampling for Textual Datacited by 0
- 2026Diversity-Aware Adaptive Collocation for Physics-Informed Neural Networks via Sparse QUBO Optimization and Hybrid Coresetscited by 0
- 2026Understanding Imbalanced Forgetting in Rehearsal-Based Class-Incremental Learningcited by 0
- 2026Understanding Context Sampling in TabPFN on Small Tabular Datasetscited by 0
- 2026Diversity Matters: Distributional Feature Coverage Sample Selection for Data-Efficient Backdoor Attackscited by 0
- 2026Why Ghost Outputs Teach: A Kernel-Based Understanding of Subliminal Learningcited by 0
- 2026CRISP: Scalable Importance-Stratified Coresets for Imbalanced Tabular Learningcited by 0
- 2026CRISP: Scalable Importance-Stratified Coresets for Imbalanced Tabular Learning22 Sep 2026
- 2026Why Ghost Outputs Teach: A Kernel-Based Understanding of Subliminal Learning20 Sep 2026
- 2026Diversity Matters: Distributional Feature Coverage Sample Selection for Data-Efficient Backdoor Attacks10 Aug 2026
- 2026Understanding Context Sampling in TabPFN on Small Tabular Datasets29 Jul 2026
- 2026Understanding Imbalanced Forgetting in Rehearsal-Based Class-Incremental Learning14 May 2026
- 2026GRACE: A Dynamic Coreset Selection Framework for Large Language Model Optimization9 Apr 2026
- 2026Diversity-Aware Adaptive Collocation for Physics-Informed Neural Networks via Sparse QUBO Optimization and Hybrid Coresets6 Mar 2026
- 2025Accumulative SGD Influence Estimation for Data Attribution30 Oct 2025
- 2025From Benchmarks to Skills: Low-Rank Factors for LLM Evaluation27 Jul 2025
- 2025Large Language Models are Demonstration Pre-Selectors for Themselves6 Jun 2025
- 2025Data Selection for ERMs20 Apr 2025
- 2025Ordered Semantically Diverse Sampling for Textual Data12 Mar 2025
33 more
- 2025Does Training with Synthetic Data Truly Protect Privacy?18 Feb 2025
- 2024Decomposed Distribution Matching in Dataset Condensation6 Dec 2024
- 2024Theoretically Grounded Pruning of Large Ground Sets for Constrained, Discrete Optimization23 Oct 2024
- 2024Unsupervised Domain Adaptation Via Data Pruning18 Sep 2024
- 2024Learning Dynamics of LLM Finetuning15 Jul 2024
- 2024Using Low-Discrepancy Points for Data Compression in Machine Learning: An Experimental Comparison10 Jul 2024
- 2024General bounds on the quality of Bayesian coresets20 May 2024
- 2024Online Algorithms with Limited Data Retention17 Apr 2024
- 2024Settling Time vs. Accuracy Tradeoffs for Clustering Big Data2 Apr 2024
- 2024Unknown Domain Inconsistency Minimization for Domain Generalization12 Mar 2024
- 2023MIM4DD: Mutual Information Maximization for Dataset Distillation27 Dec 2023
- 2023Simple, Scalable and Effective Clustering via One-Dimensional Projections25 Oct 2023
- 2023Coreset selection can accelerate quantum machine learning models with provable generalization19 Sep 2023
- 2023Anchor Points: Benchmarking Models with Much Fewer Examples14 Sep 2023
- 2023Composable Core-sets for Diversity Approximation on Multi-Dataset Streams10 Aug 2023
- 2023Improved Distribution Matching for Dataset Condensation19 Jul 2023
- 2023Dataset Distillation Meets Provable Subset Selection16 Jul 2023
- 2023Machine Learning and the Future of Bayesian Computation21 Apr 2023
- 2023Visual DNA: Representing and Comparing Images using Distributions of Neuron Activations20 Apr 2023
- 2023Data-Efficient Training of CNNs and Transformers with Coresets: A Stability Perspective3 Mar 2023
- 2023Dataset Distillation: A Comprehensive Review17 Jan 2023
- 2022Training Data Influence Analysis and Estimation: A Survey9 Dec 2022
- 2022Adversarial Coreset Selection for Efficient Robust Training13 Sep 2022
- 2022One-pass additive-error subset selection for ℓp subspace approximation26 Apr 2022
- 2022CAFE: Learning to Condense Dataset by Aligning Features3 Mar 2022
- 2022Submodularity In Machine Learning and Artificial Intelligence31 Jan 2022
- 2021ℓ_∞-Robustness and Beyond: Unleashing Efficient Adversarial Training1 Dec 2021
- 2021A Unified Approach to Coreset Learning4 Nov 2021
- 2021Coresets for Time Series Clustering28 Oct 2021
- 2021Dimensionality Reduction for Wasserstein Barycenter18 Oct 2021
- 2021Data Summarization via Bilevel Optimization26 Sep 2021
- 2021Robust and Fully-Dynamic Coreset for Continuous-and-Bounded Learning (With Outliers) Problems30 Jun 2021
- 2021Adversarial Robustness of Streaming Algorithms through Importance Sampling28 Jun 2021
- 2024Learning Dynamics of LLM Finetuningcited by 95
- 2024Learning Dynamics of LLM Finetuning15 Jul 2024
- 2022Training Data Influence Analysis and Estimation: A Surveycited by 134
- 2023Dataset Distillation: A Comprehensive Reviewcited by 126
- 2023Improved Distribution Matching for Dataset Condensationcited by 124
- 2023Anchor Points: Benchmarking Models with Much Fewer Examplescited by 84
- 2022Submodularity In Machine Learning and Artificial Intelligencecited by 37
- 2023MIM4DD: Mutual Information Maximization for Dataset Distillationcited by 21
- 2021A Unified Approach to Coreset Learningcited by 18
- 2021Adversarial Robustness of Streaming Algorithms through Importance Samplingcited by 13
- 2021Dimensionality Reduction for Wasserstein Barycentercited by 13
- 2025Does Training with Synthetic Data Truly Protect Privacy?cited by 12
- 2021ℓ_∞-Robustness and Beyond: Unleashing Efficient Adversarial Trainingcited by 11
- 2022Adversarial Coreset Selection for Efficient Robust Trainingcited by 9
12 most cited of 44 All 44 (JSON)
- 2026CRISP: Scalable Importance-Stratified Coresets for Imbalanced Tabular Learning22 Sep 2026
- 2026Why Ghost Outputs Teach: A Kernel-Based Understanding of Subliminal Learning20 Sep 2026
- 2026Diversity Matters: Distributional Feature Coverage Sample Selection for Data-Efficient Backdoor Attacks10 Aug 2026
- 2026Understanding Context Sampling in TabPFN on Small Tabular Datasets29 Jul 2026
- 2026Understanding Imbalanced Forgetting in Rehearsal-Based Class-Incremental Learning14 May 2026
- 2026GRACE: A Dynamic Coreset Selection Framework for Large Language Model Optimization9 Apr 2026
- 2026Diversity-Aware Adaptive Collocation for Physics-Informed Neural Networks via Sparse QUBO Optimization and Hybrid Coresets6 Mar 2026
- 2025Accumulative SGD Influence Estimation for Data Attribution30 Oct 2025
- 2025From Benchmarks to Skills: Low-Rank Factors for LLM Evaluation27 Jul 2025
- 2025Large Language Models are Demonstration Pre-Selectors for Themselves6 Jun 2025
- 2025Data Selection for ERMs20 Apr 2025
- 2025Ordered Semantically Diverse Sampling for Textual Data12 Mar 2025
12 newest of 44 All 44 (JSON)