mlsanityData to 13 Oct 2026

Introduction to Core-sets: an Updated Survey

arXiv 2011.09384 ↗First posted 18 Nov 2020cs.LG cs.AI cs.CGcited by 45

Not on the map. Why?

Abstract (arXiv)

In optimization or machine learning problems we are given a set of items, usually points in some metric space, and the goal is to minimize or maximize an objective function over some space of candidate solutions. For example, in clustering problems, the input is a set of points in some metric space, and a common goal is to compute a set of centers in some other space (points, lines) that will minimize the sum of distances to these points. In database queries, we may need to compute such a some for a specific query set of k centers. However, traditional algorithms cannot handle modern systems that require parallel real-time computations of infinite distributed streams from sensors such as GPS, audio or video that arrive to a cloud, or networks of weaker devices such as smartphones or robots. Core-set is a "small data" summarization of the input "big data", where every possible query has approximately the same answer on both data sets. Generic techniques enable efficient coreset changedmaintenance of streaming, distributed and dynamic data. Traditional algorithms can then be applied on these coresets to maintain the approximated optimal solutions. The challenge is to design coresets with provable tradeoff between their size and approximation error. This survey summarizes such constructions in a retrospective way, that aims to unified and simplify the state-of-the-art.

Key facts. Cited by 45 papers in the map (data through 13 Oct 2026). First posted on arXiv 18 Nov 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2021: 7; 2022: 5; 2023: 11; 2024: 9; 2025: 6; 2026: 7.

45 papers.

Sort:

By area:

  1. 2022Training Data Influence Analysis and Estimation: A Surveycited by 134
  2. 2023Dataset Distillation: A Comprehensive Reviewcited by 126
  3. 2023Improved Distribution Matching for Dataset Condensationcited by 124
  4. 2024Learning Dynamics of LLM Finetuningcited by 95
  5. 2023Anchor Points: Benchmarking Models with Much Fewer Examplescited by 84
  6. 2022Submodularity In Machine Learning and Artificial Intelligencecited by 37
  7. 2023MIM4DD: Mutual Information Maximization for Dataset Distillationcited by 21
  8. 2021A Unified Approach to Coreset Learningcited by 18
  9. 2021Adversarial Robustness of Streaming Algorithms through Importance Samplingcited by 13
  10. 2021Dimensionality Reduction for Wasserstein Barycentercited by 13
  11. 2025Does Training with Synthetic Data Truly Protect Privacy?cited by 12
  12. 2021ℓ_∞-Robustness and Beyond: Unleashing Efficient Adversarial Trainingcited by 11
33 more
  1. 2022Adversarial Coreset Selection for Efficient Robust Trainingcited by 9
  2. 2021Coresets for Time Series Clusteringcited by 8
  3. 2021Data Summarization via Bilevel Optimizationcited by 7
  4. 2023Visual DNA: Representing and Comparing Images using Distributions of Neuron Activationscited by 7
  5. 2023Dataset Distillation Meets Provable Subset Selectioncited by 7
  6. 2024Unknown Domain Inconsistency Minimization for Domain Generalizationcited by 7
  7. 2021Robust and Fully-Dynamic Coreset for Continuous-and-Bounded Learning (With Outliers) Problemscited by 6
  8. 2023Data-Efficient Training of CNNs and Transformers with Coresets: A Stability Perspectivecited by 6
  9. 2025From Benchmarks to Skills: Low-Rank Factors for LLM Evaluationcited by 6
  10. 2023Machine Learning and the Future of Bayesian Computationcited by 4
  11. 2023Coreset selection can accelerate quantum machine learning models with provable generalizationcited by 4
  12. 2024Settling Time vs. Accuracy Tradeoffs for Clustering Big Datacited by 4
  13. 2024Decomposed Distribution Matching in Dataset Condensationcited by 3
  14. 2025Data Selection for ERMscited by 3
  15. 2023Simple, Scalable and Effective Clustering via One-Dimensional Projectionscited by 2
  16. 2024General bounds on the quality of Bayesian coresetscited by 2
  17. 2022One-pass additive-error subset selection for ℓp subspace approximationcited by 1
  18. 2024Using Low-Discrepancy Points for Data Compression in Machine Learning: An Experimental Comparisoncited by 1
  19. 2025Large Language Models are Demonstration Pre-Selectors for Themselvescited by 1
  20. 2025Accumulative SGD Influence Estimation for Data Attributioncited by 1
  21. 2026GRACE: A Dynamic Coreset Selection Framework for Large Language Model Optimizationcited by 1
  22. 2022CAFE: Learning to Condense Dataset by Aligning Featurescited by 0
  23. 2023Composable Core-sets for Diversity Approximation on Multi-Dataset Streamscited by 0
  24. 2024Online Algorithms with Limited Data Retentioncited by 0
  25. 2024Unsupervised Domain Adaptation Via Data Pruningcited by 0
  26. 2024Theoretically Grounded Pruning of Large Ground Sets for Constrained, Discrete Optimizationcited by 0
  27. 2025Ordered Semantically Diverse Sampling for Textual Datacited by 0
  28. 2026Diversity-Aware Adaptive Collocation for Physics-Informed Neural Networks via Sparse QUBO Optimization and Hybrid Coresetscited by 0
  29. 2026Understanding Imbalanced Forgetting in Rehearsal-Based Class-Incremental Learningcited by 0
  30. 2026Understanding Context Sampling in TabPFN on Small Tabular Datasetscited by 0
  31. 2026Diversity Matters: Distributional Feature Coverage Sample Selection for Data-Efficient Backdoor Attackscited by 0
  32. 2026Why Ghost Outputs Teach: A Kernel-Based Understanding of Subliminal Learningcited by 0
  33. 2026CRISP: Scalable Importance-Stratified Coresets for Imbalanced Tabular Learningcited by 0