mlsanityData to 7 Oct 2026

Accelerating data-driven algorithm selection for combinatorial partitioning problems

arXiv 2402.14332 ↗First posted 22 Feb 2024cs.LG stat.MLcited by 2

Not on the map. Why?

Abstract (arXiv)

Data-driven algorithm selection is a powerful approach for choosing effective heuristics for computational problems. It operates by evaluating a set of candidate algorithms on a collection of representative training instances and selecting the one with the best empirical performance. However, running each algorithm on every training instance is computationally expensive, making scalability a central challenge. In practice, a common workaround is to evaluate algorithms on smaller proxy instances derived from the original inputs. However, this practice has remained largely ad hoc and lacked theoretical grounding. We provide the first theoretical foundations for this practice by formalizing the notion of size generalization: predicting an algorithm's performance on a large instance by evaluating it on a smaller, representative instance, subsampled from the original instance. We provide size generalization guarantees for three widely used clustering algorithms (single-linkage, k-means++, and Gonzalez's k-centers heuristic) and two canonical max-cut algorithms (Goemans-Williamson and Greedy). We characterize the subsample size sufficient to ensure that performance on the subsample reflects performance on the full instance, and our experiments support these findings.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 32 of its 84 references that are in the map. First posted on arXiv 22 Feb 2024.

Builds on

32 of 84 references.

References · 32

  1. 2015Pointer Networkscited by 882
  2. 2017Learning Combinatorial Optimization Algorithms over Graphscited by 557
  3. 2019Exact Combinatorial Optimization with Graph Convolutional Neural Networkscited by 313
  4. 2018Learning a SAT Solver from Single-Bit Supervisioncited by 198
  5. 2019Neural Execution of Graph Algorithmscited by 118
  6. 2019Reinforcement Learning for Integer Programming: Learning to Cutcited by 108
  7. 2020Learning the Travelling Salesperson Problem Requires Rethinking Generalizationcited by 96
  8. 2020Hybrid Models for Learning to Branchcited by 95
  9. 2018Turning Big data into tiny data: Constant-size coresets for k-means, PCA and projective clusteringcited by 94
  10. 2022A Generalist Neural Algorithmic Learnercited by 58
  11. 2015A PAC Approach to Application-Specific Algorithm Selectioncited by 57
  12. 2023Searching Large Neighborhoods for Integer Linear Programs with Contrastive Learningcited by 37
20 more
  1. 2017Clustering with Noisy Queriescited by 34
  2. 2016Learning-Theoretic Foundations of Algorithm Configuration for Combinatorial Partitioning Problemscited by 30
  3. 2016Clustering with Same-Cluster Queriescited by 29
  4. 2019How much data is sufficient to learn high-performing algorithms? Generalization guarantees for data-driven algorithm designcited by 27
  5. 2022Generalization Bounds for Data-Driven Numerical Linear Algebracited by 24
  6. 2022A Deep Reinforcement Learning Framework For Column Generationcited by 21
  7. 2019Correlation Clustering with Same-Cluster Queries Bounded by Optimal Costcited by 16
  8. 2019Learning to Linkcited by 13
  9. 2020Learning Complexity of Simulated Annealingcited by 12
  10. 2014Consistent procedures for cluster tree estimation and pruningcited by 9
  11. 2016Interactive Bayesian Hierarchical Clusteringcited by 9
  12. 2018Clustering - What Both Theoreticians and Practitioners are Doing Wrongcited by 8
  13. 2022Accelerating ERM for data-driven algorithm design using output-sensitive techniquescited by 8
  14. 2014Robust Hierarchical Clusteringcited by 7
  15. 2020Sketching semidefinite programs for faster clusteringcited by 5
  16. 2015Representation Learning for Clustering: A Statistical Frameworkcited by 2
  17. 2022Sublinear-Time Algorithms for Max Cut, Max E2Lin(q), and Unique Label Cover on Expanderscited by 2
  18. 2014Efficient Clustering with Limited Distance Informationcited by 1
  19. 2018Sublinear Algorithms for MAXCUT and Correlation Clusteringcited by 1
  20. 2022Sketch-and-solve approaches to k-means clustering by semidefinite programmingcited by 1

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.