mlsanityData to 14 Oct 2026

UniPROT: Uniform Prototype Selection via Partial Optimal Transport with Submodular Guarantees

arXiv 2604.10952 ↗First posted 13 Apr 2026cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Selecting prototypical examples from a source distribution to represent a target data distribution is a fundamental problem in machine learning. Existing subset selection methods often rely on implicit importance scores, which can be skewed towards majority classes and lead to low-quality prototypes for minority classes. We present methodprop, a novel subset selection framework that minimizes the optimal transport (OT) distance between a uniformly weighted prototypical distribution and the target distribution. While intuitive, this formulation leads to a cardinality-constrained maximization of a super-additive objective, which is generally intractable to approximate efficiently. To address this, we propose a principled reformulation of the OT marginal constraints, yielding a partial optimal transport-based submodular objective. We prove that this reformulation enables a greedy algorithm with a (1-1/e) approximation guarantee relative to the original super-additive maximization problem. Empirically, we showcase that enforcing uniform prototype weights in UniPROT consistently improves minority-class representation in imbalanced classification benchmarks without compromising majority-class accuracy. In both finetuning and pretraining regimes for large language models under domain imbalance, UniPROT enforces uniform source contributions, yielding robust performance gains. Our results establish UniPROT as a scalable, theoretically grounded solution for uniform-weighted prototype selection. Our code is publicly available at GitHubfootnoteCode: https://github.com/efficiency-learning/UniPROT

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 28 of its 68 references that are in the map. First posted on arXiv 13 Apr 2026.

Builds on

28 of 68 references.

References · 28

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  2. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  3. 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,729
  4. 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 878
  5. 2018This Looks Like That: Deep Learning for Interpretable Image Recognitioncited by 737
  6. 2023Textbooks Are All You Need II: phi-1.5 technical reportcited by 565
  7. 2023Zephyr: Direct Distillation of LM Alignmentcited by 506
  8. 2023MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuningcited by 487
  9. 2018Not All Samples Are Created Equal: Deep Learning with Importance Samplingcited by 328
  10. 2021GRAD-MATCH: Gradient Matching based Data Subset Selection for Efficient Deep Model Trainingcited by 274
  11. 2020GLISTER: Generalization based Data Subset Selection for Efficient and Robust Learningcited by 226
  12. 2021Dataset Distillation with Infinitely Wide Convolutional Networkscited by 218
16 more
  1. 2013Fast Computation of Wasserstein Barycenterscited by 216
  2. 2022NumGLUE: A Suite of Fundamental yet Challenging Mathematical Reasoning Taskscited by 112
  3. 2014Lazier Than Lazy Greedycited by 99
  4. 2016Restricted Strong Convexity Implies Weak Submodularitycited by 52
  5. 2017Multilevel Clustering via Wasserstein Meanscited by 49
  6. 2023Towards Sustainable Learning: Coresets for Data-efficient Deep Learningcited by 44
  7. 2023Dataset Distillation via the Wasserstein Metriccited by 31
  8. 2016Minimizing the Maximal Loss: How and Why?cited by 30
  9. 2024TSDS: Data Selection for Task-Specific Model Finetuningcited by 28
  10. 2025Data Pruning by Information Maximizationcited by 15
  11. 2024Diversified Batch Selection for Training Accelerationcited by 14
  12. 2021SPOT: A framework for selection of prototypes using optimal transportcited by 13
  13. 2024Mini-batch Coresets for Memory-efficient Language Model Training on Data Mixturescited by 12
  14. 2021Submodular Mutual Information for Targeted Data Subset Selectioncited by 8
  15. 2023On Partial Optimal Transport: Revising the Infeasibility of Sinkhorn and Efficient Gradient Methodscited by 7
  16. 2021Partial Wasserstein Coveringcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.