mlsanityData to 14 Oct 2026

Few-for-Many Best-Arm Identification in Multi-Objective Bandits

arXiv 2610.16840 ↗First posted 12 Oct 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Real-world systems often serve many objectives but can deploy only a few options, whose performance must be learned from noisy feedback. Modeling each option as an arm in a multi-objective bandit, we introduce few-for-many best-arm identification, which seeks a small set of arms minimizing the worst weighted degradation from the objective-wise optima, rather than the best arm for every objective. We consider both known objective groups and latent groups specified only by a representative budget, and propose textscGFM-Elim and textscAFM-Elim with instance-dependent sample-complexity guarantees. For Gaussian rewards, we further derive a lower bound for the latent-group setting and show that it is asymptotically attainable with high probability by an oracle-based Track-and-Stop procedure. Our results show that sharing observations across objectives and ignoring irrelevant objective-wise distinctions can substantially reduce the sampling cost, as confirmed by experiments on synthetic and real-world tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 43 references that are in the map. First posted on arXiv 12 Oct 2026.

Builds on

30 of 43 references.

References · 30

  1. 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 853
  2. 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
  3. 2016Optimal Best Arm Identification with Fixed Confidencecited by 239
  4. 2015Multi-armed Bandit Models for the Optimal Design of Clinical Trials: Benefits and Challengescited by 114
  5. 2018A Flexible Framework for Multi-Objective Bayesian Optimization using Random Scalarizationscited by 99
  6. 2019Sequential Experimental Design for Transductive Linear Banditscited by 91
  7. 2020Optimal Best-arm Identification in Linear Banditscited by 71
  8. 2019Pure Exploration with Multiple Correct Answerscited by 64
  9. 2020Gamification of Pure Exploration for Linear Banditscited by 63
  10. 2024Smooth Tchebycheff Scalarization for Multi-Objective Optimizationcited by 54
  11. 2018Multi-objective Contextual Bandit Problem with Similarity Informationcited by 21
  12. 2021Efficient Pure Exploration for Combinatorial Bandits with Semi-Bandit Feedbackcited by 21
18 more
  1. 2024Few for Many: Tchebycheff Set Scalarization for Many-Objective Optimizationcited by 16
  2. 2023Adaptive Algorithms for Relaxed Pareto Set Identificationcited by 15
  3. 2024Traversing Pareto Optimal Policies: Provably Efficient Multi-Objective Reinforcement Learningcited by 15
  4. 2025Sequential Learning of the Pareto Front for Multi-objective Banditscited by 15
  5. 2016Pure Exploration of Multi-armed Bandit Under Matroid Constraintscited by 14
  6. 2022Pareto Regret Analyses in Multi-objective Multi-armed Banditcited by 13
  7. 2021Vector Optimization with Stochastic Bandit Feedbackcited by 12
  8. 2023Optimal Scalarizations for Sublinear Hypervolume Regretcited by 7
  9. 2019Online Evaluation of Audiences for Targeted Advertising via Bandit Experimentscited by 6
  10. 2024Preference-based Pure Explorationcited by 5
  11. 2025Optimal Multi-Objective Best Arm Identification with Fixed Confidencecited by 5
  12. 2025FraPPE: Fast and Efficient Preference-based Pure Explorationcited by 4
  13. 2026Cost-Aware Multi-Objective Bandits: Theory and Application to Budgeted LLM Configuration Evaluationcited by 3
  14. 2025Thompson Sampling for Multi-Objective Linear Contextual Banditcited by 2
  15. 2026Few-for-Many Personalized Federated Learningcited by 2
  16. 2026Efficient Online Lexicographic Generalized Low-Rank Matrix Banditscited by 2
  17. 2019Decision-making with multiple correlated binary outcomes in clinical trialscited by 1
  18. 2026An Efficient Evolutionary Algorithm for Few-for-Many Optimizationcited by 1

Built on by

Not cited yet.