Sequential Learning of the Pareto Front for Multi-objective Bandits
Not on the map. Why?
Abstract (arXiv)
We study the problem of sequential learning of the Pareto front in multi-objective multi-armed bandits. An agent is faced with K possible arms to pull. At each turn she picks one, and receives a vector-valued reward. When she thinks she has enough information to identify the Pareto front of the different arm means, she stops the game and gives an answer. We are interested in designing algorithms such that the answer given is correct with probability at least 1-δ. Our main contribution is an efficient implementation of an algorithm achieving the optimal sample complexity when the risk δ is small. With K arms in d dimensions p of which are in the Pareto set, the algorithm runs in time O(Kpd) per round.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 19 of its 42 references that are in the map. First posted on arXiv 29 Jan 2025.
Builds on
19 of 42 references.
References · 19
- 2016Optimal Best Arm Identification with Fixed Confidencecited by 233
- 2020Optimal Best-arm Identification in Linear Banditscited by 70
- 2019Non-Asymptotic Pure Exploration by Solving Gamescited by 62
- 2020Gamification of Pure Exploration for Linear Banditscited by 61
- 2019Adaptive Exploration in Linear Contextual Banditcited by 43
- 2017Nearly Instance Optimal Sample Complexity Bounds for Top-k Arm Selectioncited by 28
- 2017Multi-objective Bandits: Optimizing the Generalized Gini Indexcited by 27
- 2020An Asymptotically Optimal Primal-Dual Incremental Algorithm for Contextual Linear Banditscited by 26
- 2020Adaptive Sampling for Best Policy Identification in Markov Decision Processescited by 20
- 2020Optimal Best-Arm Identification Methods for Tail-Risk Measurescited by 17
- 2021A/B/n Testing with Control in the Presence of Subpopulationscited by 17
- 2017Thresholding Bandit for Dose-ranging: The Impact of Monotonicitycited by 15
7 more
- 2023Adaptive Algorithms for Relaxed Pareto Set Identificationcited by 13
- 2019Optimal Best Markovian Arm Identification with Fixed Confidencecited by 12
- 2022Pareto Regret Analyses in Multi-objective Multi-armed Banditcited by 11
- 2016Maximin Action Identification: A New Bandit Framework for Gamescited by 7
- 2019MaxGap Bandit: Adaptive Algorithms for Approximate Rankingcited by 6
- 2017Adaptive Multiple-Arm Identificationcited by 4
- 2017Skyline Identification in Multi-Armed Banditscited by 3
Built on by
Citing papers per year: 2025: 7; 2026: 6.
13 papers.
Sort:
- 2025Best Group Identification in Multi-Objective Banditscited by 2
- 2025Constrained Pareto Set Identification with Bandit Feedbackcited by 2
- 2025FraPPE: Fast and Efficient Preference-based Pure Explorationcited by 2
- 2025Multi-thresholding Good Arm Identification with Bandit Feedbackcited by 1
- 2025Multi-Metric Adaptive Experimental Design Under a Fixed Budget with Validationcited by 1
- 2025Stochastic Multi-Objective Multi-Armed Bandits: Regret Definition and Algorithmcited by 1
- 2026Communication-Corruption Coupling and Verification in Cooperative Multi-Objective Banditscited by 1
- 2026Cost-Aware Multi-Objective Bandits: Theory and Application to Budgeted LLM Configuration Evaluationcited by 1
- 2025Beyond the Lower Bound: Bridging Regret Minimization and Best Arm Identification in Lexicographic Banditscited by 0
- 2026Probe-then-Commit Multi-Objective Bandits: Theoretical Benefits of Limited Multi-Arm Feedbackcited by 0
- 2026Bayesian Anytime Pareto Set Identification for Multi-Objective Multi-Armed Banditscited by 0
- 2026Selective Ensemble Based on Preference-Directed Multi-Objective Banditscited by 0
1 more
- 2026Cost-Aware Multi-Objective Bandits: Theory and Application to Budgeted LLM Configuration Evaluation5 Aug 2026
- 2026Efficient Online Lexicographic Generalized Low-Rank Matrix Bandits5 Aug 2026
- 2026Selective Ensemble Based on Preference-Directed Multi-Objective Bandits20 Jun 2026
- 2026Bayesian Anytime Pareto Set Identification for Multi-Objective Multi-Armed Bandits17 Jun 2026
- 2026Probe-then-Commit Multi-Objective Bandits: Theoretical Benefits of Limited Multi-Arm Feedback3 Feb 2026
- 2026Communication-Corruption Coupling and Verification in Cooperative Multi-Objective Bandits17 Jan 2026
- 2025Beyond the Lower Bound: Bridging Regret Minimization and Best Arm Identification in Lexicographic Bandits8 Nov 2025
- 2025FraPPE: Fast and Efficient Preference-based Pure Exploration22 Aug 2025
- 2025Stochastic Multi-Objective Multi-Armed Bandits: Regret Definition and Algorithm16 Jun 2025
- 2025Constrained Pareto Set Identification with Bandit Feedback9 Jun 2025
- 2025Multi-Metric Adaptive Experimental Design Under a Fixed Budget with Validation3 Jun 2025
- 2025Best Group Identification in Multi-Objective Bandits23 May 2025
1 more
- 2025Best Group Identification in Multi-Objective Banditscited by 2
- 2025Constrained Pareto Set Identification with Bandit Feedbackcited by 2
- 2025FraPPE: Fast and Efficient Preference-based Pure Explorationcited by 2
- 2025Multi-thresholding Good Arm Identification with Bandit Feedbackcited by 1
- 2025Multi-Metric Adaptive Experimental Design Under a Fixed Budget with Validationcited by 1
- 2025Stochastic Multi-Objective Multi-Armed Bandits: Regret Definition and Algorithmcited by 1
- 2026Communication-Corruption Coupling and Verification in Cooperative Multi-Objective Banditscited by 1
- 2026Cost-Aware Multi-Objective Bandits: Theory and Application to Budgeted LLM Configuration Evaluationcited by 1
- 2025Beyond the Lower Bound: Bridging Regret Minimization and Best Arm Identification in Lexicographic Banditscited by 0
- 2026Probe-then-Commit Multi-Objective Bandits: Theoretical Benefits of Limited Multi-Arm Feedbackcited by 0
- 2026Bayesian Anytime Pareto Set Identification for Multi-Objective Multi-Armed Banditscited by 0
- 2026Selective Ensemble Based on Preference-Directed Multi-Objective Banditscited by 0
12 most cited of 13 All 13 (JSON)
- 2026Cost-Aware Multi-Objective Bandits: Theory and Application to Budgeted LLM Configuration Evaluation5 Aug 2026
- 2026Efficient Online Lexicographic Generalized Low-Rank Matrix Bandits5 Aug 2026
- 2026Selective Ensemble Based on Preference-Directed Multi-Objective Bandits20 Jun 2026
- 2026Bayesian Anytime Pareto Set Identification for Multi-Objective Multi-Armed Bandits17 Jun 2026
- 2026Probe-then-Commit Multi-Objective Bandits: Theoretical Benefits of Limited Multi-Arm Feedback3 Feb 2026
- 2026Communication-Corruption Coupling and Verification in Cooperative Multi-Objective Bandits17 Jan 2026
- 2025Beyond the Lower Bound: Bridging Regret Minimization and Best Arm Identification in Lexicographic Bandits8 Nov 2025
- 2025FraPPE: Fast and Efficient Preference-based Pure Exploration22 Aug 2025
- 2025Stochastic Multi-Objective Multi-Armed Bandits: Regret Definition and Algorithm16 Jun 2025
- 2025Constrained Pareto Set Identification with Bandit Feedback9 Jun 2025
- 2025Multi-Metric Adaptive Experimental Design Under a Fixed Budget with Validation3 Jun 2025
- 2025Best Group Identification in Multi-Objective Bandits23 May 2025
12 newest of 13 All 13 (JSON)