Combinatorial Semi-Bandits with Knapsacks
Not on the map. Why?
Abstract (arXiv)
We unify two prominent lines of work on multi-armed bandits: bandits with knapsacks (BwK) and combinatorial semi-bandits. The former concerns limited "resources" consumed by the algorithm, e.g., limited supply in dynamic pricing. The latter allows a huge number of actions but assumes combinatorial structure and additional feedback to make the problem tractable. We define a common generalization, support it with several motivating examples, and design an algorithm for it. Our regret bounds are comparable with those for BwK and combinatorial semi- bandits.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 2; 2023: 3; 2024: 4; 2025: 4; 2026: 5.
23 papers.
Sort:
By area:
- 2024Cost-Effective Online Multi-LLM Selection with Versatile Reward Modelscited by 36
- 2021Stochastic Bandits for Multi-platform Budget Optimization in Online Advertisingcited by 25
- 2021Combinatorial Bandits under Strategic Manipulationscited by 6
- 2023Approximately Stationary Bandits with Knapsackscited by 6
- 2023Bandits with Replenishable Knapsacks: the Best of both Worldscited by 6
- 2025No-Regret Learning Under Adversarial Resource Constraints: A Spending Plan Is All You Need!cited by 5
- 2022Best of Many Worlds Guarantees for Online Learning with Knapsackscited by 4
- 2022Safe Online Bid Optimization with Return on Investment and Budget Constraintscited by 3
- 2024Best Arm Identification with Resource Constraintscited by 3
- 2021Recurrent Submodular Welfare and Matroid Blocking Banditscited by 2
- 2021MNL-Bandit with Knapsacks: a near-optimal algorithmcited by 2
- 2024Multi-Task Combinatorial Bandits for Budget Allocationcited by 2
11 more
- 2023Online Resource Allocation: Bandits feedback and Advice on Time-varying Demandscited by 1
- 2025Adversarial Combinatorial Semi-bandits with Graph Feedbackcited by 1
- 2026Cost-Aware Multi-Objective Bandits: Theory and Application to Budgeted LLM Configuration Evaluationcited by 1
- 2021Continuous Time Bandits With Sampling Costscited by 0
- 2024Learning to Explore with Lagrangians for Bandits under Unknown Linear Constraintscited by 0
- 2025Stochastically Constrained Best Arm Identification with Thompson Samplingcited by 0
- 2025Finite-Time Guarantees for Multi-Agent Combinatorial Bandits with Nonstationary Rewardscited by 0
- 2026Learning with a Budget: Identifying the Best Arm with Resource Constraintscited by 0
- 2026Adaptive Combinatorial Experimental Design: Pareto Optimality for Decision-Making and Inferencecited by 0
- 2026Combinatorial Allocation Bandits with Nonlinear Arm Utilitycited by 0
- 2026Multinomial Subset Routing with Sum-Max Rewards and Operational Constraintscited by 0
- 2026Multinomial Subset Routing with Sum-Max Rewards and Operational Constraints17 Aug 2026
- 2026Cost-Aware Multi-Objective Bandits: Theory and Application to Budgeted LLM Configuration Evaluation5 Aug 2026
- 2026Combinatorial Allocation Bandits with Nonlinear Arm Utility7 Mar 2026
- 2026Adaptive Combinatorial Experimental Design: Pareto Optimality for Decision-Making and Inference27 Feb 2026
- 2026Learning with a Budget: Identifying the Best Arm with Resource Constraints27 Feb 2026
- 2025Finite-Time Guarantees for Multi-Agent Combinatorial Bandits with Nonstationary Rewards28 Aug 2025
- 2025No-Regret Learning Under Adversarial Resource Constraints: A Spending Plan Is All You Need!16 Jun 2025
- 2025Adversarial Combinatorial Semi-bandits with Graph Feedback26 Feb 2025
- 2025Stochastically Constrained Best Arm Identification with Thompson Sampling7 Jan 2025
- 2024Learning to Explore with Lagrangians for Bandits under Unknown Linear Constraints24 Oct 2024
- 2024Multi-Task Combinatorial Bandits for Budget Allocation31 Aug 2024
- 2024Cost-Effective Online Multi-LLM Selection with Versatile Reward Models26 May 2024
11 more
- 2024Best Arm Identification with Resource Constraints29 Feb 2024
- 2023Bandits with Replenishable Knapsacks: the Best of both Worlds14 Jun 2023
- 2023Approximately Stationary Bandits with Knapsacks28 Feb 2023
- 2023Online Resource Allocation: Bandits feedback and Advice on Time-varying Demands8 Feb 2023
- 2022Best of Many Worlds Guarantees for Online Learning with Knapsacks28 Feb 2022
- 2022Safe Online Bid Optimization with Return on Investment and Budget Constraints18 Jan 2022
- 2021Continuous Time Bandits With Sampling Costs12 Jul 2021
- 2021MNL-Bandit with Knapsacks: a near-optimal algorithm2 Jun 2021
- 2021Stochastic Bandits for Multi-platform Budget Optimization in Online Advertising16 Mar 2021
- 2021Combinatorial Bandits under Strategic Manipulations25 Feb 2021
- 2021Recurrent Submodular Welfare and Matroid Blocking Bandits30 Jan 2021
- 2021Stochastic Bandits for Multi-platform Budget Optimization in Online Advertisingcited by 25
- 2021Combinatorial Bandits under Strategic Manipulationscited by 6
- 2023Approximately Stationary Bandits with Knapsackscited by 6
- 2023Bandits with Replenishable Knapsacks: the Best of both Worldscited by 6
- 2025No-Regret Learning Under Adversarial Resource Constraints: A Spending Plan Is All You Need!cited by 5
- 2022Best of Many Worlds Guarantees for Online Learning with Knapsackscited by 4
- 2022Safe Online Bid Optimization with Return on Investment and Budget Constraintscited by 3
- 2024Best Arm Identification with Resource Constraintscited by 3
- 2021Recurrent Submodular Welfare and Matroid Blocking Banditscited by 2
- 2021MNL-Bandit with Knapsacks: a near-optimal algorithmcited by 2
- 2024Multi-Task Combinatorial Bandits for Budget Allocationcited by 2
- 2023Online Resource Allocation: Bandits feedback and Advice on Time-varying Demandscited by 1
12 most cited of 22 All 22 (JSON)
- 2026Multinomial Subset Routing with Sum-Max Rewards and Operational Constraints17 Aug 2026
- 2026Cost-Aware Multi-Objective Bandits: Theory and Application to Budgeted LLM Configuration Evaluation5 Aug 2026
- 2026Combinatorial Allocation Bandits with Nonlinear Arm Utility7 Mar 2026
- 2026Adaptive Combinatorial Experimental Design: Pareto Optimality for Decision-Making and Inference27 Feb 2026
- 2026Learning with a Budget: Identifying the Best Arm with Resource Constraints27 Feb 2026
- 2025Finite-Time Guarantees for Multi-Agent Combinatorial Bandits with Nonstationary Rewards28 Aug 2025
- 2025No-Regret Learning Under Adversarial Resource Constraints: A Spending Plan Is All You Need!16 Jun 2025
- 2025Adversarial Combinatorial Semi-bandits with Graph Feedback26 Feb 2025
- 2025Stochastically Constrained Best Arm Identification with Thompson Sampling7 Jan 2025
- 2024Learning to Explore with Lagrangians for Bandits under Unknown Linear Constraints24 Oct 2024
- 2024Multi-Task Combinatorial Bandits for Budget Allocation31 Aug 2024
- 2024Best Arm Identification with Resource Constraints29 Feb 2024
12 newest of 22 All 22 (JSON)