Fair Algorithms for Multi-Agent Multi-Armed Bandits
Not on the map. Why?
Abstract (arXiv)
We propose a multi-agent variant of the classical multi-armed bandit problem, in which there are N agents and K arms, and pulling an arm generates a (possibly different) stochastic reward for each agent. Unlike the classical multi-armed bandit problem, the goal is not to learn the "best arm"; indeed, each agent may perceive a different arm to be the best for her personally. Instead, we seek to learn a fair distribution over the arms. Drawing on a long line of research in economics and computer science, we use the Nash social welfare as our notion of fairness. We design multi-agent variants of three classic multi-armed bandit algorithms and show that they achieve sublinear regret, which is now measured in terms of the lost Nash social welfare.
Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 7; 2023: 8; 2024: 13; 2025: 7; 2026: 5.
41 papers.
Sort:
By area:
- 2022Multi-agent Dynamic Algorithm Configurationcited by 36
- 2022Fairness and Welfare Quantification for Regret in Multi-Armed Banditscited by 17
- 2023Runtime Monitoring of Dynamic Fairness Propertiescited by 17
- 2022Socially Fair Reinforcement Learningcited by 13
- 2022An Efficient Algorithm for Fair Multi-Agent Multi-Armed Bandit with Low Regretcited by 10
- 2022Online Approval Committee Electionscited by 9
- 2023Nash Regret Guarantees for Linear Banditscited by 9
- 2022Mitigating Disparity while Maximizing Reward: Tight Anytime Guarantee for Improving Banditscited by 8
- 2023Learning with Exposure Constraints in Recommendation Systemscited by 8
- 2023Achieving Fairness in Multi-Agent Markov Decision Processes Using Reinforcement Learningcited by 8
- 2024No-Regret Learning for Fair Multi-Agent Social Welfare Optimizationcited by 7
- 2023On-Demand Communication for Asynchronous Multi-Agent Banditscited by 6
29 more
- 2023BanditQ: Fair Bandits with Guaranteed Rewardscited by 6
- 2024p-Mean Regret for Stochastic Banditscited by 6
- 2021Decentralized Task Offloading in Edge Computing: A Multi-User Multi-Armed Bandit Approachcited by 5
- 2024Fair Online Bilateral Tradecited by 4
- 2024Keep Everyone Happy: Online Fair Division of Numerous Items with Few Copiescited by 4
- 2024Stochastic Bandits for Egalitarian Assignmentcited by 4
- 2022Ranked Prioritization of Groups in Combinatorial Bandit Allocationcited by 3
- 2024Federated Linear Contextual Bandits with Heterogeneous Clientscited by 3
- 2024Fair Best Arm Identification with Fixed Confidencecited by 3
- 2025Revisiting Social Welfare in Bandits: UCB is (Nearly) All You Needcited by 3
- 2023Bandit Learning to Rank with Position-Based Click Models: Personalized and Equal Treatmentscited by 2
- 2025Beyond Predictions: A Participatory Framework for Multi-Stakeholder Decision-Makingcited by 2
- 2024Fairness and Privacy Guarantees in Federated Contextual Banditscited by 1
- 2024Simultaneously Achieving Group Exposure Fairness and Within-Group Meritocracy in Stochastic Banditscited by 1
- 2024A Note on Bias to Completecited by 1
- 2024Intuitions of Compromise: Utilitarianism vs. Contractualismcited by 1
- 2024QuACK: A Multipurpose Queuing Algorithm for Cooperative k-Armed Banditscited by 1
- 2024Fairness in Reinforcement Learning with Bisimulation Metricscited by 1
- 2025Bandit Max-Min Fair Allocationcited by 1
- 2025Fair Algorithms with Probing for Multi-Agent Multi-Armed Banditscited by 1
- 2025Your Recourse, My Loss? Algorithmic Recourse under Shared Constraintscited by 1
- 2026Multi-Objective Multi-Agent Bandits: From Learning Efficiency to Fairness Optimizationcited by 1
- 2023Disincentivizing Polarization in Social Networkscited by 0
- 2025Multi-agent Multi-armed Bandits with Minimum Reward Guarantee Fairnesscited by 0
- 2025Fairness in the Multi-Secretary Problemcited by 0
- 2026Procedural Fairness in Multi-Agent Banditscited by 0
- 2026Envy-Free Allocation of Indivisible Goods via Noisy Queriescited by 0
- 2026Multi-User Dueling Bandits: A Fair Approach using Nash Social Welfarecited by 0
- 2026The Optimization Trilemma: Efficiency, Comfort and Fairness in Decentralized Multi-agent Coordinationcited by 0
- 2026The Optimization Trilemma: Efficiency, Comfort and Fairness in Decentralized Multi-agent Coordination19 Jul 2026
- 2026Multi-Objective Multi-Agent Bandits: From Learning Efficiency to Fairness Optimization7 May 2026
- 2026Multi-User Dueling Bandits: A Fair Approach using Nash Social Welfare3 May 2026
- 2026Envy-Free Allocation of Indivisible Goods via Noisy Queries6 Feb 2026
- 2026Procedural Fairness in Multi-Agent Bandits15 Jan 2026
- 2025Fairness in the Multi-Secretary Problem28 Nov 2025
- 2025Revisiting Social Welfare in Bandits: UCB is (Nearly) All You Need24 Oct 2025
- 2025Your Recourse, My Loss? Algorithmic Recourse under Shared Constraints14 Aug 2025
- 2025Fair Algorithms with Probing for Multi-Agent Multi-Armed Bandits17 Jun 2025
- 2025Bandit Max-Min Fair Allocation8 May 2025
- 2025Multi-agent Multi-armed Bandits with Minimum Reward Guarantee Fairness21 Feb 2025
- 2025Beyond Predictions: A Participatory Framework for Multi-Stakeholder Decision-Making12 Feb 2025
29 more
- 2024Fairness in Reinforcement Learning with Bisimulation Metrics22 Dec 2024
- 2024p-Mean Regret for Stochastic Bandits14 Dec 2024
- 2024QuACK: A Multipurpose Queuing Algorithm for Cooperative k-Armed Bandits31 Oct 2024
- 2024Stochastic Bandits for Egalitarian Assignment8 Oct 2024
- 2024Intuitions of Compromise: Utilitarianism vs. Contractualism7 Oct 2024
- 2024Fair Best Arm Identification with Fixed Confidence30 Aug 2024
- 2024Keep Everyone Happy: Online Fair Division of Numerous Items with Few Copies23 Aug 2024
- 2024No-Regret Learning for Fair Multi-Agent Social Welfare Optimization31 May 2024
- 2024Fair Online Bilateral Trade22 May 2024
- 2024Federated Linear Contextual Bandits with Heterogeneous Clients29 Feb 2024
- 2024A Note on Bias to Complete18 Feb 2024
- 2024Simultaneously Achieving Group Exposure Fairness and Within-Group Meritocracy in Stochastic Bandits8 Feb 2024
- 2024Fairness and Privacy Guarantees in Federated Contextual Bandits5 Feb 2024
- 2023Bandit Learning to Rank with Position-Based Click Models: Personalized and Equal Treatments8 Nov 2023
- 2023Nash Regret Guarantees for Linear Bandits3 Oct 2023
- 2023Achieving Fairness in Multi-Agent Markov Decision Processes Using Reinforcement Learning1 Jun 2023
- 2023Disincentivizing Polarization in Social Networks23 May 2023
- 2023Runtime Monitoring of Dynamic Fairness Properties8 May 2023
- 2023BanditQ: Fair Bandits with Guaranteed Rewards11 Apr 2023
- 2023On-Demand Communication for Asynchronous Multi-Agent Bandits15 Feb 2023
- 2023Learning with Exposure Constraints in Recommendation Systems2 Feb 2023
- 2022Multi-agent Dynamic Algorithm Configuration13 Oct 2022
- 2022An Efficient Algorithm for Fair Multi-Agent Multi-Armed Bandit with Low Regret23 Sep 2022
- 2022Socially Fair Reinforcement Learning26 Aug 2022
- 2022Mitigating Disparity while Maximizing Reward: Tight Anytime Guarantee for Improving Bandits19 Aug 2022
- 2022Fairness and Welfare Quantification for Regret in Multi-Armed Bandits27 May 2022
- 2022Ranked Prioritization of Groups in Combinatorial Bandit Allocation11 May 2022
- 2022Online Approval Committee Elections14 Feb 2022
- 2021Decentralized Task Offloading in Edge Computing: A Multi-User Multi-Armed Bandit Approach22 Dec 2021
- 2022Multi-agent Dynamic Algorithm Configurationcited by 36
- 2022Fairness and Welfare Quantification for Regret in Multi-Armed Banditscited by 17
- 2023Runtime Monitoring of Dynamic Fairness Propertiescited by 17
- 2022Socially Fair Reinforcement Learningcited by 13
- 2022An Efficient Algorithm for Fair Multi-Agent Multi-Armed Bandit with Low Regretcited by 10
- 2022Online Approval Committee Electionscited by 9
- 2023Nash Regret Guarantees for Linear Banditscited by 9
- 2022Mitigating Disparity while Maximizing Reward: Tight Anytime Guarantee for Improving Banditscited by 8
- 2023Learning with Exposure Constraints in Recommendation Systemscited by 8
- 2023Achieving Fairness in Multi-Agent Markov Decision Processes Using Reinforcement Learningcited by 8
- 2024No-Regret Learning for Fair Multi-Agent Social Welfare Optimizationcited by 7
- 2023On-Demand Communication for Asynchronous Multi-Agent Banditscited by 6
12 most cited of 40 All 40 (JSON)
- 2026The Optimization Trilemma: Efficiency, Comfort and Fairness in Decentralized Multi-agent Coordination19 Jul 2026
- 2026Multi-Objective Multi-Agent Bandits: From Learning Efficiency to Fairness Optimization7 May 2026
- 2026Envy-Free Allocation of Indivisible Goods via Noisy Queries6 Feb 2026
- 2026Procedural Fairness in Multi-Agent Bandits15 Jan 2026
- 2025Fairness in the Multi-Secretary Problem28 Nov 2025
- 2025Revisiting Social Welfare in Bandits: UCB is (Nearly) All You Need24 Oct 2025
- 2025Your Recourse, My Loss? Algorithmic Recourse under Shared Constraints14 Aug 2025
- 2025Fair Algorithms with Probing for Multi-Agent Multi-Armed Bandits17 Jun 2025
- 2025Bandit Max-Min Fair Allocation8 May 2025
- 2025Multi-agent Multi-armed Bandits with Minimum Reward Guarantee Fairness21 Feb 2025
- 2025Beyond Predictions: A Participatory Framework for Multi-Stakeholder Decision-Making12 Feb 2025
- 2024Fairness in Reinforcement Learning with Bisimulation Metrics22 Dec 2024
12 newest of 40 All 40 (JSON)