Beyond log2(T) Regret for Decentralized Bandits in Matching Markets
Not on the map. Why?
Abstract (arXiv)
We design decentralized algorithms for regret minimization in the two-sided matching market with one-sided bandit feedback that significantly improves upon the prior works (Liu et al. 2020a, 2020b, Sankararaman et al. 2020). First, for general markets, for any varepsilon > 0, we design an algorithm that achieves a O(log1+varepsilon(T)) regret to the agent-optimal stable matching, with unknown time horizon T, improving upon the O(log2(T)) regret achieved in (Liu et al. 2020b). Second, we provide the optimal Theta(log(T)) agent-optimal regret for markets satisfying uniqueness consistency -- markets where leaving participants don't alter the original stable matching. Previously, Theta(log(T)) regret was achievable (Sankararaman et al. 2020, Liu et al. 2020b) in the much restricted serial dictatorship setting, when all arms have the same preference over the agents. We propose a phase-based algorithm, wherein each phase, besides deleting the globally communicated dominated arms the agents locally delete arms with which they collide often. This local deletion is pivotal in breaking deadlocks arising from rank heterogeneity of agents across arms. We further demonstrate the superiority of our algorithm over existing works through simulations.
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). Builds on 18 of its 30 references that are in the map. First posted on arXiv 12 Mar 2021.
Builds on
18 of 30 references.
References · 18
- 2019Introduction to Multi-Armed Banditscited by 475
- 2019Competing Bandits in Matching Marketscited by 54
- 2019Social Learning in Multi Agent Multi Armed Banditscited by 48
- 2013Distributed Exploration in Multi-Armed Banditscited by 46
- 2018SIC-MMAB: Synchronisation Involves Communication in Multiplayer Multi-Armed Banditscited by 46
- 2020Bandit Learning in Decentralized Matching Marketscited by 46
- 2020Distributed Cooperative Decision Making in Multi-agent Multi-armed Banditscited by 38
- 2020The Gossiping Insert-Eliminate Algorithm for Multi-Agent Banditscited by 37
- 2020Cooperative Multi-Agent Bandits with Heavy Tailscited by 31
- 2016Collaborative Learning of Stochastic Bandits over a Social Networkcited by 29
- 2019A Practical Algorithm for Multiplayer Bandits when Arm Means Vary Among Playerscited by 25
- 2016Matching while Learningcited by 19
6 more
- 2020Learning Strategies in Decentralized Matching Markets under Uncertain Preferencescited by 14
- 2020Selfish Robustness and Equilibria in Multi-Player Banditscited by 13
- 2018Game of Thrones: Fully Distributed Learning for Multi-Player Banditscited by 12
- 2019Multiplayer Bandit Learning, from Competition to Cooperationcited by 12
- 2020Competing Bandits: The Perils of Exploration Under Competitioncited by 12
- 2020Dominate or Delete: Decentralized Competing Bandits in Serial Dictatorshipcited by 7
Built on by
Citing papers per year: 2021: 3; 2022: 5; 2023: 3; 2024: 7; 2025: 5; 2026: 6.
29 papers.
Sort:
- 2021Learning Equilibria in Matching Markets from Bandit Feedbackcited by 34
- 2022A survey on multi-player banditscited by 18
- 2022Learn to Match with No Regret: Reinforcement Learning in Markov Matching Marketscited by 16
- 2023Player-optimal Stable Regret for Bandit Learning in Matching Marketscited by 16
- 2021Deep Learning for Two-Sided Matchingcited by 15
- 2022Thompson Sampling for Bandit Learning in Matching Marketscited by 10
- 2021Decentralized Learning in Online Queuing Systemscited by 7
- 2023Competing for Shareable Arms in Multi-Player Multi-Armed Banditscited by 6
- 2024Improved Bandits in Many-to-one Matching Markets with Incentive Compatibilitycited by 6
- 2024Putting Gale & Shapley to Work: Guaranteeing Stability Through Learningcited by 6
- 2023Two-sided Competing Matching Recommendation Markets With Quota and Complementary Preferences Constraintscited by 5
- 2022Decentralized Competing Bandits in Non-Stationary Matching Marketscited by 4
17 more
- 2025Probably Correct Optimal Stable Matching for Two-Sided Markets Under Uncertaintycited by 3
- 2024Decentralized and Uncoordinated Learning of Stable Matchings: A Game-Theoretic Approachcited by 2
- 2024Stable Matching with Ties: Approximation Ratios and Learningcited by 2
- 2025Competing Bandits in Matching Markets via Super Stabilitycited by 2
- 2024Competing Bandits in Decentralized Contextual Matching Marketscited by 1
- 2024Bandit Learning in Matching Markets: Utilitarian and Rawlsian Perspectivescited by 1
- 2026Online Learning and Equilibrium Computation with Ranking Feedbackcited by 1
- 2022Double Auctions with Two-sided Bandit Feedbackcited by 0
- 2024PPA-Game: Characterizing and Learning Competitive Dynamics Among Online Content Creatorscited by 0
- 2025Learning in Matching Games with Bandit Feedbackcited by 0
- 2025Stochastic Matching Bandits with Rare Optimization Updatescited by 0
- 2025Optimal Analysis for Bandit Learning in Matching Markets with Serial Dictatorshipcited by 0
- 2026Regret Analysis of Sleeping Competing Banditscited by 0
- 2026Adaptive Bandit Algorithms for Contextual Matching Marketscited by 0
- 2026Learn to Match: Two-Sided Matching with Temporally Extended Feedbackcited by 0
- 2026Matching Markets meet Cumulative Prospect Theory: Towards Optimal and Adversarially Robust Learningcited by 0
- 2026Probably Correct Optimal Stable Matching under Two-Sided Uncertaintycited by 0
- 2026Probably Correct Optimal Stable Matching under Two-Sided Uncertainty6 Jul 2026
- 2026Matching Markets meet Cumulative Prospect Theory: Towards Optimal and Adversarially Robust Learning18 Jun 2026
- 2026Learn to Match: Two-Sided Matching with Temporally Extended Feedback4 Jun 2026
- 2026Adaptive Bandit Algorithms for Contextual Matching Markets27 May 2026
- 2026Regret Analysis of Sleeping Competing Bandits20 Mar 2026
- 2026Online Learning and Equilibrium Computation with Ranking Feedback19 Mar 2026
- 2025Optimal Analysis for Bandit Learning in Matching Markets with Serial Dictatorship7 Dec 2025
- 2025Stochastic Matching Bandits with Rare Optimization Updates4 Sep 2025
- 2025Competing Bandits in Matching Markets via Super Stability19 Jun 2025
- 2025Learning in Matching Games with Bandit Feedback4 Jun 2025
- 2025Probably Correct Optimal Stable Matching for Two-Sided Markets Under Uncertainty6 Jan 2025
- 2024Bandit Learning in Matching Markets: Utilitarian and Rawlsian Perspectives30 Nov 2024
17 more
- 2024Competing Bandits in Decentralized Contextual Matching Markets18 Nov 2024
- 2024Stable Matching with Ties: Approximation Ratios and Learning5 Nov 2024
- 2024Putting Gale & Shapley to Work: Guaranteeing Stability Through Learning6 Oct 2024
- 2024Decentralized and Uncoordinated Learning of Stable Matchings: A Game-Theoretic Approach31 Jul 2024
- 2024PPA-Game: Characterizing and Learning Competitive Dynamics Among Online Content Creators22 Mar 2024
- 2024Improved Bandits in Many-to-one Matching Markets with Incentive Compatibility3 Jan 2024
- 2023Player-optimal Stable Regret for Bandit Learning in Matching Markets20 Jul 2023
- 2023Competing for Shareable Arms in Multi-Player Multi-Armed Bandits30 May 2023
- 2023Two-sided Competing Matching Recommendation Markets With Quota and Complementary Preferences Constraints24 Jan 2023
- 2022A survey on multi-player bandits29 Nov 2022
- 2022Double Auctions with Two-sided Bandit Feedback13 Aug 2022
- 2022Decentralized Competing Bandits in Non-Stationary Matching Markets31 May 2022
- 2022Thompson Sampling for Bandit Learning in Matching Markets26 Apr 2022
- 2022Learn to Match with No Regret: Reinforcement Learning in Markov Matching Markets7 Mar 2022
- 2021Learning Equilibria in Matching Markets from Bandit Feedback19 Aug 2021
- 2021Deep Learning for Two-Sided Matching7 Jul 2021
- 2021Decentralized Learning in Online Queuing Systems8 Jun 2021
- 2021Learning Equilibria in Matching Markets from Bandit Feedbackcited by 34
- 2022A survey on multi-player banditscited by 18
- 2022Learn to Match with No Regret: Reinforcement Learning in Markov Matching Marketscited by 16
- 2023Player-optimal Stable Regret for Bandit Learning in Matching Marketscited by 16
- 2021Deep Learning for Two-Sided Matchingcited by 15
- 2022Thompson Sampling for Bandit Learning in Matching Marketscited by 10
- 2021Decentralized Learning in Online Queuing Systemscited by 7
- 2023Competing for Shareable Arms in Multi-Player Multi-Armed Banditscited by 6
- 2024Improved Bandits in Many-to-one Matching Markets with Incentive Compatibilitycited by 6
- 2024Putting Gale & Shapley to Work: Guaranteeing Stability Through Learningcited by 6
- 2023Two-sided Competing Matching Recommendation Markets With Quota and Complementary Preferences Constraintscited by 5
- 2022Decentralized Competing Bandits in Non-Stationary Matching Marketscited by 4
12 most cited of 29 All 29 (JSON)
- 2026Probably Correct Optimal Stable Matching under Two-Sided Uncertainty6 Jul 2026
- 2026Matching Markets meet Cumulative Prospect Theory: Towards Optimal and Adversarially Robust Learning18 Jun 2026
- 2026Learn to Match: Two-Sided Matching with Temporally Extended Feedback4 Jun 2026
- 2026Adaptive Bandit Algorithms for Contextual Matching Markets27 May 2026
- 2026Regret Analysis of Sleeping Competing Bandits20 Mar 2026
- 2026Online Learning and Equilibrium Computation with Ranking Feedback19 Mar 2026
- 2025Optimal Analysis for Bandit Learning in Matching Markets with Serial Dictatorship7 Dec 2025
- 2025Stochastic Matching Bandits with Rare Optimization Updates4 Sep 2025
- 2025Competing Bandits in Matching Markets via Super Stability19 Jun 2025
- 2025Learning in Matching Games with Bandit Feedback4 Jun 2025
- 2025Probably Correct Optimal Stable Matching for Two-Sided Markets Under Uncertainty6 Jan 2025
- 2024Bandit Learning in Matching Markets: Utilitarian and Rawlsian Perspectives30 Nov 2024
12 newest of 29 All 29 (JSON)