mlsanityData to 14 Oct 2026

Revisiting Social Welfare in Bandits: UCB is (Nearly) All You Need

arXiv 2510.21312 ↗First posted 24 Oct 2025cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Regret in stochastic multi-armed bandits traditionally measures the difference between the highest reward and either the arithmetic mean of accumulated rewards or the final reward. These conventional metrics often fail to address fairness among agents receiving rewards, particularly in settings where rewards are distributed across a population, such as patients in clinical trials. To address this, a recent body of work has introduced Nash regret, which evaluates performance via the geometric mean of accumulated rewards, aligning with the Nash social welfare function known for satisfying fairness axioms. To minimize Nash regret, existing approaches require specialized algorithm designs and strong assumptions, such as multiplicative concentration inequalities and bounded, non-negative rewards, making them unsuitable for even Gaussian reward distributions. We demonstrate that an initial uniform exploration phase followed by a standard Upper Confidence Bound (UCB) algorithm achieves near-optimal Nash regret, while relying only on additive Hoeffding bounds, and naturally extending to sub-Gaussian rewards. Furthermore, we generalize the algorithm to a broad class of fairness metrics called the p-mean regret, proving (nearly) optimal regret bounds uniformly across all p values. This is in contrast to prior work, which made extremely restrictive assumptions on the bandit instances and even then achieved suboptimal regret bounds.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 14 of its 16 references that are in the map. First posted on arXiv 24 Oct 2025.

Builds on

14 of 16 references.

References · 14

  1. 2016Fairness in Learning: Classic and Contextual Banditscited by 168
  2. 2019Achieving Fairness in the Stochastic Multi-armed Bandit Problemcited by 78
  3. 2020Fair Algorithms for Multi-Agent Multi-Armed Banditscited by 41
  4. 2022Fairness and Welfare Quantification for Regret in Multi-Armed Banditscited by 17
  5. 2022Socially Fair Reinforcement Learningcited by 13
  6. 2021Universal and Tight Online Algorithms for Generalized-Mean Welfarecited by 12
  7. 2022An Efficient Algorithm for Fair Multi-Agent Multi-Armed Bandit with Low Regretcited by 10
  8. 2023Nash Regret Guarantees for Linear Banditscited by 9
  9. 2020Tight Approximation Algorithms for p-Mean Welfare Under Subadditive Valuationscited by 8
  10. 2024No-Regret Learning for Fair Multi-Agent Social Welfare Optimizationcited by 8
  11. 2024On the Fairness of Normalized p-Means for Allocating Goods and Chorescited by 6
  12. 2024p-Mean Regret for Stochastic Banditscited by 6
2 more
  1. 2021Tractable Fragments of the Maximum Nash Welfare Problemcited by 4
  2. 2025DP-NCB: Privacy Preserving Fair Banditscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.