mlsanityData to 14 Oct 2026

The Coordination Gap: Multi-Agent Alternation Metrics for Temporal Fairness in Repeated Games

arXiv 2603.05789 ↗First posted 6 Mar 2026cs.MA cs.GT cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Repeated multi-agent interactions require evaluation metrics that capture not only payoff distributions but also their temporal organization. Conventional outcome-based fairness measures can assign similar aggregate scores to temporally distinct coordination patterns, obscuring whether access to a shared resource is genuinely rotating or persistently monopolized. We study this problem in the Honey-Jar Game (HJG), a minimally dynamic repeated threshold-congestion Markov game in which n agents compete for exclusive access to a single high-reward resource. We introduce Perfect Alternation (PA), a reference turn-taking regime corresponding to the n-periodic round-robin picking sequence, together with six novel Alternation (ALT) metrics and a benchmarking methodology mapping ALT values to interpretable PA-equivalent performance. Using Q-learning agents as a minimal adaptive baseline against analytically derived random-policy baselines, we uncover a clear measurement failure: despite deceptively high traditional metrics (e.g., reward fairness often exceeding 0.9), learned policies perform worse than random on every ALT metric, by 34-74% on CALT and up to 92% on EALT, with PA-equivalent coordination falling to roughly one-fifth of the population at n=10. EALT further reveals two distinct failure patterns: without episodic memory (Type-A), the deficit grows from -20% at n=2 to -92% at n=10; with episodic memory (Type-B), it reaches a trough of -76% at n=5 before partially recovering to -10% at n=10. Conventional efficiency and fairness metrics do not reveal these differences. The ALT framework complements the temporal fair division and picking-sequence literature by diagnosing whether temporal fairness emerges spontaneously in decentralized adaptive systems rather than how to enforce it.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 11 of its 57 references that are in the map. First posted on arXiv 6 Mar 2026.

Builds on

11 of 57 references.

References · 11

  1. 2017A multi-agent reinforcement learning model of common-pool resource appropriationcited by 69
  2. 2019Learning Fairness in Multi-Agent Systemscited by 44
  3. 2024Temporal Fair Division of Indivisible Itemscited by 11
  4. 2024Temporal Fair Divisioncited by 8
  5. 2018Modeling the Formation of Social Conventions from Embodied Real-Time Interactionscited by 4
  6. 2023Weighted Fair Division with Matroid-Rank Valuations: Monotonicity and Strategyproofnesscited by 4
  7. 2021Generalized binary utility functions and fair allocationscited by 3
  8. 2019Loss aversion fosters coordination among independent reinforcement learnerscited by 2
  9. 2026Temporal Fair Division of Indivisible Goods with Schedulingcited by 2
  10. 2026Perpetually Fair Assignments Via Balanced Sequences of Permutationscited by 2
  11. 2024Purely vision-based collective movement of robotscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2023Achieving Fairness in Multi-Agent Markov Decision Processes Using Reinforcement Learning
  2. 2026α-fair heterogeneous agent reinforcement learning
  3. 2024Convex Markov Games: A New Frontier for Multi-Agent Reinforcement Learning
  4. 2025AdaFair-MARL: Enforcing Adaptive Fairness Constraints in Multi-Agent Reinforcement Learning
  5. 2024Fairness in Reinforcement Learning with Bisimulation Metrics
  6. 2026Fairness over Equality: Correcting Social Incentives in Asymmetric Sequential Social Dilemmas
  7. 2026Examining Agents' Bias Amplification versus Suppression in Multi-Agent Systems
  8. 2026Agent Island: A Saturation- and Contamination-Resistant Benchmark from Multiagent Games