The Coordination Gap: Multi-Agent Alternation Metrics for Temporal Fairness in Repeated Games
Not on the map. Why?
Abstract (arXiv)
Repeated multi-agent interactions require evaluation metrics that capture not only payoff distributions but also their temporal organization. Conventional outcome-based fairness measures can assign similar aggregate scores to temporally distinct coordination patterns, obscuring whether access to a shared resource is genuinely rotating or persistently monopolized. We study this problem in the Honey-Jar Game (HJG), a minimally dynamic repeated threshold-congestion Markov game in which n agents compete for exclusive access to a single high-reward resource. We introduce Perfect Alternation (PA), a reference turn-taking regime corresponding to the n-periodic round-robin picking sequence, together with six novel Alternation (ALT) metrics and a benchmarking methodology mapping ALT values to interpretable PA-equivalent performance. Using Q-learning agents as a minimal adaptive baseline against analytically derived random-policy baselines, we uncover a clear measurement failure: despite deceptively high traditional metrics (e.g., reward fairness often exceeding 0.9), learned policies perform worse than random on every ALT metric, by 34-74% on CALT and up to 92% on EALT, with PA-equivalent coordination falling to roughly one-fifth of the population at n=10. EALT further reveals two distinct failure patterns: without episodic memory (Type-A), the deficit grows from -20% at n=2 to -92% at n=10; with episodic memory (Type-B), it reaches a trough of -76% at n=5 before partially recovering to -10% at n=10. Conventional efficiency and fairness metrics do not reveal these differences. The ALT framework complements the temporal fair division and picking-sequence literature by diagnosing whether temporal fairness emerges spontaneously in decentralized adaptive systems rather than how to enforce it.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 11 of its 57 references that are in the map. First posted on arXiv 6 Mar 2026.
Builds on
11 of 57 references.
References · 11
- 2017A multi-agent reinforcement learning model of common-pool resource appropriationcited by 69
- 2019Learning Fairness in Multi-Agent Systemscited by 44
- 2024Temporal Fair Division of Indivisible Itemscited by 11
- 2024Temporal Fair Divisioncited by 8
- 2018Modeling the Formation of Social Conventions from Embodied Real-Time Interactionscited by 4
- 2023Weighted Fair Division with Matroid-Rank Valuations: Monotonicity and Strategyproofnesscited by 4
- 2021Generalized binary utility functions and fair allocationscited by 3
- 2019Loss aversion fosters coordination among independent reinforcement learnerscited by 2
- 2026Temporal Fair Division of Indivisible Goods with Schedulingcited by 2
- 2026Perpetually Fair Assignments Via Balanced Sequences of Permutationscited by 2
- 2024Purely vision-based collective movement of robotscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2023Achieving Fairness in Multi-Agent Markov Decision Processes Using Reinforcement Learning
- 2026α-fair heterogeneous agent reinforcement learning
- 2024Convex Markov Games: A New Frontier for Multi-Agent Reinforcement Learning
- 2025AdaFair-MARL: Enforcing Adaptive Fairness Constraints in Multi-Agent Reinforcement Learning
- 2024Fairness in Reinforcement Learning with Bisimulation Metrics
- 2026Fairness over Equality: Correcting Social Incentives in Asymmetric Sequential Social Dilemmas
- 2026Examining Agents' Bias Amplification versus Suppression in Multi-Agent Systems
- 2026Agent Island: A Saturation- and Contamination-Resistant Benchmark from Multiagent Games