Multi-Head Attention Is a Multi-Player Game
Not on the map. Why?
Abstract (arXiv)
Modern transformer attention is internally multi-agent -- heads compete and coordinate -- yet we train it as if it were a monolithic optimizer. We formalize this gap: cross-entropy training induces an implicit potential game among heads, and gradient descent converges to Nash equilibria with potentially unbounded inefficiency due to unpriced externalities (redundancy, correlated errors). Our main result bounds the Price of Anarchy by Gamma(G), the off-diagonal mass of a head interaction matrix capturing weight and gradient coupling. Under mild smoothness assumptions, we prove that both excess hallucination probability and excess head redundancy scale with PoA, unifying two distinct failure modes into a single mechanism. The bound is prescriptive: regularization that reduces Gamma(G) provably tightens PoA. We instantiate this as GAME-LoRA, combining Barlow Twins decorrelation with log-determinant coordination pressure. Experiments validate the theory: Gamma(G) predicts hallucination (p<0.05), emergent coalitions exhibit selective coordination, and GAME-LoRA achieves up to 18% hallucination reduction (8% average) with no knowledge degradation -- a Pareto improvement inaccessible to methods ignoring the game structure.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 29 of its 36 references that are in the map. First posted on arXiv 31 Jan 2026.
Builds on
29 of 36 references.
References · 29
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2016Pointer Sentinel Mixture Modelscited by 3,096
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,838
- 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,128
- 2022In-context Learning and Induction Headscited by 964
- 2016Deep Variational Information Bottleneckcited by 930
- 2019Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Prunedcited by 856
- 2019Are Sixteen Heads Really Better than One?cited by 816
- 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 698
17 more
- 2023Dissecting Recall of Factual Associations in Auto-Regressive Language Modelscited by 528
- 2023Trusting Your Evidence: Hallucinate Less with Context-aware Decodingcited by 327
- 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 324
- 2024INSIDE: LLMs' Internal States Retain the Power of Hallucination Detectioncited by 323
- 2024Retrieval Head Mechanistically Explains Long-Context Factualitycited by 232
- 2022Multi-Task Learning as a Bargaining Gamecited by 215
- 2020Learning Robust Representations via Multi-View Information Bottleneckcited by 191
- 2023Mitigating the Alignment Tax of RLHFcited by 183
- 2024Direct Nash Optimization: Teaching Language Models to Self-Improve with General Preferencescited by 178
- 2025Safety Tax: Safety Alignment Makes Your Large Reasoning Models Less Reasonablecited by 122
- 2018The Mechanics of n-Player Differentiable Gamescited by 118
- 2024A Closer Look at Machine Unlearning for Large Language Modelscited by 56
- 2018Multi-Head Attention with Disagreement Regularizationcited by 35
- 2023Teaching Language Models to Hallucinate Less with Synthetic Taskscited by 31
- 2024Magnetic Preference Optimization: Achieving Last-iterate Convergence for Language Model Alignmentcited by 20
- 2020D3C: Reducing the Price of Anarchy in Multi-Agent Learningcited by 16
- 2025Neural Diversity Regularizes Hallucinations in Language Modelscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.