Learning under Opponent Unawareness in Linear-Quadratic Stochastic Games
Not on the map. Why?
Abstract (arXiv)
As firms increasingly deploy machine learning for strategic decision-making, understanding algorithmic interactions has become central to operations research and economics. This paper studies learning in infinite-horizon, nonzero-sum linear-quadratic stochastic games under a radically uncoupled information structure, where players are either unaware of opponents or strategically oblivious, observing only a common state and their own action history. Under this minimal information, we analyze an asynchronous decentralized learning process in which each player independently runs a single-agent ε-greedy iterated least-squares algorithm. We prove that, despite being unable to identify the system parameters, players' learning dynamics converge almost surely to the complete-information Nash equilibrium and characterize the convergence rate. We then apply the framework to a dynamic Cournot competition with sticky prices. Numerical experiments validate the theoretical results and show that learning under limited information reduces firm profits under both low and high price stickiness, while total surplus declines and market concentration increases when price stickiness is high. Publicly revealing aggregate market output substantially accelerates convergence and mitigates these welfare losses.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 50 references that are in the map. First posted on arXiv 8 Aug 2026.
Builds on
18 of 50 references.
References · 18
- 2019Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithmscited by 555
- 2018Global Convergence of Policy Gradient Methods for the Linear Quadratic Regulatorcited by 211
- 2018Learning Without Mixing: Towards A Sharp Analysis of Linear System Identificationcited by 158
- 2020Naive Exploration is Optimal for Online LQRcited by 111
- 2018What Doubling Tricks Can and Can't Do for Multi-Armed Banditscited by 69
- 2021Decentralized Q-Learning in Zero-sum Markov Gamescited by 53
- 2024Strategic Collusion of LLM Agents: Market Division in Multi-Commodity Competitionscited by 25
- 2021Independent Learning in Stochastic Gamescited by 20
- 2021Policy Gradient Methods Find the Nash Equilibrium in N-player General-sum Linear-quadratic Gamescited by 19
- 2022Independent and Decentralized Learning in Markov Potential Gamescited by 19
- 2019Policy-Gradient Algorithms Have No Guarantees of Convergence in Linear Quadratic Gamescited by 15
- 2021Doubly Optimal No-Regret Online Learning in Strongly Monotone Games with Bandit Feedbackcited by 14
6 more
- 2018Learning with minimal information in continuous gamescited by 7
- 2020Multi-Agent Reinforcement Learning in Cournot Gamescited by 4
- 2016Linear Quadratic Stochastic Two-Person Nonzero-Sum Differential Games: Open-Loop and Closed-Loop Nash Equilibriacited by 1
- 2024Is Thompson Sampling Susceptible to Algorithmic Collusion?cited by 1
- 2026Strategic AI in Cournot Marketscited by 1
- 2026Learning Distributed Equilibria in Linear-Quadratic Stochastic Differential Games: An α-Potential Approachcited by 1
Built on by
Not cited yet.