Multi-agent online learning in time-varying games
Not on the map. Why?
Abstract (arXiv)
We examine the long-run behavior of multi-agent online learning in games that evolve over time. Specifically, we focus on a wide class of policies based on mirror descent, and we show that the induced sequence of play (a) converges to Nash equilibrium in time-varying games that stabilize in the long run to a strictly monotone limit; and (b) it stays asymptotically close to the evolving equilibrium of the sequence of stage games (assuming they are strongly monotone). Our results apply to both gradient-based and payoff-based feedback - i.e., the "bandit feedback" case where players only get to observe the payoffs of their chosen actions.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 3; 2023: 4; 2024: 4; 2025: 5; 2026: 1.
17 papers.
Sort:
By area:
- 2022No-Regret Learning in Time-Varying Zero-Sum Gamescited by 36
- 2022A unified stochastic approximation framework for learning in gamescited by 22
- 2023On the Convergence of No-Regret Learning Dynamics in Time-Varying Gamescited by 14
- 2025Incentivizing Truthful Language Models via Peer Elicitation Gamescited by 8
- 2025Independent Learning in Performative Markov Potential Gamescited by 5
- 2023A Black-box Approach for Non-stationary Multi-agent Reinforcement Learningcited by 3
- 2024Last-iterate Convergence Separation between Extra-gradient and Optimism in Constrained Periodic Gamescited by 3
- 2023Exploiting hidden structures in non-convex games for convergence to Nash equilibriumcited by 2
- 2026ALIGN: Aligned Delegation with Performance Guarantees for Multi-Agent LLM Reasoningcited by 2
- 2022Personalized incentives as feedback design in generalized Nash equilibrium problemscited by 1
- 2024Tracking solutions of time-varying variational inequalitiescited by 1
- 2025Learning from Delayed Feedback in Games via Extra Predictioncited by 1
5 more
- 2023An Imitation Learning Based Algorithm Enabling Priori Knowledge Transfer in Modern Electricity Markets for Bayesian Nash Equilibrium Estimationcited by 0
- 2024Nested replicator dynamics, nested logit choice, and similarity-based learningcited by 0
- 2024An Online Feasible Point Method for Benign Generalized Nash Equilibrium Problemscited by 0
- 2025Online Multi-Agent Control with Adversarial Disturbancescited by 0
- 2025Characterizing Nash Equilibria in Zero-Sum Games: A Physics-Inspired, Parallelizable Approach with a Linear Number of Gradient Queriescited by 0
- 2026ALIGN: Aligned Delegation with Performance Guarantees for Multi-Agent LLM Reasoning28 Jan 2026
- 2025Learning from Delayed Feedback in Games via Extra Prediction26 Sep 2025
- 2025Characterizing Nash Equilibria in Zero-Sum Games: A Physics-Inspired, Parallelizable Approach with a Linear Number of Gradient Queries15 Jul 2025
- 2025Online Multi-Agent Control with Adversarial Disturbances23 Jun 2025
- 2025Incentivizing Truthful Language Models via Peer Elicitation Games19 May 2025
- 2025Independent Learning in Performative Markov Potential Games29 Apr 2025
- 2024An Online Feasible Point Method for Benign Generalized Nash Equilibrium Problems3 Oct 2024
- 2024Nested replicator dynamics, nested logit choice, and similarity-based learning25 Jul 2024
- 2024Tracking solutions of time-varying variational inequalities20 Jun 2024
- 2024Last-iterate Convergence Separation between Extra-gradient and Optimism in Constrained Periodic Games15 Jun 2024
- 2023Exploiting hidden structures in non-convex games for convergence to Nash equilibrium27 Dec 2023
- 2023A Black-box Approach for Non-stationary Multi-agent Reinforcement Learning12 Jun 2023
5 more
- 2023An Imitation Learning Based Algorithm Enabling Priori Knowledge Transfer in Modern Electricity Markets for Bayesian Nash Equilibrium Estimation4 May 2023
- 2023On the Convergence of No-Regret Learning Dynamics in Time-Varying Games26 Jan 2023
- 2022A unified stochastic approximation framework for learning in games8 Jun 2022
- 2022Personalized incentives as feedback design in generalized Nash equilibrium problems24 Mar 2022
- 2022No-Regret Learning in Time-Varying Zero-Sum Games30 Jan 2022
- 2022No-Regret Learning in Time-Varying Zero-Sum Gamescited by 36
- 2022A unified stochastic approximation framework for learning in gamescited by 22
- 2023On the Convergence of No-Regret Learning Dynamics in Time-Varying Gamescited by 14
- 2025Incentivizing Truthful Language Models via Peer Elicitation Gamescited by 8
- 2025Independent Learning in Performative Markov Potential Gamescited by 5
- 2023A Black-box Approach for Non-stationary Multi-agent Reinforcement Learningcited by 3
- 2024Last-iterate Convergence Separation between Extra-gradient and Optimism in Constrained Periodic Gamescited by 3
- 2023Exploiting hidden structures in non-convex games for convergence to Nash equilibriumcited by 2
- 2022Personalized incentives as feedback design in generalized Nash equilibrium problemscited by 1
- 2024Tracking solutions of time-varying variational inequalitiescited by 1
- 2025Learning from Delayed Feedback in Games via Extra Predictioncited by 1
- 2023An Imitation Learning Based Algorithm Enabling Priori Knowledge Transfer in Modern Electricity Markets for Bayesian Nash Equilibrium Estimationcited by 0
12 most cited of 16 All 16 (JSON)
- 2025Learning from Delayed Feedback in Games via Extra Prediction26 Sep 2025
- 2025Characterizing Nash Equilibria in Zero-Sum Games: A Physics-Inspired, Parallelizable Approach with a Linear Number of Gradient Queries15 Jul 2025
- 2025Online Multi-Agent Control with Adversarial Disturbances23 Jun 2025
- 2025Incentivizing Truthful Language Models via Peer Elicitation Games19 May 2025
- 2025Independent Learning in Performative Markov Potential Games29 Apr 2025
- 2024An Online Feasible Point Method for Benign Generalized Nash Equilibrium Problems3 Oct 2024
- 2024Nested replicator dynamics, nested logit choice, and similarity-based learning25 Jul 2024
- 2024Tracking solutions of time-varying variational inequalities20 Jun 2024
- 2024Last-iterate Convergence Separation between Extra-gradient and Optimism in Constrained Periodic Games15 Jun 2024
- 2023Exploiting hidden structures in non-convex games for convergence to Nash equilibrium27 Dec 2023
- 2023A Black-box Approach for Non-stationary Multi-agent Reinforcement Learning12 Jun 2023
- 2023An Imitation Learning Based Algorithm Enabling Priori Knowledge Transfer in Modern Electricity Markets for Bayesian Nash Equilibrium Estimation4 May 2023
12 newest of 16 All 16 (JSON)