# Can an AI agent hit a moving target?

arXiv: https://arxiv.org/abs/2110.02474 · HTML: https://mlsanity.com/paper/2110.02474/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 5 of its 43 references that are in the map.
- First posted on arXiv 6 Oct 2021.

## Builds on (most cited first, 5 of 5)

- [Continuous control with deep reinforcement learning](https://mlsanity.com/paper/1509.02971/) (2015)
- [Playing Atari with Deep Reinforcement Learning](https://mlsanity.com/paper/1312.5602/) (2013)
- [Deep Reinforcement Learning in a Monetary Model](https://mlsanity.com/paper/2104.09368/) (2021)
- [Solving Heterogeneous General Equilibrium Economic Models with Deep Reinforcement Learning](https://mlsanity.com/paper/2103.16977/) (2021)
- [Stable Reinforcement Learning with Unbounded State Space](https://mlsanity.com/paper/2006.04353/) (2020)

## Built on by (most cited first, 3 of 3)

- [EconGym: A Scalable AI Testbed with Diverse Economic Tasks](https://mlsanity.com/paper/2506.12110/) (2025)
- [Think, Speak, Decide: Language-Augmented Multi-Agent Reinforcement Learning for Economic Decision-Making](https://mlsanity.com/paper/2511.12876/) (2025)
- [Learning Macroeconomic Policies through Dynamic Stackelberg Mean-Field Games](https://mlsanity.com/paper/2403.12093/) (2024)

## Abstract (arXiv)

I model the belief formation and decision making processes of economic agents during a monetary policy regime change (an acceleration in the money supply) with a deep reinforcement learning algorithm in the AI literature. I show that when the money supply accelerates, the learning agents only adjust their actions, which include consumption and demand for real balance, after gathering learning experience for many periods. This delayed adjustments leads to low returns during transition periods. Once they start adjusting to the new environment, their welfare improves. Their changes in beliefs and actions lead to temporary inflation volatility. I also show that, 1. the AI agents who explores their environment more adapt to the policy regime change quicker, which leads to welfare improvements and less inflation volatility, and 2. the AI agents who have experienced a structural change adjust their beliefs and behaviours quicker than an inexperienced learning agent.