Decision Making in Monopoly using a Hybrid Deep Reinforcement Learning Approach
Not on the map. Why?
Abstract (arXiv)
Learning to adapt and make real-time informed decisions in a dynamic and complex environment is a challenging problem. Monopoly is a popular strategic board game that requires players to make multiple decisions during the game. Decision-making in Monopoly involves many real-world elements such as strategizing, luck, and modeling of opponent's policies. In this paper, we present novel representations for the state and action space for the full version of Monopoly and define an improved reward function. Using these, we show that our deep reinforcement learning agent can learn winning strategies for Monopoly against different fixed-policy agents. In Monopoly, players can take multiple actions even if it is not their turn to roll the dice. Some of these actions occur more frequently than others, resulting in a skewed distribution that adversely affects the performance of the learning agent. To tackle the non-uniform distribution of actions, we propose a hybrid approach that combines deep reinforcement learning (for frequent but complex decisions) with a fixed policy approach (for infrequent but straightforward decisions). Experimental results show that our hybrid agent outperforms a standard deep reinforcement learning agent by 30% in the number of games won against fixed-policy agents.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 18 of its 39 references that are in the map. First posted on arXiv 1 Mar 2021.
Builds on
18 of 39 references.
References · 18
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2015Continuous control with deep reinforcement learningcited by 3,279
- 2015Trust Region Policy Optimizationcited by 2,503
- 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,302
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
- 2015Deep Reinforcement Learning with Double Q-learningcited by 1,704
- 2015Prioritized Experience Replaycited by 1,070
- 2017Rainbow: Combining Improvements in Deep Reinforcement Learningcited by 774
- 2015Dueling Network Architectures for Deep Reinforcement Learningcited by 769
- 2017A Brief Survey of Deep Reinforcement Learningcited by 466
- 2017DeepStack: Expert-Level Artificial Intelligence in No-Limit Pokercited by 228
6 more
- 2015Massively Parallel Methods for Deep Reinforcement Learningcited by 80
- 2019No Press Diplomacy: Modeling Multi-Agent Gameplaycited by 37
- 2018StarCraft Micromanagement with Reinforcement Learning and Curriculum Transfer Learningcited by 25
- 2019Lane Change Decision-making through Deep Reinforcement Learning with Rule-based Constraintscited by 24
- 2019Creating Pro-Level AI for a Real-Time Fighting Game Using Deep Reinforcement Learningcited by 14
- 2019Learning to Correlate in Multi-Player General-Sum Sequential Gamescited by 9
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 1; 2025: 0; 2026: 1.
6 papers.
- 2024Global Convergence Guarantees for Federated Policy Gradient Methods with Adversariescited by 6
- 2023On the Global Convergence of Natural Actor-Critic with Two-layer Neural Network Parametrizationcited by 5
- 2022On the Global Convergence of Fitted Q-Iteration with Two-layer Neural Network Parametrizationcited by 3
- 2023Quantum Speedups in Regret Analysis of Infinite Horizon Average-Reward Markov Decision Processescited by 3
- 2026Robots Influencing Humans to Reveal their Goals during Collaboration and Competitioncited by 1
- 2023Methods and Mechanisms for Interactive Novelty Handling in Adversarial Environmentscited by 0
- 2026Robots Influencing Humans to Reveal their Goals during Collaboration and Competition31 Aug 2026
- 2024Global Convergence Guarantees for Federated Policy Gradient Methods with Adversaries15 Mar 2024
- 2023Quantum Speedups in Regret Analysis of Infinite Horizon Average-Reward Markov Decision Processes18 Oct 2023
- 2023On the Global Convergence of Natural Actor-Critic with Two-layer Neural Network Parametrization18 Jun 2023
- 2023Methods and Mechanisms for Interactive Novelty Handling in Adversarial Environments28 Feb 2023
- 2022On the Global Convergence of Fitted Q-Iteration with Two-layer Neural Network Parametrization14 Nov 2022