# AlphaZero Gomoku

arXiv: https://arxiv.org/abs/2309.01294 · HTML: https://mlsanity.com/paper/2309.01294/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 3 of its 12 references that are in the map.
- First posted on arXiv 4 Sep 2023.

## Builds on (most cited first, 3 of 3)

- [Deep Reinforcement Learning: An Overview](https://mlsanity.com/paper/1701.07274/) (2017)
- [MiAMix: Enhancing Image Classification through a Multi-stage Augmented Mixed Sample Data Augmentation Method](https://mlsanity.com/paper/2308.02804/) (2023)
- [Cross-Attribute Matrix Factorization Model with Shared User Embedding](https://mlsanity.com/paper/2308.07284/) (2023)

## Abstract (arXiv)

In the past few years, AlphaZero's exceptional capability in mastering intricate board games has garnered considerable interest. Initially designed for the game of Go, this revolutionary algorithm merges deep learning techniques with the Monte Carlo tree search (MCTS) to surpass earlier top-tier methods. In our study, we broaden the use of AlphaZero to Gomoku, an age-old tactical board game also referred to as "Five in a Row." Intriguingly, Gomoku has innate challenges due to a bias towards the initial player, who has a theoretical advantage. To add value, we strive for a balanced game-play. Our tests demonstrate AlphaZero's versatility in adapting to games other than Go. MCTS has become a predominant algorithm for decision processes in intricate scenarios, especially board games. MCTS creates a search tree by examining potential future actions and uses random sampling to predict possible results. By leveraging the best of both worlds, the AlphaZero technique fuses deep learning from Reinforcement Learning with the balancing act of MCTS, establishing a fresh standard in game-playing AI. Its triumph is notably evident in board games such as Go, chess, and shogi.