mlsanityData to 14 Oct 2026

Playing Hex and Counter Wargames using Reinforcement Learning and Recurrent Neural Networks

arXiv 2502.13918 ↗First posted 19 Feb 2025cs.LGcited by 0

On the map: Deep reinforcement learning methods → RL for games and combinatorial optimization

Abstract (arXiv)

Hex and Counter Wargames are adversarial two-player simulations of real military conflicts requiring complex strategic decision-making. Unlike classical board games, these games feature intricate terrain/unit interactions, unit stacking, large maps of varying sizes, and simultaneous move and combat decisions involving hundreds of units. This paper introduces a novel system designed to address the strategic complexity of Hex and Counter Wargames by integrating cutting-edge advancements in Recurrent Neural Networks with AlphaZero, a reliable modern Reinforcement Learning algorithm. The system utilizes a new Neural Network architecture developed from existing research, incorporating innovative state and action representations tailored to these specific game environments. With minimal training, our solution has shown promising results in typical scenarios, demonstrating the ability to generalize across different terrain and tactical situations. Additionally, we explore the system's potential to scale to larger map sizes. The developed system is openly accessible, facilitating continued research and exploration within this challenging domain.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for games and combinatorial optimization, one of 15 directions in Deep reinforcement learning methods. Builds on 9 of its 28 references that are in the map. First posted on arXiv 19 Feb 2025.

Builds on

9 of 28 references.

References · 9

  1. 2016Adaptive Computation Time for Recurrent Neural Networkscited by 506
  2. 2017Adaptive Neural Networks for Efficient Inferencecited by 163
  3. 2021Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networkscited by 117
  4. 2016Hierarchical Multiscale Recurrent Neural Networkscited by 104
  5. 2022End-to-end Algorithm Synthesis with Recurrent Networks: Logical Extrapolation Without Overthinkingcited by 33
  6. 2020MEMO: A Deep Network for Flexible Combination of Episodic Memoriescited by 21
  7. 2019HexagDLy - Processing hexagonally sampled data with CNNs in PyTorchcited by 9
  8. 2021Mastering Terra Mystica: Applying Self-Play to Multi-agent Cooperative Board Gamescited by 1
  9. 2021Method for making multi-attribute decisions in wargames by combining intuitionistic fuzzy numbers with reinforcement learningcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Mastering the Digital Art of War: Developing Intelligent Combat Simulation Agents for Wargaming Using Hierarchical Reinforcement Learning
  2. 2025A Hierarchical Hybrid AI Approach: Integrating Deep Reinforcement Learning and Scripted Agents in Combat Simulations
  3. 2026Can AI Agents Learn Their Way to the Top? Evaluating Heuristic Learning in a Long-Running Game Agent Competition
  4. 20254Hammer: a board-game reinforcement learning environment for the hour long time frame
  5. 2024Scaling Intelligent Agents in Combat Simulations for Wargaming
  6. 2025Scalable Decision Making for Games of Imperfect Information
  7. 2026Constrained Command-Conditioned Reinforcement Learning with Bandit Strategy Selection in Real-Time Strategy Games
  8. 2025Reinforcement Learning in Strategy-Based and Atari Games: A Review of Google DeepMinds Innovations