mlsanityData to 7 Oct 2026

Checkmating One, by Using Many: Combining Mixture of Experts with MCTS to Improve in Chess

arXiv 2401.16852 ↗First posted 30 Jan 2024cs.LGcited by 4

On the map: Mixture-of-experts → MoE in reinforcement learning and robotics

Abstract (arXiv)

In games like chess, strategy evolves dramatically across distinct phases - the opening, middlegame, and endgame each demand different forms of reasoning and decision-making. Yet, many modern chess engines rely on a single neural network to play the entire game uniformly, often missing opportunities to specialize. In this work, we introduce M2CTS, a modular framework that combines Mixture of Experts with Monte Carlo Tree Search to adapt strategy dynamically based on game phase. We explore three different methods for training the neural networks: Separated Learning, Staged Learning, and Weighted Learning. By routing decisions through specialized neural networks trained for each phase, M2CTS improves both computational efficiency and playing strength. In experiments on chess, M2CTS achieves up to +122 Elo over standard single-model baselines and shows promising generalization to multi-agent domains such as Pommerman. These results highlight how modular, phase-aware systems can better align with the structured nature of games and move us closer to human-like behavior in dividing a problem into many smaller units.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in MoE in reinforcement learning and robotics, one of 12 directions in Mixture-of-experts. Builds on 17 of its 31 references that are in the map. First posted on arXiv 30 Jan 2024.

Builds on

17 of 31 references.

References · 17

  1. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  2. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  3. 2019Searching for MobileNetV3cited by 1,984
  4. 2024Mixtral of Expertscited by 1,785
  5. 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,327
  6. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 890
  7. 2021Scaling Vision with Sparse Mixture of Expertscited by 740
  8. 2019ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networkscited by 572
  9. 2016Modular Multitask Reinforcement Learning with Policy Sketchescited by 200
  10. 2021Efficient Large Scale Language Modeling with Mixtures of Expertscited by 175
  11. 2021Acquisition of Chess Knowledge in AlphaZerocited by 120
  12. 2020Aligning Superhuman AI with Human Behavior: Chess as a Model Systemcited by 78
5 more
  1. 2018Pommerman: A Multi-Agent Playgroundcited by 30
  2. 2020Learning Models of Individual Behavior in Chesscited by 22
  3. 2021One Network Fits All? Modular versus Monolithic Task Formulations in Neural Networkscited by 8
  4. 2023Representation Matters for Mastering Chess: Improved Feature Representation in AlphaZero Outperforms Switching to Transformerscited by 8
  5. 2019Learning to play the Chess Variant Crazyhouse above World Champion Level with Deep Neural Networks and Human Datacited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Mastering Board Games by External and Internal Planning with Language Models
  2. 2024Amortized Planning with Large-Scale Transformers: A Case Study on Chess
  3. 2025Out-of-distribution Tests Reveal Compositionality in Chess Transformers
  4. 2025Xiangqi-R1: Enhancing Spatial Strategic Reasoning in LLMs for Chinese Chess via Reinforcement Learning
  5. 2024Can Large Language Models Play Games? A Case Study of A Self-Play Approach
  6. 2024Explore the Reasoning Capability of LLMs in the Chess Testbed
  7. 2024Emergent World Models and Latent Variable Estimation in Chess-Playing Language Models
  8. 2025ChessArena: A Chess Testbed for Evaluating Strategic Reasoning Capabilities of Large Language Models