mlsanityData to 7 Oct 2026

Perfect Information Monte Carlo with Postponing Reasoning

arXiv 2408.02380 ↗First posted 5 Aug 2024cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Imperfect information games, such as Bridge and Skat, present challenges due to state-space explosion and hidden information, posing formidable obstacles for search algorithms. Determinization-based algorithms offer a resolution by sampling hidden information and solving the game in a perfect information setting, facilitating rapid and effective action estimation. However, transitioning to perfect information introduces challenges, notably one called strategy fusion.This research introduces `Extended Perfect Information Monte Carlo' (EPIMC), an online algorithm inspired by the state-of-the-art determinization-based approach Perfect Information Monte Carlo (PIMC). EPIMC enhances the capabilities of PIMC by postponing the perfect information resolution, reducing alleviating issues related to strategy fusion. However, the decision to postpone the leaf evaluator introduces novel considerations, such as the interplay between prior levels of reasoning and the newly deferred resolution. In our empirical analysis, we investigate the performance of EPIMC across a range of games, with a particular focus on those characterized by varying degrees of strategy fusion. Our results demonstrate notable performance enhancements, particularly in games where strategy fusion significantly impacts gameplay. Furthermore, our research contributes to the theoretical foundation of determinization-based algorithms addressing challenges associated with strategy fusion.%, thereby enhancing our understanding of these algorithms within the context of imperfect information game scenarios.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 30 references that are in the map. First posted on arXiv 5 Aug 2024.

Builds on

10 of 30 references.

References · 10

  1. 2017Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithmcited by 723
  2. 2017DeepStack: Expert-Level Artificial Intelligence in No-Limit Pokercited by 228
  3. 2019OpenSpiel: A Framework for Reinforcement Learning in Gamescited by 180
  4. 2020Combining Deep Reinforcement Learning and Search for Imperfect-Information Gamescited by 110
  5. 2019Rethinking Formal Models of Partially Observable Multiagent Decision Makingcited by 35
  6. 2013Solving Imperfect Information Games Using Decompositioncited by 27
  7. 2021Subgame solving without common knowledgecited by 11
  8. 2019The αμ Search Algorithm for the Game of Bridgecited by 6
  9. 2019Policy Based Inference in Trick-Taking Card Gamescited by 4
  10. 2024Mixture of Public and Private Distributions in Imperfect Information Gamescited by 1

Built on by

Not cited yet.