Diverse Agents for Ad-Hoc Cooperation in Hanabi
Not on the map. Why?
Abstract (arXiv)
In complex scenarios where a model of other actors is necessary to predict and interpret their actions, it is often desirable that the model works well with a wide variety of previously unknown actors. Hanabi is a card game that brings the problem of modeling other players to the forefront, but there is no agreement on how to best generate a pool of agents to use as partners in ad-hoc cooperation evaluation. This paper proposes Quality Diversity algorithms as a promising class of algorithms to generate populations for this purpose and shows an initial implementation of an agent generator based on this idea. We also discuss what metrics can be used to compare such generators, and how the proposed generator could be leveraged to help build adaptive agents for the game.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). First posted on arXiv 8 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 4; 2023: 4; 2024: 2; 2025: 2.
17 papers.
Sort:
- 2021Generating and Blending Game Levels via Quality-Diversity in the Latent Space of a Variational Autoencodercited by 27
- 2022Any-Play: An Intrinsic Augmentation for Zero-Shot Coordinationcited by 23
- 2021Collaborative Visual Navigationcited by 18
- 2021Learned Belief Search: Efficiently Improving Policies in Partially Observable Settingscited by 10
- 2023Referential communication in heterogeneous communities of pre-trained visual deep networkscited by 10
- 2023Towards Few-shot Coordination: Revisiting Ad-hoc Teamplay Challenge In the Game of Hanabicited by 10
- 2022On-the-fly Strategy Adaptation for ad-hoc Agent Coordinationcited by 7
- 2021Generating Diverse and Competitive Play-Styles for Strategy Gamescited by 6
- 2022On the Impossibility of Learning to Cooperate with Adaptive Partner Strategies in Repeated Gamescited by 5
- 2024Measuring Diversity of Game Scenarioscited by 5
- 2023Mix-ME: Quality-Diversity for Multi-Agent Learningcited by 4
- 2022Is Vanilla Policy Gradient Overlooked? Analyzing Deep Reinforcement Learning for Hanabicited by 3
5 more
- 2025Improving Human-AI Coordination through Online Adversarial Training and Generative Modelscited by 3
- 2021Playing Against the Board: Rolling Horizon Evolutionary Algorithms Against Pandemiccited by 1
- 2023Behavioral Differences is the Key of Ad-hoc Team Cooperation in Multiplayer Games Hanabicited by 1
- 2024Adapting to Teammates in a Cooperative Language Gamecited by 1
- 2025Generalizable Agent Modeling for Agent Collaboration-Competition Adaptation with Multi-Retrieval and Dynamic Generationcited by 0
- 2025Generalizable Agent Modeling for Agent Collaboration-Competition Adaptation with Multi-Retrieval and Dynamic Generation20 Jun 2025
- 2025Improving Human-AI Coordination through Online Adversarial Training and Generative Models21 Apr 2025
- 2024Measuring Diversity of Game Scenarios15 Apr 2024
- 2024Adapting to Teammates in a Cooperative Language Game26 Feb 2024
- 2023Mix-ME: Quality-Diversity for Multi-Agent Learning3 Nov 2023
- 2023Towards Few-shot Coordination: Revisiting Ad-hoc Teamplay Challenge In the Game of Hanabi20 Aug 2023
- 2023Behavioral Differences is the Key of Ad-hoc Team Cooperation in Multiplayer Games Hanabi12 Mar 2023
- 2023Referential communication in heterogeneous communities of pre-trained visual deep networks4 Feb 2023
- 2022On the Impossibility of Learning to Cooperate with Adaptive Partner Strategies in Repeated Games20 Jun 2022
- 2022Is Vanilla Policy Gradient Overlooked? Analyzing Deep Reinforcement Learning for Hanabi22 Mar 2022
- 2022On-the-fly Strategy Adaptation for ad-hoc Agent Coordination8 Mar 2022
- 2022Any-Play: An Intrinsic Augmentation for Zero-Shot Coordination28 Jan 2022
5 more
- 2021Collaborative Visual Navigation2 Jul 2021
- 2021Learned Belief Search: Efficiently Improving Policies in Partially Observable Settings16 Jun 2021
- 2021Generating Diverse and Competitive Play-Styles for Strategy Games17 Apr 2021
- 2021Playing Against the Board: Rolling Horizon Evolutionary Algorithms Against Pandemic28 Mar 2021
- 2021Generating and Blending Game Levels via Quality-Diversity in the Latent Space of a Variational Autoencoder24 Feb 2021
- 2021Generating and Blending Game Levels via Quality-Diversity in the Latent Space of a Variational Autoencodercited by 27
- 2022Any-Play: An Intrinsic Augmentation for Zero-Shot Coordinationcited by 23
- 2021Collaborative Visual Navigationcited by 18
- 2021Learned Belief Search: Efficiently Improving Policies in Partially Observable Settingscited by 10
- 2023Referential communication in heterogeneous communities of pre-trained visual deep networkscited by 10
- 2023Towards Few-shot Coordination: Revisiting Ad-hoc Teamplay Challenge In the Game of Hanabicited by 10
- 2022On-the-fly Strategy Adaptation for ad-hoc Agent Coordinationcited by 7
- 2021Generating Diverse and Competitive Play-Styles for Strategy Gamescited by 6
- 2022On the Impossibility of Learning to Cooperate with Adaptive Partner Strategies in Repeated Gamescited by 5
- 2024Measuring Diversity of Game Scenarioscited by 5
- 2023Mix-ME: Quality-Diversity for Multi-Agent Learningcited by 4
- 2022Is Vanilla Policy Gradient Overlooked? Analyzing Deep Reinforcement Learning for Hanabicited by 3
12 most cited of 17 All 17 (JSON)
- 2025Generalizable Agent Modeling for Agent Collaboration-Competition Adaptation with Multi-Retrieval and Dynamic Generation20 Jun 2025
- 2025Improving Human-AI Coordination through Online Adversarial Training and Generative Models21 Apr 2025
- 2024Measuring Diversity of Game Scenarios15 Apr 2024
- 2024Adapting to Teammates in a Cooperative Language Game26 Feb 2024
- 2023Mix-ME: Quality-Diversity for Multi-Agent Learning3 Nov 2023
- 2023Towards Few-shot Coordination: Revisiting Ad-hoc Teamplay Challenge In the Game of Hanabi20 Aug 2023
- 2023Behavioral Differences is the Key of Ad-hoc Team Cooperation in Multiplayer Games Hanabi12 Mar 2023
- 2023Referential communication in heterogeneous communities of pre-trained visual deep networks4 Feb 2023
- 2022On the Impossibility of Learning to Cooperate with Adaptive Partner Strategies in Repeated Games20 Jun 2022
- 2022Is Vanilla Policy Gradient Overlooked? Analyzing Deep Reinforcement Learning for Hanabi22 Mar 2022
- 2022On-the-fly Strategy Adaptation for ad-hoc Agent Coordination8 Mar 2022
- 2022Any-Play: An Intrinsic Augmentation for Zero-Shot Coordination28 Jan 2022
12 newest of 17 All 17 (JSON)