mlsanityData to 7 Oct 2026

A Survey of Ad Hoc Teamwork Research

arXiv 2202.10450 ↗First posted 16 Feb 2022cs.MA cs.AIcited by 41

Not on the map. Why?

Abstract (arXiv)

Ad hoc teamwork is the research problem of designing agents that can collaborate with new teammates without prior coordination. This survey makes a two-fold contribution: First, it provides a structured description of the different facets of the ad hoc teamwork problem. Second, it discusses the progress that has been made in the field so far, and identifies the immediate and long-term open problems that need to be addressed in ad hoc teamwork.

Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). Builds on 25 of its 72 references that are in the map. First posted on arXiv 16 Feb 2022.

Builds on

25 of 72 references.

References · 25

  1. 2020Towards Continual Reinforcement Learning: A Review and Perspectivescited by 268
  2. 2018Machine Theory of Mindcited by 222
  3. 2019The Hanabi Challenge: A New Frontier for AI Researchcited by 194
  4. 2020"Other-Play" for Zero-Shot Coordinationcited by 194
  5. 2021Open-Ended Learning Leads to Generally Capable Agentscited by 177
  6. 2017Autonomous Agents Modelling Other Agents: A Comprehensive Survey and Open Problemscited by 126
  7. 2021Scalable Evaluation of Multi-Agent Reinforcement Learning with Melting Potcited by 97
  8. 2020Learning Latent Representations to Influence Multi-Agent Interactioncited by 92
  9. 2019Dealing with Non-Stationarity in Multi-Agent Deep Reinforcement Learningcited by 90
  10. 2021Off-Belief Learningcited by 72
  11. 2015A Game-Theoretic Model and Best-Response Learning Method for Ad Hoc Coordination in Multiagent Systemscited by 41
  12. 2020Towards Open Ad Hoc Teamwork Using Graph-based Policy Learningcited by 37
13 more
  1. 2021Deep Interactive Bayesian Reinforcement Learning via Meta-Learningcited by 29
  2. 2019Reasoning about Hypothetical Agent Behaviours and their Parameterscited by 24
  3. 2018M3RL: Mind-aware Multi-agent Management Reinforcement Learningcited by 22
  4. 2015Belief and Truth in Hypothesised Behaviourscited by 19
  5. 2021Expected Value of Communication for Planning in Ad Hoc Teamworkcited by 19
  6. 2021Quasi-Equivalence Discovery for Zero-Shot Emergent Communicationcited by 19
  7. 2020Exploring Zero-Shot Emergent Communication in Embodied Multi-Agent Populationscited by 18
  8. 2019Active Goal Recognitioncited by 16
  9. 2018An Efficient, Generalized Bellman Update For Cooperative Inverse Reinforcement Learningcited by 15
  10. 2019Scalable Decision-Theoretic Planning in Open and Typed Multiagent Systemscited by 7
  11. 2022Assisting Unknown Teammates in Unknown Tasks: Ad Hoc Teamwork under Partial Observabilitycited by 6
  12. 2019An Empirical Study on the Practical Impact of Prior Beliefs over Policy Typescited by 2
  13. 2019E-HBA: Using Action Policies for Expert Advice and Agent Typificationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 4; 2023: 3; 2024: 8; 2025: 17; 2026: 9.

41 papers.

Sort:

By area:

  1. 2023ZSC-Eval: An Evaluation Toolkit and Benchmark for Multi-agent Zero-shot Coordinationcited by 23
  2. 2022Generating Teammates for Training Robust Ad Hoc Teamwork Agents via Best-Response Diversitycited by 17
  3. 2024N-Agent Ad Hoc Teamworkcited by 15
  4. 2023Minimum Coverage Sets for Training Robust Ad Hoc Teamwork Agentscited by 13
  5. 2022Heterogeneous Multi-agent Zero-Shot Coordination by Coevolutioncited by 12
  6. 2022A General Learning Framework for Open Ad Hoc Teamwork Using Graph-based Policy Learningcited by 12
  7. 2025Inherent and emergent liability issues in LLM-based agentic systems: a principal-agent perspectivecited by 12
  8. 2025The Collaboration Gap: Exploration and Benchmarking of Open-World Agentic Cooperationcited by 11
  9. 2024Concept -- An Evaluation Protocol on Conversational Recommender Systems with System-centric and User-centric Factorscited by 9
  10. 2023Automated Task-Time Interventions to Improve Teamwork using Imitation Learningcited by 7
  11. 2024Efficient Adaptation in Mixed-Motive Environments via Hierarchical Opponent Modeling and Planningcited by 7
  12. 2024Open Ad Hoc Teamwork with Cooperative Game Theorycited by 6
29 more
  1. 2025ROTATE: Regret-driven Open-ended Training for Ad Hoc Teamworkcited by 6
  2. 2024Assessing the Impact of Distribution Shift on Reinforcement Learning Performancecited by 4
  3. 2025Towards Principled Unsupervised Multi-Agent Reinforcement Learningcited by 4
  4. 2025Partner Modelling Emerges in Recurrent Agents (But Only When It Matters)cited by 4
  5. 2025A Minimax Approach to Ad Hoc Teamworkcited by 3
  6. 2025Implicitly Aligning Humans and Autonomous Agents through Shared Task Abstractionscited by 2
  7. 2025Breaking the Performance Ceiling in Reinforcement Learning requires Inference Strategiescited by 2
  8. 2025Unsupervised Partner Design Enables Robust Ad-hoc Teamworkcited by 2
  9. 2026AI for Games in the Foundation Model Eracited by 2
  10. 2024Adapting to Teammates in a Cooperative Language Gamecited by 1
  11. 2025Seldonian Reinforcement Learning for Ad Hoc Teamworkcited by 1
  12. 2025Birds of a Different Feather Flock Together: Exploring Opportunities and Challenges in Animal-Human-Machine Teamingcited by 1
  13. 2025Zero-Shot Coordination in Ad Hoc Teams with Generalized Policy Improvement and Difference Rewardscited by 1
  14. 2026Partner Capability Estimation for Task-Agnostic Adaptation in Ad-Hoc Teamworkcited by 1
  15. 2022Classifying Ambiguous Identities in Hidden-Role Stochastic Games with Multi-Agent Reinforcement Learningcited by 0
  16. 2024On the Complexity of Learning to Cooperate with Populations of Socially Rational Agentscited by 0
  17. 2024Noisy Zero-Shot Coordination: Breaking The Common Knowledge Assumption In Zero-Shot Coordination Gamescited by 0
  18. 2025Heterogeneous Decision Making in Mixed Traffic: Uncertainty-aware Planning and Bounded Rationalitycited by 0
  19. 2025Generalizable Agent Modeling for Agent Collaboration-Competition Adaptation with Multi-Retrieval and Dynamic Generationcited by 0
  20. 2025Assistax: A Multi-Agent Hardware-Accelerated Reinforcement Learning Benchmark for Assistive Roboticscited by 0
  21. 2025Co-Alignment: Rethinking Alignment as Bidirectional Human-AI Cognitive Adaptationcited by 0
  22. 2025PACT: Phenotype-Aware Contrastive Team Representation for Multi-Phenotype Grouped Ad Hoc Teamworkcited by 0
  23. 2026Fluid-Agent Reinforcement Learningcited by 0
  24. 2026NestRL: A Nested Training Regime for Mutual Adaptation in Human-AI Teamingcited by 0
  25. 2026MOSAIC: A Universal Agent-Level Interface for Cross-Paradigm Agent Mixing and Human-AI Collaborationcited by 0
  26. 2026Learning When to Cooperate Under Heterogeneous Goalscited by 0
  27. 2026Predicting Decisions of AI Agents from Limited Interaction through Text-Tabular Modelingcited by 0
  28. 2026Testing Interchangeability in LLM Agent Teamscited by 0
  29. 2026JaxAHT: A JAX-Based Library for Ad Hoc Teamworkcited by 0