mlsanityData to 7 Oct 2026

Autonomous Agents Modelling Other Agents: A Comprehensive Survey and Open Problems

arXiv 1709.08071 ↗First posted 23 Sep 2017cs.AI cs.MAcited by 126

Not on the map. Why?

Abstract (arXiv)

Much research in artificial intelligence is concerned with the development of autonomous agents that can interact effectively with other agents. An important aspect of such agents is the ability to reason about the behaviours of other agents, by constructing models which make predictions about various properties of interest (such as actions, goals, beliefs) of the modelled agents. A variety of modelling approaches now exist which vary widely in their methodology and underlying assumptions, catering to the needs of the different sub-communities within which they were developed and reflecting the different practical uses for which they are intended. The purpose of the present article is to provide a comprehensive survey of the salient modelling methods which can be found in the literature. The article concludes with a discussion of open problems which may form the basis for fruitful future research.

Key facts. Cited by 126 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Sep 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2018: 1; 2019: 0; 2020: 0; 2021: 24; 2022: 19; 2023: 26; 2024: 23; 2025: 20; 2026: 13.

126 papers.

Sort:

By area:

  1. 2021A Survey of Zero-shot Generalisation in Deep Reinforcement Learningcited by 164
  2. 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Aheadcited by 155
  3. 2021Scaling Multi-Agent Reinforcement Learning with Selective Parameter Sharingcited by 85
  4. 2024When Search Engine Services meet Large Language Models: Visions and Challengescited by 59
  5. 2025Plan-Then-Execute: An Empirical Study of User Trust and Team Performance When Using LLM Agents As A Daily Assistantcited by 54
  6. 2021AGENT: A Benchmark for Core Psychological Reasoningcited by 42
  7. 2021Deep Multiagent Reinforcement Learning: Challenges and Directionscited by 42
  8. 2022A Survey of Ad Hoc Teamwork Researchcited by 41
  9. 2021Baby Intuitions Benchmark (BIB): Discerning the goals, preferences, and actions of otherscited by 39
  10. 2023World Models and Predictive Coding for Cognitive and Developmental Robotics: Frontiers and Challengescited by 35
  11. 2025LLM-Powered GUI Agents in Phone Automation: Surveying Progress and Prospectscited by 31
  12. 2023Multi-agent Reinforcement Learning: A Comprehensive Surveycited by 30
38 more
  1. 2021Deep Interactive Bayesian Reinforcement Learning via Meta-Learningcited by 29
  2. 2023Order Matters: Agent-by-agent Policy Optimizationcited by 24
  3. 2021PsiPhi-Learning: Reinforcement Learning with Demonstrations using Successor Features and Inverse Temporal Difference Learningcited by 23
  4. 2023NOPA: Neurally-guided Online Probabilistic Assistance for Building Socially Intelligent Home Assistantscited by 23
  5. 2021Model-Based Opponent Modelingcited by 21
  6. 2021Expected Value of Communication for Planning in Ad Hoc Teamworkcited by 19
  7. 2024AdaSociety: An Adaptive Environment with Social Structures for Multi-Agent Decision-Makingcited by 19
  8. 2021Neural Recursive Belief States in Multi-Agent Reinforcement Learningcited by 18
  9. 2021Collaborative Visual Navigationcited by 18
  10. 2022Model-based Multi-agent Reinforcement Learning: Recent Progress and Prospectscited by 17
  11. 2022Generating Teammates for Training Robust Ad Hoc Teamwork Agents via Best-Response Diversitycited by 17
  12. 2024Mutual Theory of Mind in Human-AI Collaboration: An Empirical Study with LLM-driven AI Agents in a Real-time Shared Workspace Taskcited by 17
  13. 2022On the link between conscious function and general intelligence in humans and machinescited by 15
  14. 2024N-Agent Ad Hoc Teamworkcited by 15
  15. 2022Pareto Actor-Critic for Equilibrium Selection in Multi-Agent Reinforcement Learningcited by 14
  16. 2021Multi-Agent Imitation Learning with Copulascited by 13
  17. 2022Opponent Modeling in Negotiation Dialogues by Related Data Adaptationcited by 13
  18. 2021HAMMER: Multi-Level Coordination of Reinforcement Learning Agents via Learned Messagingcited by 12
  19. 2022A General Learning Framework for Open Ad Hoc Teamwork Using Graph-based Policy Learningcited by 12
  20. 2026TrajAudit: Automated Failure Diagnosis for Agentic Coding Systemscited by 11
  21. 2023Causal Explanations for Sequential Decision-Making in Multi-Agent Systemscited by 10
  22. 2024Towards Next-Generation Urban Decision Support Systems through AI-Powered Construction of Scientific Ontology using Large Language Models -- A Case in Optimizing Intermodal Freight Transportationcited by 10
  23. 2021LINDA: Multi-Agent Local Information Decomposition for Awareness of Teammatescited by 9
  24. 2023Towards Collaborative Plan Acquisition through Theory of Mind Modeling in Situated Dialoguecited by 9
  25. 2024Converging Paradigms: The Synergy of Symbolic and Connectionist AI in LLM-Empowered Autonomous Agentscited by 9
  26. 2025Orchestrating Human-AI Teams: The Manager Agent as a Unifying Research Challengecited by 8
  27. 2023Automated Task-Time Interventions to Improve Teamwork using Imitation Learningcited by 7
  28. 2024Efficient Adaptation in Mixed-Motive Environments via Hierarchical Opponent Modeling and Planningcited by 7
  29. 2021Visual Perspective Taking for Opponent Behavior Modelingcited by 6
  30. 2023Combining Tree-Search, Generative Models, and Nash Bargaining Concepts in Game-Theoretic Reinforcement Learningcited by 6
  31. 2024Collaborative AI Teaming in Unknown Environments via Active Goal Deductioncited by 6
  32. 2025ROTATE: Regret-driven Open-ended Training for Ad Hoc Teamworkcited by 6
  33. 2022Learning Task Embeddings for Teamwork Adaptation in Multi-Agent Reinforcement Learningcited by 5
  34. 2023(Ir)rationality in AI: State of the Art, Research Challenges and Open Questionscited by 5
  35. 2024IDIL: Imitation Learning of Intent-Driven Expert Behaviorcited by 5
  36. 2023Reflective Artificial Intelligencecited by 4
  37. 2023Co-Learning Empirical Games and World Modelscited by 4
  38. 2023Self-Confirming Transformer for Belief-Conditioned Adaptation in Offline Multi-Agent Reinforcement Learningcited by 4

50 most cited of 126 All 126 (JSON)