ReCollab: Retrieval-Augmented LLMs for Cooperative Ad-hoc Teammate Modeling
On the map: World models → World models for language agents
also in 1 more
Abstract (arXiv)
Ad-hoc teamwork (AHT) requires agents to infer the behavior of previously unseen teammates and adapt their policy accordingly. Conventional approaches often rely on fixed probabilistic models or classifiers, which can be brittle under partial observability and limited interaction. Large language models (LLMs) offer a flexible alternative: by mapping short behavioral traces into high-level hypotheses, they can serve as world models over teammate behavior. We introduce Collab, a language-based framework that classifies partner types using a behavior rubric derived from trajectory features, and extend it to ReCollab, which incorporates retrieval-augmented generation (RAG) to stabilize inference with exemplar trajectories. In the cooperative Overcooked environment, Collab effectively distinguishes teammate types, while ReCollab consistently improves adaptation across layouts, achieving Pareto-optimal trade-offs between classification accuracy and episodic return. These findings demonstrate the potential of LLMs as behavioral world models for AHT and highlight the importance of retrieval grounding in challenging coordination settings.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 20 of its 32 references that are in the map. First posted on arXiv 5 Dec 2025.
Builds on
20 of 32 references.
References · 20
- 2021The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Gamescited by 903
- 2019The StarCraft Multi-Agent Challengecited by 589
- 2017Value-Decomposition Networks For Cooperative Multi-Agent Learningcited by 490
- 2020Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learningcited by 475
- 2019QTRAN: Learning to Factorize with Transformation for Cooperative Multi-Agent Reinforcement Learningcited by 372
- 2020Is Independent Learning All You Need in the StarCraft Multi-Agent Challenge?cited by 281
- 2023Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectivescited by 253
- 2020Weighted QMIX: Expanding Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learningcited by 197
- 2024Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Makingcited by 142
- 2017Autonomous Agents Modelling Other Agents: A Comprehensive Survey and Open Problemscited by 126
- 2020SMARTS: Scalable Multi-Agent Reinforcement Learning Training School for Autonomous Drivingcited by 121
- 2023ProAgent: Building Proactive Cooperative Agents with Large Language Modelscited by 97
8 more
- 2024Richelieu: Self-Evolving LLM-Based Agents for AI Diplomacycited by 36
- 2018M3RL: Mind-aware Multi-agent Management Reinforcement Learningcited by 22
- 2023TiZero: Mastering Multi-Agent Football with Curriculum Learning and Self-Playcited by 18
- 2024Mutual Theory of Mind in Human-AI Collaboration: An Empirical Study with LLM-driven AI Agents in a Real-time Shared Workspace Taskcited by 17
- 2024N-Agent Ad Hoc Teamworkcited by 15
- 2023Dealing With Non-stationarity in Decentralized Cooperative Multi-Agent Deep Reinforcement Learning via Multi-Timescale Learningcited by 12
- 2023Multi-Agent Behavior Retrieval: Retrieval-Augmented Policy Training for Cooperative Push Manipulation by Mobile Robotscited by 6
- 2025A Visual RAG Pipeline for Few-Shot Fine-Grained Product Classificationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Cooperation on the Fly: Exploring Language Agents for Ad Hoc Teamwork in the Avalon Game
- 2026TeamLLM: Exploring the Capabilities of LLMs for Multimodal Group Interaction Prediction
- 2026Dreaming Of Others: Latent Teammate Modeling In World Models For Multi-Agent Reinforcement Learning
- 2023Knowledge-based Reasoning and Learning under Partial Observability in Ad Hoc Teamwork
- 2025PADiff: Predictive and Adaptive Diffusion Policies for Ad Hoc Teamwork
- 2024ACC-Collab: An Actor-Critic Approach to Multi-Agent LLM Collaboration
- 2023MetaAgents: Large Language Model Based Agents for Decision-Making on Teaming
- 2022Knowledge-based and Data-driven Reasoning and Learning for Ad Hoc Teamwork