Beyond Partner Diversity: An Influence-Based Team Steering Framework for Zero-Shot Human-Machine Teaming
Not on the map. Why?
Abstract (arXiv)
While AI agents are rapidly advancing from isolated tools to interactive collaborators, data-driven human-machine teaming (HMT) methods remain costly in their reliance on human interaction data across domains, teammates, and team sizes. Zero-shot coordination (ZSC) addresses this bottleneck by simulating diverse partner populations to approximate how unseen partners might behave. However, partner coverage alone is insufficient as team settings scale and communication becomes degraded. To remedy this deficiency, we propose Influence-Based Team Steering (IBTS), a framework that uses influence shaping to incentivize agents to discover diverse, high-performing team interaction patterns and further steers ongoing trajectories toward stronger learned coordination modes. We assess IBTS on Overcooked-AI in both two-agent and three-agent settings, allowing us to test whether learned coordination structure transfers beyond dyadic interaction. Our evaluation includes simulated partners, synthetic partner-style variation, and, to our knowledge, the first 30-subject Overcooked-AI HMT study involving two real human teammates and one machine teammate. Across these evaluations, IBTS improves team performance against competing baselines, highlighting the need for scaled ZSC to combine sparse-reward coordination mechanisms with partner-variation coverage rather than relying on diversity alone.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 55 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
31 of 55 references.
References · 31
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,558
- 2015Prioritized Experience Replaycited by 1,099
- 2021The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Gamescited by 942
- 2019The StarCraft Multi-Agent Challengecited by 597
- 2017Population Based Training of Neural Networkscited by 367
- 2019On the Utility of Learning about Humans for Human-AI Coordinationcited by 349
- 2019Google Research Football: A Novel Reinforcement Learning Environmentcited by 260
- 2013The Complexity of Decentralized Control of Markov Decision Processescited by 231
- 2020"Other-Play" for Zero-Shot Coordinationcited by 198
- 2021Trust Region Policy Optimisation in Multi-Agent Reinforcement Learningcited by 186
- 2021Collaborating with Humans without Human Datacited by 142
19 more
- 2020ROMA: Multi-Agent Reinforcement Learning with Emergent Rolescited by 137
- 2023ProAgent: Building Proactive Cooperative Agents with Large Language Modelscited by 98
- 2019Influence-Based Multi-Agent Explorationcited by 75
- 2021Maximum Entropy Population-Based Training for Zero-Shot Human-AI Coordinationcited by 70
- 2021Cooperative Exploration for Multi-Agent Deep Reinforcement Learningcited by 57
- 2024An Introduction to Centralized Training for Decentralized Execution in Cooperative Multi-Agent Reinforcement Learningcited by 50
- 2021Evaluation of Human-AI Teams for Learned and Rule-Based Agents in Hanabicited by 40
- 2021On the Importance of Environments in Human-Robot Coordinationcited by 37
- 2022The Utility of Explainable AI in Ad Hoc Human-Machine Teamingcited by 30
- 2023ZSC-Eval: An Evaluation Toolkit and Benchmark for Multi-agent Zero-shot Coordinationcited by 24
- 2024Learning to Cooperate with Humans using Generative Agentscited by 24
- 2025OvercookedV2: Rethinking Overcooked for Zero-Shot Coordinationcited by 16
- 2023Diverse Conventions for Human-AI Collaborationcited by 15
- 2025Personality-Driven Decision-Making in LLM-Based Autonomous Agentscited by 13
- 2023Learning to Coordinate with Anyonecited by 7
- 2024Designs for Enabling Collaboration in Human-Machine Teaming via Interactive and Explainable Systemscited by 4
- 2024Personalization in Human-Robot Interaction through Preference-based Action Representation Learningcited by 4
- 2025Adaptively Coordinating with Novel Partners via Learned Latent Strategiescited by 4
- 2026Theory of Mind Guided Strategy Adaptation for Zero-Shot Coordinationcited by 1
Built on by
Not cited yet.