Searching for Synergy in Shared Workspace Human-AI Collaboration
Not on the map. Why?
Abstract (arXiv)
Automated AI agents are increasingly capable, yet many scientific and professional tasks require human judgment and contextual expertise. We use simulated shared-workspace human-AI teams as a controlled testbed for studying how collaboration structure shapes team behavior. Using the Collaborative Gym environment with tasks from DiscoveryBench, we vary team compositions and collaboration structures across 1,482 sessions. We find that adding additional collaborators can lower performance when coordination structure is absent. We then evaluate collaboration scaffolding that combines shared group memory with simulated human-in-the-loop (HITL) gates, where selected actions require approval from a designated simulated participant. This scaffolding improves performance, most clearly in three-person teams, with clearer responsibility signals and stronger routing of expertise to team actions. Overall, our results suggest that coordination structure is central to whether available capability improves team outcomes.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 42 references that are in the map. First posted on arXiv 16 Jun 2026.
Builds on
21 of 42 references.
References · 21
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2025LLMs Get Lost In Multi-Turn Conversationcited by 400
- 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 396
- 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 350
- 2025CollabLLM: From Passive Responders to Active Collaboratorscited by 117
- 2025SWEET-RL: Training Multi-Turn LLM Agents on Collaborative Reasoning Taskscited by 108
- 2024When combinations of humans and AI are useful: A systematic review and meta-analysiscited by 100
- 2024DiscoveryBench: Towards Data-Driven Discovery with Large Language Modelscited by 97
- 2024Collaborative Gym: A Framework for Enabling and Evaluating Human-Agent Collaborationcited by 60
- 2025Collab-Overcooked: Benchmarking and Evaluating Large Language Models as Collaborative Agentscited by 39
- 2024Graph-enhanced Large Language Models in Asynchronous Plan Reasoningcited by 37
9 more
- 2025Robotouille: An Asynchronous Planning Benchmark for LLM Agentscited by 31
- 2026AutoResearchClaw: Self-Reinforcing Autonomous Research with Human-AI Collaborationcited by 23
- 2026HiL-Bench (Human-in-Loop Benchmark): Do Agents Know When to Ask for Help?cited by 16
- 2026Proactive Agent Research Environment: Simulating Active Users to Evaluate Proactive Assistantscited by 14
- 2025Orchestrating Human-AI Teams: The Manager Agent as a Unifying Research Challengecited by 8
- 2026Beyond Cooperative Simulators: Generating Realistic User Personas for Robust Evaluation of LLM Agentscited by 6
- 2026Measuring and Mitigating the Distributional Gap Between Real and Simulated User Behaviorscited by 4
- 2025ParaCook: On Time-Efficient Planning for Multi-Agent Systemscited by 2
- 2026DRACULA: Hunting for the Actions Users Want Deep Research Agents to Executecited by 1
Built on by
Not cited yet.