mlsanityData to 7 Oct 2026

From Conversation to Orchestration: HCI Challenges and Opportunities in Interactive Multi-Agentic Systems

arXiv 2506.20091 ↗First posted 25 Jun 2025cs.HCcited by 9

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Recent advances in multi-agentic systems (e.g. AutoGen, OpenAI Swarm) allow users to interact with a group of specialised AI agents rather than a single general-purpose agent. Despite the promise of this new paradigm, the HCI community has yet to fully examine the opportunities, risks, and user-centred challenges it introduces. We contribute to research on multi-agentic systems by exploring their architectures and key features through a human-centred lens. While literature and use cases remain limited, we build on existing tools and frameworks available to developers to identify a set of overarching challenges, e.g. orchestration and conflict resolution, that can guide future research in HCI. We illustrate these challenges through examples, offer potential design considerations, and provide research opportunities to spark interdisciplinary conversation. Our work lays the groundwork for future exploration and offers a research agenda focused on user-centred design in multi-agentic systems.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 21 of its 85 references that are in the map. First posted on arXiv 25 Jun 2025.

Builds on

21 of 85 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
  2. 2023Harms from Increasingly Agentic Algorithmic Systems20 Feb

Other references · 19

  1. 2018Model Cards for Model Reportingcited by 1,068
  2. 2022Complexity-Based Prompting for Multi-Step Reasoningcited by 387
  3. 2020Effect of Confidence and Explanation on Accuracy and Trust Calibration in AI-Assisted Decision Makingcited by 281
  4. 2021AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model Promptscited by 265
  5. 2021To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-makingcited by 118
  6. 2023Supporting Qualitative Analysis with Large Language Models: Combining Codebook with GPT-3 for Deductive Codingcited by 82
  7. 2024Visibility into AI Agentscited by 77
  8. 2023Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Modelscited by 67
  9. 2024A Taxonomy for Human-LLM Interaction Modes: An Initial Explorationcited by 38
  10. 2023Choice Over Control: How Users Write with Large Language Models using Diegetic and Non-Diegetic Promptingcited by 36
  11. 2024Believing Anthropomorphism: Examining the Role of Anthropomorphic Cues on Trust in Large Language Modelscited by 36
  12. 2023Mirages: On Anthropomorphism in Dialogue Systemscited by 30
7 more
  1. 2024AutoGen Studio: A No-Code Developer Tool for Building and Debugging Multi-Agent Systemscited by 20
  2. 2021Meaningful human control: actionable properties for AI system developmentcited by 18
  3. 2024Designing for Human-Agent Alignment: Understanding what humans want from their agentscited by 18
  4. 2023Competent but Rigid: Identifying the Gap in Empowering AI to Participate Equally in Group Decision-Makingcited by 11
  5. 2023Anthropomorphization of AI: Opportunities and Riskscited by 8
  6. 2025Can you pass that tool?: Implications of Indirect Speech in Physical Human-Robot Collaborationcited by 2
  7. 2025Implicit Communication of Contextual Information in Human-Robot Collaborationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 7.

9 papers.

  1. 2025Perspectra: Choosing Your Experts Enhances Critical Thinking in Multi-Agent Research Ideationcited by 4
  2. 2026More Than "Means to an End": Supporting Reasoning with Transparently Designed AI Data Science Processescited by 2
  3. 2025AnimAgents: Coordinating Multi-Stage Animation Pre-Production with Human-Multi-Agent Collaborationcited by 1
  4. 2026"When to Hand Off, When to Work Together": Understanding Concurrent Human-Agent Interaction in Shared Co-Creative Workspacescited by 1
  5. 2026A Multimodal Framework for Human-Multi-Agent Interactioncited by 0
  6. 2026Do LLMs Need to See Everything? A Benchmark and Study of Failures in LLM-driven Smartphone Automation using Screentext vs. Screenshotscited by 0
  7. 2026Delegating or Doing? Understanding User Behavior in Hybrid Human-Agent Interfacescited by 0
  8. 2026DocuTeam: Mixed-Initiative Multi-Agent Discussions around Evolving Documentscited by 0
  9. 2026ParallelPilot: Supporting Coordination and Monitoring in Parallel AI Codingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Human-Artificial Interaction in the Age of Agentic AI: A System-Theoretical Approach
  2. 2025Designing The Internet of Agents: A Framework for Trustworthy, Transparent, and Collaborative Human-Agent Interaction (HAX)
  3. 2025Advancing Multi-Agent Systems Through Model Context Protocol: Architecture, Implementation, and Applications
  4. 2025Through the Lens of Human-Human Collaboration: A Configurable Research Platform for Exploring Human-Agent Collaboration
  5. 2025Agentic Workflows for Conversational Human-AI Interaction Design
  6. 2025Multi-Agent Coordination across Diverse Applications: A Survey
  7. 2026Architecting Agentic Communities using Design Patterns
  8. 2025LLMs Working in Harmony: A Survey on the Technological Aspects of Building Effective LLM-Based Multi Agent Systems