mlsanityData to 14 Oct 2026

Magentic-UI: Towards Human-in-the-loop Agentic Systems

arXiv 2507.22358 ↗First posted 30 Jul 2025cs.AI cs.HCcited by 43

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

AI agents powered by large language models are increasingly capable of autonomously completing complex, multi-step tasks using external tools. Yet, they still fall short of human-level performance in most domains including computer use, software development, and research. Their growing autonomy and ability to interact with the outside world, also introduces safety and security risks including potentially misaligned actions and adversarial manipulation. We argue that human-in-the-loop agentic systems offer a promising path forward, combining human oversight and control with AI efficiency to unlock productivity from imperfect systems. We introduce Magentic-UI, an open-source web interface for developing and studying human-agent interaction. Built on a flexible multi-agent architecture, Magentic-UI supports web browsing, code execution, and file manipulation, and can be extended with diverse tools via Model Context Protocol (MCP). Moreover, Magentic-UI presents six interaction mechanisms for enabling effective, low-cost human involvement: co-planning, co-tasking, multi-tasking, action guards, and long-term memory. We evaluate Magentic-UI across four dimensions: autonomous task completion on agentic benchmarks, simulated user testing of its interaction capabilities, qualitative studies with real users, and targeted safety assessments. Our findings highlight Magentic-UI's potential to advance safe and efficient human-agent collaboration.

Key facts. Cited by 43 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 55 of its 112 references that are in the map. First posted on arXiv 30 Jul 2025.

Builds on

55 of 112 references.

Closest ancestors · 12

Same direction, newest first

  1. 2024Collaborative Gym: A Framework for Enabling and Evaluating Human-Agent Collaboration20 Dec
  2. 2024CRMArena: Understanding the Capacity of LLM Agents to Perform Professional CRM Tasks in Realistic Environments4 Nov
  3. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun
  4. 2024Agent Design Pattern Catalogue: A Collection of Architectural Patterns for Foundation Model based Agents16 May
  5. 2024AgentCoord: Visually Exploring Coordination Strategy for LLM-based Multi-Agent Collaboration18 Apr
  6. 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Survey17 Apr
  7. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challenges21 Jan
  8. 2024Exploring Large Language Model based Intelligent Agents: Definitions, Methods, and Prospects7 Jan
  9. 2024From LLM to Conversational Agent: A Memory Enhanced Architecture with Fine-Tuning of Large Language Models5 Jan
  10. 2023The Rise and Potential of Large Language Model Based Agents: A Survey14 Sep
  11. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
  12. 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agents5 Jun

Other references · 43

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2017Deep reinforcement learning from human preferencescited by 3,912
  4. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  5. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  6. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  7. 2016Concrete Problems in AI Safetycited by 1,642
  8. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
  9. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
  10. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
  11. 2023GAIA: a benchmark for General AI Assistantscited by 1,128
  12. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
31 more
  1. 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 563
  2. 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 438
  3. 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 399
  4. 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 299
  5. 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agentscited by 288
  6. 2023The Impact of AI on Developer Productivity: Evidence from GitHub Copilotcited by 274
  7. 2020Consistent Estimators for Learning to Defer to an Expertcited by 271
  8. 2017Predict Responsibly: Improving Fairness and Accuracy by Learning to Defercited by 233
  9. 2023REFINER: Reasoning Feedback on Intermediate Representationscited by 205
  10. 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvementcited by 205
  11. 2023ART: Automatic multi-step reasoning and tool-use for large language modelscited by 197
  12. 2024Trial and Error: Exploration-Based Trajectory Optimization for LLM Agentscited by 197
  13. 2023Synapse: Trajectory-as-Exemplar Prompting with Memory for Computer Controlcited by 187
  14. 2025An Illusion of Progress? Assessing the Current State of Web Agentscited by 174
  15. 2019Asking Clarifying Questions in Open-Domain Information-Seeking Conversationscited by 139
  16. 2024When combinations of humans and AI are useful: A systematic review and meta-analysiscited by 106
  17. 2025CVE-Bench: A Benchmark for AI Agents' Ability to Exploit Real-World Web Application Vulnerabilitiescited by 96
  18. 2023On the Planning Abilities of Large Language Models (A Critical Investigation with a Proposed Benchmark)cited by 85
  19. 2025OpenAgentSafety: A Comprehensive Framework for Evaluating Real-World AI Agent Safetycited by 75
  20. 2025The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideascited by 62
  21. 2024Understanding the Weakness of Large Language Model Agents within a Complex Android Environmentcited by 60
  22. 2024When is Tree Search Useful for LLM Planning? It Depends on the Discriminatorcited by 47
  23. 2025CRMArena-Pro: Holistic Assessment of LLM Agents Across Diverse Business Scenarios and Interactionscited by 47
  24. 2025RedTeamCUA: Realistic Adversarial Testing of Computer-Use Agents in Hybrid Web-OS Environmentscited by 46
  25. 2023Open-Ended Instructable Embodied Agents with Memory-Augmented Large Language Modelscited by 37
  26. 2025CowPilot: A Framework for Autonomous and Human-Agent Collaborative Web Navigationcited by 36
  27. 2024Designing for Human-Agent Alignment: Understanding what humans want from their agentscited by 18
  28. 2024WebSuite: Systematically Evaluating Why Web Agents Failcited by 16
  29. 2025ComfyUI-Copilot: An Intelligent Assistant for Automated Workflow Developmentcited by 11
  30. 2024From Interaction to Impact: Towards Safer AI Agents Through Understanding and Evaluating Mobile UI Operation Impactscited by 10
  31. 2024HELPER-X: A Unified Instructable Embodied Agent to Tackle Four Interactive Vision-Language Domains with Memory-Augmented Language Modelscited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 13; 2026: 30.

43 papers.

Sort:

By area:

  1. 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 205
  2. 2025Fara-7B: An Efficient Agentic Model for Computer Usecited by 35
  3. 2025Dark Patterns Meet GUI Agents: LLM Agent Susceptibility to Manipulative Interfaces and the Role of Human Oversightcited by 16
  4. 2026When Benign Inputs Lead to Severe Harms: Eliciting Unsafe Unintended Behaviors of Computer-Use Agentscited by 14
  5. 2025AgentProg: Empowering Long-Horizon GUI Agents with Program-Guided Context Managementcited by 11
  6. 2026Adaptive Collaboration with Humans: Metacognitive Policy Optimization for Multi-Agent LLMs with Continual Learningcited by 9
  7. 2026AIR: Improving Agent Safety through Incident Responsecited by 8
  8. 2026Mapping the Design Space of User Experience for Computer Use Agentscited by 7
  9. 2025An Evaluation-Centric Paradigm for Scientific Visualization Agentscited by 6
  10. 2025When Should Users Check? Modeling Confirmation Frequency in Multi-Step Agentic AI Taskscited by 6
  11. 2026Comparing Human Oversight Strategies for Computer-Use Agentscited by 6
  12. 2026Fara-1.5: Scalable Learning Environments for Computer Use Agentscited by 6
31 more
  1. 2026Modeling Distinct Human Interaction in Web Agentscited by 5
  2. 2025TheMCPCompany: Creating General-purpose Agents with Task-specific Toolscited by 4
  3. 2026Toward Safe and Responsible AI Agents: A Three-Pillar Model for Transparency, Accountability, and Trustworthinesscited by 4
  4. 2025Interaction-Driven Browsing: A Human-in-the-Loop Conceptual Framework Informed by Human Web Browsing for Browser-Using Agentscited by 3
  5. 2025On the Regulatory Potential of User Interfaces for AI Agent Governancecited by 3
  6. 2026Overseeing Agents Without Constant Oversight: Challenges and Opportunitiescited by 3
  7. 2026Hedwig: Dynamic Autonomy for Coding Agents Under Local Oversightcited by 3
  8. 2026Autonomy and Agency in Agentic AI: Architectural Tactics for Regulated Contextscited by 3
  9. 2026SentinelBench: A Benchmark for Long-Running Monitoring Agentscited by 3
  10. 2026Plover: Steering GUI Agents through Plan-Centric Interactioncited by 3
  11. 2026Humans are Missing from AI Coding Agent Researchcited by 3
  12. 2025WebRouter: Query-specific Router via Variational Information Bottleneck for Cost-sensitive Web Agentcited by 2
  13. 2026RunAgent: Interpreting Natural-Language Plans with Constraint-Guided Executioncited by 2
  14. 2026Governed AI-Assisted Engineering: Graduated Human Oversight for Agentic Code Generation in Regulated Domainscited by 2
  15. 2026HiLSVA: Design and Evaluation of a Human-in-the-Loop Agentic System for Scientific Visualizationcited by 2
  16. 2026From Language Models to World-Acting Systems: Progress and Limits of Agentic AI across Digital, Social, Virtual, and Physical Environmentscited by 2
  17. 2025Instruction Agent: Enhancing Agent with Expert Demonstrationcited by 1
  18. 2025Designing Beyond Language: Sociotechnical Barriers in AI Health Technologies for Limited English Proficiencycited by 1
  19. 2025MiniScope: A Least Privilege Framework for Authorizing Tool Calling Agentscited by 1
  20. 2026Auditing and Controlling AI Agent Actions in Spreadsheetscited by 1
  21. 2026CollabSkill: Evaluating Human-Agent Collaboration On Real-World Taskscited by 1
  22. 2026HANSEL: Extracting Breadcrumbs from Web Agent Trajectories for Interactive Verificationcited by 1
  23. 2026JarvisHub: An Open Harness for Canvas-Native Multimodal Creative Agentscited by 1
  24. 2026Agents in the Wild: Where Research Meets Deploymentcited by 0
  25. 2026Plans Work in Mysterious Ways: Evaluating a Plan Mode for Spreadsheet Agentscited by 0
  26. 2026AgentGUI: An Interface for Observing and Steering Long-Running AI Agentscited by 0
  27. 2026AdaLens: Interactive Storyline for Monitoring and Steering Long-Running Agentic Data Analysiscited by 0
  28. 2026GRASP: Generating, Revising, and Assessing for Strategic Planning with Agentic AIcited by 0
  29. 2026Trust and Task Completion in the World of Consumer AI Agentscited by 0
  30. 2026L3M: A Verifiable Harness and Runtime for Self-Extending and Self-Improving Agentscited by 0
  31. 2026Task-State Governance: A Virtual Machine for Verifiable and Recoverable GUI Agent Executioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks
  2. 2025DuetUI: A Bidirectional Context Loop for Human-Agent Co-Generation of Task-Oriented Interfaces
  3. 2024Interactive Speculative Planning: Enhance Agent Efficiency through Co-design of System and User Interface
  4. 2025AgentBay: A Hybrid Interaction Sandbox for Seamless Human-AI Intervention in Agentic Systems
  5. 2024Agent S: An Open Agentic Framework that Uses Computers Like a Human
  6. 2026OmegaUse: Building a General-Purpose GUI Agent for Autonomous Task Execution
  7. 2025WebGames: Challenging General-Purpose Web-Browsing AI Agents
  8. 2023WebArena: A Realistic Web Environment for Building Autonomous Agents