Magentic-UI: Towards Human-in-the-loop Agentic Systems
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
AI agents powered by large language models are increasingly capable of autonomously completing complex, multi-step tasks using external tools. Yet, they still fall short of human-level performance in most domains including computer use, software development, and research. Their growing autonomy and ability to interact with the outside world, also introduces safety and security risks including potentially misaligned actions and adversarial manipulation. We argue that human-in-the-loop agentic systems offer a promising path forward, combining human oversight and control with AI efficiency to unlock productivity from imperfect systems. We introduce Magentic-UI, an open-source web interface for developing and studying human-agent interaction. Built on a flexible multi-agent architecture, Magentic-UI supports web browsing, code execution, and file manipulation, and can be extended with diverse tools via Model Context Protocol (MCP). Moreover, Magentic-UI presents six interaction mechanisms for enabling effective, low-cost human involvement: co-planning, co-tasking, multi-tasking, action guards, and long-term memory. We evaluate Magentic-UI across four dimensions: autonomous task completion on agentic benchmarks, simulated user testing of its interaction capabilities, qualitative studies with real users, and targeted safety assessments. Our findings highlight Magentic-UI's potential to advance safe and efficient human-agent collaboration.
Key facts. Cited by 43 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 55 of its 112 references that are in the map. First posted on arXiv 30 Jul 2025.
Builds on
55 of 112 references.
Closest ancestors · 12
Same direction, newest first
- 2024Collaborative Gym: A Framework for Enabling and Evaluating Human-Agent Collaboration20 Dec
- 2024CRMArena: Understanding the Capacity of LLM Agents to Perform Professional CRM Tasks in Realistic Environments4 Nov
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun
- 2024Agent Design Pattern Catalogue: A Collection of Architectural Patterns for Foundation Model based Agents16 May
- 2024AgentCoord: Visually Exploring Coordination Strategy for LLM-based Multi-Agent Collaboration18 Apr
- 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Survey17 Apr
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challenges21 Jan
- 2024Exploring Large Language Model based Intelligent Agents: Definitions, Methods, and Prospects7 Jan
- 2024From LLM to Conversational Agent: A Memory Enhanced Architecture with Fine-Tuning of Large Language Models5 Jan
- 2023The Rise and Potential of Large Language Model Based Agents: A Survey14 Sep
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
- 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agents5 Jun
Other references · 43
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
- 2016Concrete Problems in AI Safetycited by 1,642
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
- 2023GAIA: a benchmark for General AI Assistantscited by 1,128
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
31 more
- 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 563
- 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 438
- 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 399
- 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 299
- 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agentscited by 288
- 2023The Impact of AI on Developer Productivity: Evidence from GitHub Copilotcited by 274
- 2020Consistent Estimators for Learning to Defer to an Expertcited by 271
- 2017Predict Responsibly: Improving Fairness and Accuracy by Learning to Defercited by 233
- 2023REFINER: Reasoning Feedback on Intermediate Representationscited by 205
- 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvementcited by 205
- 2023ART: Automatic multi-step reasoning and tool-use for large language modelscited by 197
- 2024Trial and Error: Exploration-Based Trajectory Optimization for LLM Agentscited by 197
- 2023Synapse: Trajectory-as-Exemplar Prompting with Memory for Computer Controlcited by 187
- 2025An Illusion of Progress? Assessing the Current State of Web Agentscited by 174
- 2019Asking Clarifying Questions in Open-Domain Information-Seeking Conversationscited by 139
- 2024When combinations of humans and AI are useful: A systematic review and meta-analysiscited by 106
- 2025CVE-Bench: A Benchmark for AI Agents' Ability to Exploit Real-World Web Application Vulnerabilitiescited by 96
- 2023On the Planning Abilities of Large Language Models (A Critical Investigation with a Proposed Benchmark)cited by 85
- 2025OpenAgentSafety: A Comprehensive Framework for Evaluating Real-World AI Agent Safetycited by 75
- 2025The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideascited by 62
- 2024Understanding the Weakness of Large Language Model Agents within a Complex Android Environmentcited by 60
- 2024When is Tree Search Useful for LLM Planning? It Depends on the Discriminatorcited by 47
- 2025CRMArena-Pro: Holistic Assessment of LLM Agents Across Diverse Business Scenarios and Interactionscited by 47
- 2025RedTeamCUA: Realistic Adversarial Testing of Computer-Use Agents in Hybrid Web-OS Environmentscited by 46
- 2023Open-Ended Instructable Embodied Agents with Memory-Augmented Large Language Modelscited by 37
- 2025CowPilot: A Framework for Autonomous and Human-Agent Collaborative Web Navigationcited by 36
- 2024Designing for Human-Agent Alignment: Understanding what humans want from their agentscited by 18
- 2024WebSuite: Systematically Evaluating Why Web Agents Failcited by 16
- 2025ComfyUI-Copilot: An Intelligent Assistant for Automated Workflow Developmentcited by 11
- 2024From Interaction to Impact: Towards Safer AI Agents Through Understanding and Evaluating Mobile UI Operation Impactscited by 10
- 2024HELPER-X: A Unified Instructable Embodied Agent to Tackle Four Interactive Vision-Language Domains with Memory-Augmented Language Modelscited by 8
Built on by
Citing papers per year: 2025: 13; 2026: 30.
43 papers.
Sort:
By area:
- 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 205
- 2025Fara-7B: An Efficient Agentic Model for Computer Usecited by 35
- 2025Dark Patterns Meet GUI Agents: LLM Agent Susceptibility to Manipulative Interfaces and the Role of Human Oversightcited by 16
- 2026When Benign Inputs Lead to Severe Harms: Eliciting Unsafe Unintended Behaviors of Computer-Use Agentscited by 14
- 2025AgentProg: Empowering Long-Horizon GUI Agents with Program-Guided Context Managementcited by 11
- 2026Adaptive Collaboration with Humans: Metacognitive Policy Optimization for Multi-Agent LLMs with Continual Learningcited by 9
- 2026AIR: Improving Agent Safety through Incident Responsecited by 8
- 2026Mapping the Design Space of User Experience for Computer Use Agentscited by 7
- 2025An Evaluation-Centric Paradigm for Scientific Visualization Agentscited by 6
- 2025When Should Users Check? Modeling Confirmation Frequency in Multi-Step Agentic AI Taskscited by 6
- 2026Comparing Human Oversight Strategies for Computer-Use Agentscited by 6
- 2026Fara-1.5: Scalable Learning Environments for Computer Use Agentscited by 6
31 more
- 2026Modeling Distinct Human Interaction in Web Agentscited by 5
- 2025TheMCPCompany: Creating General-purpose Agents with Task-specific Toolscited by 4
- 2026Toward Safe and Responsible AI Agents: A Three-Pillar Model for Transparency, Accountability, and Trustworthinesscited by 4
- 2025Interaction-Driven Browsing: A Human-in-the-Loop Conceptual Framework Informed by Human Web Browsing for Browser-Using Agentscited by 3
- 2025On the Regulatory Potential of User Interfaces for AI Agent Governancecited by 3
- 2026Overseeing Agents Without Constant Oversight: Challenges and Opportunitiescited by 3
- 2026Hedwig: Dynamic Autonomy for Coding Agents Under Local Oversightcited by 3
- 2026Autonomy and Agency in Agentic AI: Architectural Tactics for Regulated Contextscited by 3
- 2026SentinelBench: A Benchmark for Long-Running Monitoring Agentscited by 3
- 2026Plover: Steering GUI Agents through Plan-Centric Interactioncited by 3
- 2026Humans are Missing from AI Coding Agent Researchcited by 3
- 2025WebRouter: Query-specific Router via Variational Information Bottleneck for Cost-sensitive Web Agentcited by 2
- 2026RunAgent: Interpreting Natural-Language Plans with Constraint-Guided Executioncited by 2
- 2026Governed AI-Assisted Engineering: Graduated Human Oversight for Agentic Code Generation in Regulated Domainscited by 2
- 2026HiLSVA: Design and Evaluation of a Human-in-the-Loop Agentic System for Scientific Visualizationcited by 2
- 2026From Language Models to World-Acting Systems: Progress and Limits of Agentic AI across Digital, Social, Virtual, and Physical Environmentscited by 2
- 2025Instruction Agent: Enhancing Agent with Expert Demonstrationcited by 1
- 2025Designing Beyond Language: Sociotechnical Barriers in AI Health Technologies for Limited English Proficiencycited by 1
- 2025MiniScope: A Least Privilege Framework for Authorizing Tool Calling Agentscited by 1
- 2026Auditing and Controlling AI Agent Actions in Spreadsheetscited by 1
- 2026CollabSkill: Evaluating Human-Agent Collaboration On Real-World Taskscited by 1
- 2026HANSEL: Extracting Breadcrumbs from Web Agent Trajectories for Interactive Verificationcited by 1
- 2026JarvisHub: An Open Harness for Canvas-Native Multimodal Creative Agentscited by 1
- 2026Agents in the Wild: Where Research Meets Deploymentcited by 0
- 2026Plans Work in Mysterious Ways: Evaluating a Plan Mode for Spreadsheet Agentscited by 0
- 2026AgentGUI: An Interface for Observing and Steering Long-Running AI Agentscited by 0
- 2026AdaLens: Interactive Storyline for Monitoring and Steering Long-Running Agentic Data Analysiscited by 0
- 2026GRASP: Generating, Revising, and Assessing for Strategic Planning with Agentic AIcited by 0
- 2026Trust and Task Completion in the World of Consumer AI Agentscited by 0
- 2026L3M: A Verifiable Harness and Runtime for Self-Extending and Self-Improving Agentscited by 0
- 2026Task-State Governance: A Virtual Machine for Verifiable and Recoverable GUI Agent Executioncited by 0
- 2026Task-State Governance: A Virtual Machine for Verifiable and Recoverable GUI Agent Execution14 Oct 2026
- 2026L3M: A Verifiable Harness and Runtime for Self-Extending and Self-Improving Agents14 Oct 2026
- 2026Trust and Task Completion in the World of Consumer AI Agents26 Sep 2026
- 2026GRASP: Generating, Revising, and Assessing for Strategic Planning with Agentic AI24 Sep 2026
- 2026From Language Models to World-Acting Systems: Progress and Limits of Agentic AI across Digital, Social, Virtual, and Physical Environments4 Sep 2026
- 2026AdaLens: Interactive Storyline for Monitoring and Steering Long-Running Agentic Data Analysis18 Aug 2026
- 2026AgentGUI: An Interface for Observing and Steering Long-Running AI Agents28 Jul 2026
- 2026Plans Work in Mysterious Ways: Evaluating a Plan Mode for Spreadsheet Agents26 Jul 2026
- 2026JarvisHub: An Open Harness for Canvas-Native Multimodal Creative Agents26 Jul 2026
- 2026Agents in the Wild: Where Research Meets Deployment21 Jul 2026
- 2026Plover: Steering GUI Agents through Plan-Centric Interaction16 Jul 2026
- 2026Humans are Missing from AI Coding Agent Research4 Jul 2026
31 more
- 2026HiLSVA: Design and Evaluation of a Human-in-the-Loop Agentic System for Scientific Visualization25 Jun 2026
- 2026Governed AI-Assisted Engineering: Graduated Human Oversight for Agentic Code Generation in Regulated Domains21 Jun 2026
- 2026Fara-1.5: Scalable Learning Environments for Computer Use Agents18 Jun 2026
- 2026HANSEL: Extracting Breadcrumbs from Web Agent Trajectories for Interactive Verification17 Jun 2026
- 2026SentinelBench: A Benchmark for Long-Running Monitoring Agents3 Jun 2026
- 2026Autonomy and Agency in Agentic AI: Architectural Tactics for Regulated Contexts12 May 2026
- 2026Hedwig: Dynamic Autonomy for Coding Agents Under Local Oversight12 May 2026
- 2026RunAgent: Interpreting Natural-Language Plans with Constraint-Guided Execution1 May 2026
- 2026Auditing and Controlling AI Agent Actions in Spreadsheets22 Apr 2026
- 2026CollabSkill: Evaluating Human-Agent Collaboration On Real-World Tasks20 Apr 2026
- 2026Comparing Human Oversight Strategies for Computer-Use Agents6 Apr 2026
- 2026Adaptive Collaboration with Humans: Metacognitive Policy Optimization for Multi-Agent LLMs with Continual Learning9 Mar 2026
- 2026Modeling Distinct Human Interaction in Web Agents19 Feb 2026
- 2026Overseeing Agents Without Constant Oversight: Challenges and Opportunities18 Feb 2026
- 2026AIR: Improving Agent Safety through Incident Response12 Feb 2026
- 2026When Benign Inputs Lead to Severe Harms: Eliciting Unsafe Unintended Behaviors of Computer-Use Agents9 Feb 2026
- 2026Mapping the Design Space of User Experience for Computer Use Agents7 Feb 2026
- 2026Toward Safe and Responsible AI Agents: A Three-Pillar Model for Transparency, Accountability, and Trustworthiness9 Jan 2026
- 2025MiniScope: A Least Privilege Framework for Authorizing Tool Calling Agents11 Dec 2025
- 2025AgentProg: Empowering Long-Horizon GUI Agents with Program-Guided Context Management11 Dec 2025
- 2025On the Regulatory Potential of User Interfaces for AI Agent Governance30 Nov 2025
- 2025Fara-7B: An Efficient Agentic Model for Computer Use24 Nov 2025
- 2025Designing Beyond Language: Sociotechnical Barriers in AI Health Technologies for Limited English Proficiency10 Nov 2025
- 2025TheMCPCompany: Creating General-purpose Agents with Task-specific Tools22 Oct 2025
- 2025WebRouter: Query-specific Router via Variational Information Bottleneck for Cost-sensitive Web Agent13 Oct 2025
- 2025When Should Users Check? Modeling Confirmation Frequency in Multi-Step Agentic AI Tasks6 Oct 2025
- 2025An Evaluation-Centric Paradigm for Scientific Visualization Agents18 Sep 2025
- 2025Interaction-Driven Browsing: A Human-in-the-Loop Conceptual Framework Informed by Human Web Browsing for Browser-Using Agents15 Sep 2025
- 2025Dark Patterns Meet GUI Agents: LLM Agent Susceptibility to Manipulative Interfaces and the Role of Human Oversight12 Sep 2025
- 2025Instruction Agent: Enhancing Agent with Expert Demonstration8 Sep 2025
- 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Survey2 Sep 2025
- 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 205
- 2025Fara-7B: An Efficient Agentic Model for Computer Usecited by 35
- 2025Dark Patterns Meet GUI Agents: LLM Agent Susceptibility to Manipulative Interfaces and the Role of Human Oversightcited by 16
- 2026When Benign Inputs Lead to Severe Harms: Eliciting Unsafe Unintended Behaviors of Computer-Use Agentscited by 14
- 2025AgentProg: Empowering Long-Horizon GUI Agents with Program-Guided Context Managementcited by 11
- 2026Adaptive Collaboration with Humans: Metacognitive Policy Optimization for Multi-Agent LLMs with Continual Learningcited by 9
- 2026AIR: Improving Agent Safety through Incident Responsecited by 8
- 2026Mapping the Design Space of User Experience for Computer Use Agentscited by 7
- 2025An Evaluation-Centric Paradigm for Scientific Visualization Agentscited by 6
- 2025When Should Users Check? Modeling Confirmation Frequency in Multi-Step Agentic AI Taskscited by 6
- 2026Comparing Human Oversight Strategies for Computer-Use Agentscited by 6
- 2026Fara-1.5: Scalable Learning Environments for Computer Use Agentscited by 6
12 most cited of 31 All 31 (JSON)
- 2026Task-State Governance: A Virtual Machine for Verifiable and Recoverable GUI Agent Execution14 Oct 2026
- 2026L3M: A Verifiable Harness and Runtime for Self-Extending and Self-Improving Agents14 Oct 2026
- 2026Trust and Task Completion in the World of Consumer AI Agents26 Sep 2026
- 2026GRASP: Generating, Revising, and Assessing for Strategic Planning with Agentic AI24 Sep 2026
- 2026From Language Models to World-Acting Systems: Progress and Limits of Agentic AI across Digital, Social, Virtual, and Physical Environments4 Sep 2026
- 2026AdaLens: Interactive Storyline for Monitoring and Steering Long-Running Agentic Data Analysis18 Aug 2026
- 2026Plans Work in Mysterious Ways: Evaluating a Plan Mode for Spreadsheet Agents26 Jul 2026
- 2026Plover: Steering GUI Agents through Plan-Centric Interaction16 Jul 2026
- 2026Humans are Missing from AI Coding Agent Research4 Jul 2026
- 2026HiLSVA: Design and Evaluation of a Human-in-the-Loop Agentic System for Scientific Visualization25 Jun 2026
- 2026Governed AI-Assisted Engineering: Graduated Human Oversight for Agentic Code Generation in Regulated Domains21 Jun 2026
- 2026Fara-1.5: Scalable Learning Environments for Computer Use Agents18 Jun 2026
12 newest of 31 All 31 (JSON)
- 2026Agents in the Wild: Where Research Meets Deploymentcited by 0
- 2026Agents in the Wild: Where Research Meets Deployment21 Jul 2026
- 2026Toward Safe and Responsible AI Agents: A Three-Pillar Model for Transparency, Accountability, and Trustworthinesscited by 4
- 2025Interaction-Driven Browsing: A Human-in-the-Loop Conceptual Framework Informed by Human Web Browsing for Browser-Using Agentscited by 3
- 2025On the Regulatory Potential of User Interfaces for AI Agent Governancecited by 3
- 2026SentinelBench: A Benchmark for Long-Running Monitoring Agentscited by 3
- 2026RunAgent: Interpreting Natural-Language Plans with Constraint-Guided Executioncited by 2
- 2025Instruction Agent: Enhancing Agent with Expert Demonstrationcited by 1
- 2025Designing Beyond Language: Sociotechnical Barriers in AI Health Technologies for Limited English Proficiencycited by 1
- 2026Auditing and Controlling AI Agent Actions in Spreadsheetscited by 1
- 2026CollabSkill: Evaluating Human-Agent Collaboration On Real-World Taskscited by 1
- 2026JarvisHub: An Open Harness for Canvas-Native Multimodal Creative Agentscited by 1
- 2026AgentGUI: An Interface for Observing and Steering Long-Running AI Agentscited by 0
- 2026AgentGUI: An Interface for Observing and Steering Long-Running AI Agents28 Jul 2026
- 2026JarvisHub: An Open Harness for Canvas-Native Multimodal Creative Agents26 Jul 2026
- 2026SentinelBench: A Benchmark for Long-Running Monitoring Agents3 Jun 2026
- 2026RunAgent: Interpreting Natural-Language Plans with Constraint-Guided Execution1 May 2026
- 2026Auditing and Controlling AI Agent Actions in Spreadsheets22 Apr 2026
- 2026CollabSkill: Evaluating Human-Agent Collaboration On Real-World Tasks20 Apr 2026
- 2026Toward Safe and Responsible AI Agents: A Three-Pillar Model for Transparency, Accountability, and Trustworthiness9 Jan 2026
- 2025On the Regulatory Potential of User Interfaces for AI Agent Governance30 Nov 2025
- 2025Designing Beyond Language: Sociotechnical Barriers in AI Health Technologies for Limited English Proficiency10 Nov 2025
- 2025Interaction-Driven Browsing: A Human-in-the-Loop Conceptual Framework Informed by Human Web Browsing for Browser-Using Agents15 Sep 2025
- 2025Instruction Agent: Enhancing Agent with Expert Demonstration8 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks
- 2025DuetUI: A Bidirectional Context Loop for Human-Agent Co-Generation of Task-Oriented Interfaces
- 2024Interactive Speculative Planning: Enhance Agent Efficiency through Co-design of System and User Interface
- 2025AgentBay: A Hybrid Interaction Sandbox for Seamless Human-AI Intervention in Agentic Systems
- 2024Agent S: An Open Agentic Framework that Uses Computers Like a Human
- 2026OmegaUse: Building a General-Purpose GUI Agent for Autonomous Task Execution
- 2025WebGames: Challenging General-Purpose Web-Browsing AI Agents
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agents