mlsanityData to 7 Oct 2026

How Do AI Agents Do Human Work? Comparing AI and Human Workflows Across Diverse Occupations

arXiv 2510.22780 ↗First posted 26 Oct 2025cs.AI cs.CL cs.HCcited by 17

Not on the map. Why?

Abstract (arXiv)

AI agents are continually optimized for tasks related to human work, such as software engineering and professional writing, signaling a pressing trend with significant impacts on the human workforce. However, these agent developments have often not been grounded in a clear understanding of how humans execute work, to reveal what expertise agents possess and the roles they can play in diverse workflows. In this work, we study how agents do human work by presenting the first direct comparison of human and agent workers across multiple essential work-related skills: data analysis, engineering, computation, writing, and design. To better understand and compare heterogeneous computer-use activities of workers, we introduce a scalable toolkit to induce interpretable, structured workflows from either human or agent computer-use activities. Using such induced workflows, we compare how humans and agents perform the same tasks and find that: (1) While agents exhibit promise in their alignment to human workflows, they take an overwhelmingly programmatic approach across all work domains, even for open-ended, visually dependent tasks like design, creating a contrast with the UI-centric methods typically used by humans. (2) Agents produce work of inferior quality, yet often mask their deficiencies via data fabrication and misuse of advanced tools. (3) Nonetheless, agents deliver results 88.3% faster and cost 90.4-96.2% less than humans, highlighting the potential for enabling efficient collaboration by delegating easily programmable tasks to agents.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 49 of its 78 references that are in the map. First posted on arXiv 26 Oct 2025.

Builds on

49 of 78 references.

References · 49

  1. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  2. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  3. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
  4. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
  5. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
  6. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
  7. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
  8. 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agentscited by 373
  9. 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?cited by 348
  10. 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 348
  11. 2024Agent Workflow Memorycited by 342
  12. 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Taskscited by 306
37 more
  1. 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 300
  2. 2018Reinforcement Learning on Web Interfaces Using Workflow-Guided Explorationcited by 282
  3. 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 245
  4. 2023GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Modelscited by 174
  5. 2024RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human expertscited by 153
  6. 2025OpenCUA: Open Foundations for Computer-Use Agentscited by 151
  7. 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 146
  8. 2025GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Taskscited by 142
  9. 2025Scaling Computer-Use Grounding via User Interface Decomposition and Synthesiscited by 132
  10. 2024When combinations of humans and AI are useful: A systematic review and meta-analysiscited by 100
  11. 2025Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivitycited by 93
  12. 2025Which Economic Tasks are Performed with AI? Evidence from Millions of Claude Conversationscited by 88
  13. 2024Beyond Browsing: API-Based Web Agentscited by 77
  14. 2024TroVE: Inducing Verifiable and Efficient Toolboxes for Solving Programmatic Taskscited by 70
  15. 2024CRMArena: Understanding the Capacity of LLM Agents to Perform Professional CRM Tasks in Realistic Environmentscited by 69
  16. 2023From Pixels to UI Actions: Learning to Follow Instructions via Graphical User Interfacescited by 67
  17. 2025AutoPresent: Designing Structured Visuals from Scratchcited by 63
  18. 2024What Are Tools Anyway? A Survey from the Language Model Perspectivecited by 53
  19. 2025Creating General User Models from Computer Usecited by 44
  20. 2017When Will AI Exceed Human Performance? Evidence from AI Expertscited by 41
  21. 2024ScribeAgent: Towards Specialized Web Agents Using Production-Scale Workflow Datacited by 39
  22. 2025Future of Work with AI Agents: Auditing Automation and Augmentation Potential across the U.S. Workforcecited by 33
  23. 2024Can Large Language Models Understand Symbolic Graphics Programs?cited by 32
  24. 2025Code with Me or for Me? How Increasing AI Automation Transforms Developer Workflowscited by 27
  25. 2025Coding Agents with Multimodal Browsing are Generalist Problem Solverscited by 24
  26. 2024Ironies of Generative AI: Understanding and mitigating productivity loss in human-AI interactionscited by 20
  27. 2023Designing LLM Chains by Adapting Techniques from Crowdsourcing Workflowscited by 17
  28. 2024WONDERBREAD: A Benchmark for Evaluating Multimodal Foundation Models on Business Process Management Taskscited by 11
  29. 2024Demystifying Tacit Knowledge in Graphic Design: Characteristics, Instances, Approaches, and Guidelinescited by 10
  30. 2025MoVer: Motion Verification for Motion Graphics Animationscited by 10
  31. 2025De-skilling, Cognitive Offloading, and Misplaced Responsibilities: Potential Ironies of AI-Assisted Designcited by 10
  32. 2025Orchestrating Human-AI Teams: The Manager Agent as a Unifying Research Challengecited by 8
  33. 2025CorpusStudio: Surfacing Emergent Patterns in a Corpus of Prior Work while Writingcited by 5
  34. 2024Unveiling Disparities in Web Task Handling Between Human and Web Agentcited by 2
  35. 2025LawFlow: Collecting and Simulating Lawyers' Thought Processes on Business Formation Case Studiescited by 2
  36. 2025Understanding User Experiences of Computer Use Agents: Design Space and Opportunities for Building Agent UX Prototypescited by 2
  37. 2025Knoll: Creating a Knowledge Ecosystem for Large Language Modelscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 17.

17 papers.

Sort:

By area:

  1. 2026How Well Does Agent Development Reflect Real-World Work?cited by 10
  2. 2026Learning Next Action Predictors from Human-Computer Interactioncited by 7
  3. 2026Modeling Distinct Human Interaction in Web Agentscited by 5
  4. 2026Agentic Search in the Wild: Intents and Trajectory Dynamics from 14M+ Real Search Requestscited by 4
  5. 2026Reasoning over mathematical objects: on-policy reward modeling and test time aggregationcited by 3
  6. 2026Humans are Missing from AI Coding Agent Researchcited by 3
  7. 2026Do AI Coding Agents Log Like Humans? An Empirical Studycited by 2
  8. 2026RAG-Reflect: Agentic Retrieval-Augmented Generation with Reflections for Comment-Driven Code Maintenance on Stack Overflowcited by 1
  9. 2026Offloading Score: Measuring AI Reliance Through Counterfactual Workflowscited by 1
  10. 2026CollabSkill: Evaluating Human-Agent Collaboration On Real-World Taskscited by 1
  11. 2026Same Outcomes, Different Journeys: A Trace-Level Framework for Comparing Human and GUI-Agent Behavior in Production Search Systemscited by 0
  12. 2026A paradox of AI fluencycited by 0
5 more
  1. 2026Spreadsheet-RL: Advancing Large Language Model Agents on Realistic Spreadsheet Tasks via Reinforcement Learningcited by 0
  2. 2026DigitalCoach: Communication and Grounding Gaps in Human and Agentic Computer Use Coachingcited by 0
  3. 2026Inducing Task Models from Computer-Use Tracescited by 0
  4. 2026Efficient Test-Time Adaptation through Human-AI Interactioncited by 0
  5. 2026ORQA: An Occupation-Realistic Question and Answer Framework for LLM Professional Knowledgecited by 0