mlsanityData to 14 Oct 2026

MyPCBench: A Benchmark for Personally Intelligent Computer-Use Agents

arXiv 2606.16748 ↗First posted 15 Jun 2026cs.LG cs.CLcited by 7

On the map: LLM agents and tool use → GUI and mobile agents

Abstract (arXiv)

Current benchmarks for computer-use agents evaluate models in impersonal environments. This leaves a gap between evaluation and deployment where personal assistants are expected to work across a user's whole digital life, including their context, historical data, and logged-in accounts. This gap is widest on web tasks, where live web evaluations cannot exercise sites that require logging in or personal information, the kind of site a real personal assistant has to drive. We introduce MyPCBench, which tests computer-use agents as personal assistants on a Linux desktop populated with 17 simulated real-world web applications and a full desktop stack, all seeded for one canonical persona, Michael Scott from The Office. We define 184 tasks in this environment, each inspired by a real request drawn from the OpenClaw community, and benchmark six closed and open-weight models with a uniform computer+bash tool surface. We find that the best model, Claude Opus 4.6, fully solves 55.4% of the tasks, the only model above 50%. Model failures cluster on tasks that span many applications and on long trajectories, where personalization stresses an assistant the most. We release the environment, task set, and agent harness at https://mypcbench.com.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 26 of its 34 references that are in the map. First posted on arXiv 15 Jun 2026.

Builds on

26 of 34 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025macOSWorld: A Multilingual Interactive Benchmark for GUI Agents4 Jun
  2. 2025ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Use4 Apr
  3. 2024Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale12 Sep
  4. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments11 Apr
  5. 2024OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Web27 Feb

Other references · 21

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  4. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
  5. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
  6. 2023GAIA: a benchmark for General AI Assistantscited by 1,128
  7. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
  8. 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 468
  9. 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 438
  10. 2023LaMP: When Large Language Models Meet Personalizationcited by 437
  11. 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 401
  12. 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?cited by 363
9 more
  1. 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Taskscited by 326
  2. 2018Reinforcement Learning on Web Interfaces Using Workflow-Guided Explorationcited by 284
  3. 2025An Illusion of Progress? Assessing the Current State of Web Agentscited by 174
  4. 2024Large Language Models Empowered Personalized Web Agentscited by 66
  5. 2024NNetNav: Unsupervised Learning of Browser Agents Through Environment Interaction in the Wildcited by 59
  6. 2026WildClawBench: A Benchmark for Real-World, Long-Horizon Agent Evaluationcited by 37
  7. 2026ClawBench: Can AI Agents Complete Everyday Online Tasks?cited by 33
  8. 2026Odysseys: Benchmarking Web Agents on Realistic Long Horizon Taskscited by 21
  9. 2026Persona2Web: Benchmarking Personalized Web Agents for Contextual Reasoning with User Historycited by 14

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Claw-Anything: Benchmarking Always-On Personal Assistants with Broader Access to User's Digital World
  2. 2026π-Bench: Evaluating Proactive Personal Assistant Agents in Long-Horizon Workflows
  3. 2026STAGE-Claw: Automated State-based Agent Benchmarking for Realistic Scenarios
  4. 2026VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactions
  5. 2026TUA-Bench: A Benchmark for General-Purpose Terminal-Use Agents
  6. 2026PersonaTrail: Benchmarking Personalized Web Agents through Browsing Trails
  7. 2026Syll: Open-Source Personal Automation with Cross-Surface Execution
  8. 2026SovereignPA-Bench: Evaluating User-Owned Personal Agents under Evolving Intent, Platform Mediation, and Consent Constraints