mlsanityData to 14 Oct 2026

LiteCUA: Computer as MCP Server for Computer-Use Agent on AIOS

arXiv 2505.18829 ↗First posted 24 May 2025cs.AI cs.HC cs.OScited by 4

On the map: LLM agents and tool use → Tool learning and function calling

Abstract (arXiv)

We present AIOS 1.0, a novel platform designed to advance computer-use agent (CUA) capabilities through environmental contextualization. While existing approaches primarily focus on building more powerful agent frameworks or enhancing agent models, we identify a fundamental limitation: the semantic disconnect between how language models understand the world and how computer interfaces are structured. AIOS 1.0 addresses this challenge by transforming computers into contextual environments that language models can natively comprehend, implementing a Model Context Protocol (MCP) server architecture to abstract computer states and actions. This approach effectively decouples interface complexity from decision complexity, enabling agents to reason more effectively about computing environments. To demonstrate our platform's effectiveness, we introduce LiteCUA, a lightweight computer-use agent built on AIOS 1.0 that achieves a 14.66% success rate on the OSWorld benchmark, outperforming several specialized agent frameworks despite its simple architecture. Our results suggest that contextualizing computer environments for language models represents a promising direction for developing more capable computer-use agents and advancing toward AI that can interact with digital systems.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Tool learning and function calling, one of 16 directions in LLM agents and tool use. Builds on 45 of its 53 references that are in the map. First posted on arXiv 24 May 2025.

Builds on

45 of 53 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs31 Jul
  2. 2023Gorilla: Large Language Model Connected with Massive APIs24 May

Other references · 43

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  5. 2024Qwen2.5 Technical Reportcited by 4,942
  6. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  7. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
  8. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  9. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
  10. 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
  11. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
  12. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
31 more
  1. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
  2. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
  3. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
  4. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
  5. 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 610
  6. 2024Executable Code Actions Elicit Better LLM Agentscited by 564
  7. 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 468
  8. 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agentscited by 382
  9. 2025Seed1.5-VL Technical Reportcited by 373
  10. 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challengescited by 282
  11. 2024Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scalecited by 223
  12. 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvementcited by 205
  13. 2023OpenAGI: When LLM Meets Domain Expertscited by 197
  14. 2023AutoDroid: LLM-powered Task Automation in Androidcited by 184
  15. 2025Agent S2: A Compositional Generalist-Specialist Framework for Computer Use Agentscited by 159
  16. 2024The Impact of Reasoning Step Length on Large Language Modelscited by 153
  17. 2024Aria-UI: Visual Grounding for GUI Instructionscited by 140
  18. 2023On the Tool Manipulation Capability of Open-source Large Language Modelscited by 122
  19. 2024WebCanvas: Benchmarking Web Agents in Online Environmentscited by 121
  20. 2024AgentGym: Evolving Large Language Model-based Agents across Diverse Environmentscited by 120
  21. 2024AIOS: LLM Agent Operating Systemcited by 97
  22. 2024ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learningcited by 62
  23. 2024Mobile-Bench: An Evaluation Benchmark for LLM-based Mobile Agentscited by 56
  24. 2024Learning from Teaching Regularization: Generalizable Correlations Should be Easy to Imitatecited by 47
  25. 2025UFO2: The Desktop AgentOScited by 41
  26. 2024OSCAR: Operating System Control via State-Aware Reasoning and Re-Planningcited by 38
  27. 2025Two Heads are Better Than One: Test-time Scaling of Multi-agent Collaborative Reasoningcited by 29
  28. 2024AgentStore: Scalable Integration of Heterogeneous Agents As Specialized Generalist Computer Assistantcited by 27
  29. 2025Self-Resource Allocation in Multi-Agent LLM Systemscited by 15
  30. 2025WebRollback: Enhancing Web Agents with Explicit Rollback Mechanismscited by 15
  31. 2025Cerebrum (AIOS SDK): A Platform for Agent Development, Deployment, Distribution, and Discoverycited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 1.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025MCPZoo: A Large-Scale Dataset of Runnable Model Context Protocol Servers for AI Agent
  2. 2025MCP-AgentBench: Evaluating Real-World Language Agent Performance with MCP-Mediated Tools
  3. 2026Agentic Artificial Intelligence (AI): Architectures, Taxonomies, and Evaluation of Large Language Model Agents
  4. 2025OS Agents: A Survey on MLLM-based Agents for General Computing Devices Use
  5. 2025Advancing Multi-Agent Systems Through Model Context Protocol: Architecture, Implementation, and Applications
  6. 2025Agentic AI Frameworks: Architectures, Protocols, and Design Challenges
  7. 2025Planet as a Brain: Towards Internet of AgentSites based on AIOS Server
  8. 2026MCP-Cosmos: World Model-Augmented Agents for Complex Task Execution in MCP Environments