mlsanityData to 14 Oct 2026

Coding Agents with Multimodal Browsing are Generalist Problem Solvers

arXiv 2506.03011 ↗First posted 3 Jun 2025cs.CLcited by 25

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

Modern human labor is characterized by specialization; we train for years and develop particular tools that allow us to perform well across a variety of tasks. In addition, AI agents have been specialized for domains such as software engineering, web navigation, and workflow automation. However, this results in agents that are good for one thing but fail to generalize beyond their intended scope. One reason for this is that agent developers provide a highly specialized set of tools or make architectural decisions optimized for a specific use case or benchmark. In this work, we ask the question: what is the minimal set of general tools that can be used to achieve high performance across a diverse set of tasks? Our answer is OpenHands-Versa, a generalist agent built with a modest number of general tools: code editing and execution, web search, as well as multimodal web browsing and file access. Importantly, OpenHands-Versa demonstrates superior or competitive performance over leading specialized agents across three diverse and challenging benchmarks: SWE-Bench Multimodal, GAIA, and The Agent Company, outperforming the best-performing previously published results with absolute improvements in success rate of 9.1, 1.3, and 9.1 points respectively. Further, we show how existing state-of-the-art multi-agent systems fail to generalize beyond their target domains. These results demonstrate the feasibility of developing a generalist agent to solve diverse tasks and establish OpenHands-Versa as a strong baseline for future research.

Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 15 of its 34 references that are in the map. First posted on arXiv 3 Jun 2025.

Builds on

15 of 34 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Symbiotic Cooperation for Web Agents: Harnessing Complementary Strengths of Large and Small LLMs11 Feb
  2. 2024The BrowserGym Ecosystem for Web Agent Research6 Dec
  3. 2024AgentOccam: A Simple Yet Strong Baseline for LLM-Based Web Agents17 Oct
  4. 2024Agent Workflow Memory11 Sep
  5. 2023WebArena: A Realistic Web Environment for Building Autonomous Agents25 Jul

Other references · 10

  1. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  2. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  3. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
  4. 2023GAIA: a benchmark for General AI Assistantscited by 1,128
  5. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
  6. 2024Agentless: Demystifying LLM-based Software Engineering Agentscited by 421
  7. 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Taskscited by 232
  8. 2024SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?cited by 203
  9. 2025OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automationcited by 131
  10. 2024TapeAgents: a Holistic Framework for Agent Development and Optimizationcited by 13

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 14; 2026: 11.

25 papers.

Sort:

By area:

  1. 2025The OpenHands Software Agent SDK: A Composable and Extensible Foundation for Production Agentscited by 45
  2. 2025How Do AI Agents Do Human Work? Comparing AI and Human Workflows Across Diverse Occupationscited by 19
  3. 2025InnovatorBench: Evaluating Agents' Ability to Conduct Innovative LLM Researchcited by 19
  4. 2026Temporary Authority, Permanent Effects: Commit-Time Authorization for LLM Agentscited by 18
  5. 2025Open Data Synthesis For Deep Researchcited by 16
  6. 2025WebGen-Agent: Enhancing Interactive Website Generation with Multi-Level Feedback and Step-Level Reinforcement Learningcited by 15
  7. 2025A Comprehensive Survey on Benchmarks and Solutions in Software Engineering of LLM-Empowered Agentic Systemcited by 15
  8. 2025Can Language Models Discover Scaling Laws?cited by 13
  9. 2026SERA: Soft-Verified Efficient Repository Agentscited by 10
  10. 2026CodeScout: An Effective Recipe for Reinforcement Learning of Code Search Agentscited by 9
  11. 2026SkillMaster: Toward Autonomous Skill Mastery in LLM Agentscited by 8
  12. 2025Completion neq Collaboration: Scaling Collaborative Effort with Agentscited by 6
13 more
  1. 2025Agentic Software Issue Resolution with Large Language Models: A Surveycited by 6
  2. 2025MetaAgent: Toward Self-Evolving Agent via Tool Meta-Learningcited by 5
  3. 2025How can we assess human-agent interactions? Case studies in software agent designcited by 4
  4. 2025TheMCPCompany: Creating General-purpose Agents with Task-specific Toolscited by 4
  5. 2026Humans are Missing from AI Coding Agent Researchcited by 3
  6. 2025Library Hallucinations in LLM-Generated Code: A Risk Analysis Grounded in Developer Queriescited by 1
  7. 2025From Refusal to Recovery: A Control-Theoretic Approach to Generative AI Guardrailscited by 1
  8. 2026Towards Reliable ML Feature Engineering via Planning in Constrained-Topology of LLM Agentscited by 1
  9. 2026Can Current Agents Close the Discovery-to-Application Gap? A Case Study in Minecraftcited by 1
  10. 2026CVEvolve: Autonomous Algorithm Discovery for Unstructured Scientific Data Processingcited by 0
  11. 2026Towards Direct Latent-Space Synthesis for Parallel Branches in LLM-Agent Workflowscited by 0
  12. 2026Data Intelligence Agents: Interpreting, Modeling, and Querying Enterprise Data via Autonomous Coding Agentscited by 0
  13. 2026The Last Mile of Coding Agents for Long-Document Tasks: An Empirical Study on Clinical Trial Protocol Digitizationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024GTA: A Benchmark for General Tool Agents
  2. 2026Can Agents Generalize to the Open World? Unveiling the Fragility of Static Training in Tool Use
  3. 2024Beyond Browsing: API-Based Web Agents
  4. 2025OmniNova:A General Multimodal Agent Framework
  5. 2024Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale
  6. 2025BrowserAgent: Building Web Agents with Human-Inspired Web Browsing Actions
  7. 2025WALT: Web Agents that Learn Tools
  8. 2024OpenWebVoyager: Building Multimodal Web Agents via Iterative Real-World Exploration, Feedback and Optimization