mlsanityData to 7 Oct 2026

OpenHands: An Open Platform for AI Software Developers as Generalist Agents

arXiv 2407.16741 ↗First posted 23 Jul 2024cs.SE cs.AI cs.CLcited by 956

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Software is one of the most powerful tools that we humans have at our disposal; it allows a skilled programmer to interact with the world in complex and profound ways. At the same time, thanks to improvements in large language models (LLMs), there has also been a rapid development in AI agents that interact with and affect change in their surrounding environments. In this paper, we introduce OpenHands (f.k.a. OpenDevin), a platform for the development of powerful and flexible AI agents that interact with the world in similar ways to those of a human developer: by writing code, interacting with a command line, and browsing the web. We describe how the platform allows for the implementation of new agents, safe interaction with sandboxed environments for code execution, coordination between multiple agents, and incorporation of evaluation benchmarks. Based on our currently incorporated benchmarks, we perform an evaluation of agents over 15 challenging tasks, including software engineering (e.g., SWE-BENCH) and web browsing (e.g., WEBARENA), among others. Released under the permissive MIT license, OpenHands is a community project spanning academia and industry with more than 2.1K contributions from over 188 contributors.

Key facts. Cited by 956 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 44 of its 79 references that are in the map. First posted on arXiv 23 Jul 2024.

Builds on

44 of 79 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024Agentless: Demystifying LLM-based Software Engineering Agents1 Jul
  2. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
  3. 2024Executable Code Actions Elicit Better LLM Agents1 Feb
  4. 2023ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code16 Nov
  5. 2023ProAgent: From Robotic Process Automation to Agentic Process Automation2 Nov

Other references · 39

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  4. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  5. 2023Qwen Technical Reportcited by 3,273
  6. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  7. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  8. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  9. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  10. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  11. 2024Mixtral of Expertscited by 1,785
  12. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
27 more
  1. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  2. 2023A Survey on Evaluation of Large Language Modelscited by 1,227
  3. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  4. 2023GAIA: a benchmark for General AI Assistantscited by 1,084
  5. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
  6. 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 667
  7. 2023Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoningcited by 379
  8. 2023Language Models can Solve Computer Taskscited by 371
  9. 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?cited by 348
  10. 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 311
  11. 2020ProofWriter: Generating Implications, Proofs, and Abductive Statements over Natural Languagecited by 309
  12. 2023MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedbackcited by 293
  13. 2018Reinforcement Learning on Web Interfaces Using Workflow-Guided Explorationcited by 282
  14. 2023ToolQA: A Dataset for LLM Question Answering with External Toolscited by 273
  15. 2024Advancing LLM Reasoning Generalists with Preference Treescited by 191
  16. 2023OpenAgents: An Open Platform for Language Agents in the Wildcited by 136
  17. 2024Autonomous Evaluation and Refinement of Digital Agentscited by 136
  18. 2023CRAFT: Customizing LLMs by Creating and Retrieving from Specialized Toolsetscited by 122
  19. 2023Mindstorms in Natural Language-Based Societies of Mindcited by 105
  20. 2022A data-driven approach for learning to control computerscited by 87
  21. 2023Lemur: Harmonizing Natural Language and Code for Language Agentscited by 71
  22. 2023From Pixels to UI Actions: Learning to Follow Instructions via Graphical User Interfacescited by 67
  23. 2024Large Language Models Can Self-Improve At Web Agent Taskscited by 54
  24. 2024Risks of AI Scientists: Prioritizing Safeguarding Over Autonomycited by 49
  25. 2023A Zero-Shot Language Agent for Computer Control with Structured Reflectioncited by 28
  26. 2023BioCoder: A Benchmark for Bioinformatics Code Generation with Large Language Modelscited by 24
  27. 2023Probing the Multi-turn Planning Capabilities of LLMs via 20 Question Gamescited by 24

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 43; 2025: 262; 2026: 651.

956 papers.

Sort:

By area:

  1. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
  2. 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
  3. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
  4. 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agentscited by 406
  5. 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 405
  6. 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Taskscited by 306
  7. 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 300
  8. 2024OLMoE: Open Mixture-of-Experts Language Modelscited by 291
  9. 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 255
  10. 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 254
  11. 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactionscited by 236
  12. 2024Agent-as-a-Judge: Evaluate Agents with Agentscited by 223
38 more
  1. 2024ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discoverycited by 208
  2. 2025AIDE: AI-Driven Exploration in the Space of Codecited by 206
  3. 2024SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?cited by 196
  4. 2024RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human expertscited by 153
  5. 2024The BrowserGym Ecosystem for Web Agent Researchcited by 152
  6. 2025The Danger of Overthinking: Examining the Reasoning-Action Dilemma in Agentic Taskscited by 150
  7. 2025R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agentscited by 140
  8. 2025Scaling Long-Horizon LLM Agent via Context-Foldingcited by 136
  9. 2024ST-WebAgentBench: A Benchmark for Evaluating Safety and Trustworthiness in Web Agentscited by 126
  10. 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 125
  11. 2024SWE-Search: Enhancing Software Agents with Monte Carlo Tree Search and Iterative Refinementcited by 124
  12. 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnessescited by 119
  13. 2025Alita: Generalist Agent Enabling Scalable Agentic Reasoning with Minimal Predefinition and Maximal Self-Evolutioncited by 114
  14. 2025MLGym: A New Framework and Benchmark for Advancing AI Research Agentscited by 111
  15. 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?cited by 105
  16. 2025SafeArena: Evaluating the Safety of Autonomous Web Agentscited by 97
  17. 2024AutoGLM: Autonomous Foundation Agents for GUIscited by 96
  18. 2025What's Behind PPO's Collapse in Long-CoT? Value Optimization Holds the Secretcited by 95
  19. 2025Learn-by-interact: A Data-Centric Framework for Self-Adaptive Agents in Realistic Environmentscited by 93
  20. 2025Trae Agent: An LLM-based Agent for Software Engineering with Test-time Scalingcited by 93
  21. 2025VerlTool: Towards Holistic Agentic Reinforcement Learning with Tool Usecited by 92
  22. 2025Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?cited by 91
  23. 2024RepoGraph: Enhancing AI Software Engineering with Repository-level Code Graphcited by 88
  24. 2025Holistic Agent Leaderboard: The Missing Infrastructure for AI Agent Evaluationcited by 83
  25. 2025LocAgent: Graph-Guided LLM Agents for Code Localizationcited by 82
  26. 2025MemEvolve: Meta-Evolution of Agent Memory Systemscited by 81
  27. 2026Self-Harness: Harnesses That Improve Themselvescited by 79
  28. 2024Beyond Browsing: API-Based Web Agentscited by 77
  29. 2025Agentic AI for Scientific Discovery: A Survey of Progress, Challenges, and Future Directionscited by 74
  30. 2025CyberGym: Evaluating AI Agents' Real-World Cybersecurity Capabilities at Scalecited by 71
  31. 2025OpenAgentSafety: A Comprehensive Framework for Evaluating Real-World AI Agent Safetycited by 71
  32. 2025SEC-bench: Automated Benchmarking of LLM Agents on Real-World Software Security Taskscited by 69
  33. 2024MarsCode Agent: AI-native Automated Bug Fixingcited by 68
  34. 2025Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoningcited by 68
  35. 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 68
  36. 2025WebGen-Bench: Evaluating LLMs on Generating Interactive and Functional Websites from Scratchcited by 66
  37. 2025AgentRxiv: Towards Collaborative Autonomous Researchcited by 64
  38. 2025SWE-Exp: Experience-Driven Software Issue Resolutioncited by 64

50 most cited of 956 All 956 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2026Can Agents Generalize to the Open World? Unveiling the Fragility of Static Training in Tool Use
  2. 2026OpenSkillEval: Automatically Auditing the Open Skill Ecosystem for LLM Agents
  3. 2026Open, Reliable, and Collective: A Community-Driven Framework for Tool-Using AI Agents
  4. 2025Agentic Refactoring: An Empirical Study of AI Coding Agents
  5. 2025An Empirical Study of Agent Developer Practices in AI Agent Frameworks
  6. 2023Agents: An Open-source Framework for Autonomous Language Agents
  7. 2026OpenThoughts-Agent: Data Recipes for Agentic Models
  8. 2025AgentScope 1.0: A Developer-Centric Framework for Building Agentic Applications