mlsanityData to 14 Oct 2026

RepoMaster: Autonomous Exploration and Understanding of GitHub Repositories for Complex Task Solving

arXiv 2505.21577 ↗First posted 27 May 2025cs.SE cs.AIcited by 19

Not on the map. Why?

Abstract (arXiv)

The ultimate goal of code agents is to solve complex tasks autonomously. Although large language models (LLMs) have made substantial progress in code generation, real-world tasks typically demand full-fledged code repositories rather than simple scripts. Building such repositories from scratch remains a major challenge. Fortunately, GitHub hosts a vast, evolving collection of open-source repositories, which developers frequently reuse as modular components for complex tasks. Yet, existing frameworks like OpenHands and SWE-Agent still struggle to effectively leverage these valuable resources. Relying solely on README files provides insufficient guidance, and deeper exploration reveals two core obstacles: overwhelming information and tangled dependencies of repositories, both constrained by the limited context windows of current LLMs. To tackle these issues, we propose RepoMaster, an autonomous agent framework designed to explore and reuse GitHub repositories for solving complex tasks. For efficient understanding, RepoMaster constructs function-call graphs, module-dependency graphs, and hierarchical code trees to identify essential components, providing only identified core elements to the LLMs rather than the entire repository. During autonomous execution, it progressively explores related components using our exploration tools and prunes information to optimize context usage. Evaluated on the adjusted MLE-bench, RepoMaster achieves a 110% relative boost in valid submissions over the strongest baseline OpenHands. On our newly released GitTaskBench, RepoMaster lifts the task-pass rate from 40.7% to 62.9% while reducing token usage by 95%. Our code and demonstration materials are publicly available at https://github.com/QuantaAlpha/RepoMaster.

Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 36 of its 55 references that are in the map. First posted on arXiv 27 May 2025.

Builds on

36 of 55 references.

References · 36

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  5. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  6. 2023Qwen Technical Reportcited by 3,344
  7. 2023Code Llama: Open Foundation Models for Codecited by 2,139
  8. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  9. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  10. 2024Mixtral of Expertscited by 1,823
  11. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  12. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
24 more
  1. 2022Competition-Level Code Generation with AlphaCodecited by 1,462
  2. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
  3. 2023StarCoder: may the source be with you!cited by 799
  4. 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 591
  5. 2024Executable Code Actions Elicit Better LLM Agentscited by 564
  6. 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 469
  7. 2023RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generationcited by 367
  8. 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 366
  9. 2024DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligencecited by 331
  10. 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 321
  11. 2023Large Language Models as Tool Makerscited by 303
  12. 2023Tool Learning with Foundation Modelscited by 302
  13. 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challengescited by 282
  14. 2023ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddingscited by 240
  15. 2025AIDE: AI-Driven Exploration in the Space of Codecited by 226
  16. 2024Tool Learning with Large Language Models: A Surveycited by 223
  17. 2024DebugBench: Evaluating Debugging Capability of Large Language Modelscited by 76
  18. 2024TroVE: Inducing Verifiable and Efficient Toolboxes for Solving Programmatic Taskscited by 75
  19. 2024RepoAgent: An LLM-Powered Open-Source Framework for Repository-level Code Documentation Generationcited by 70
  20. 2023ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Codecited by 65
  21. 2024What Are Tools Anyway? A Survey from the Language Model Perspectivecited by 54
  22. 2023Can It Edit? Evaluating the Ability of Large Language Models to Follow Code Editing Instructionscited by 48
  23. 2024ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarioscited by 35
  24. 2024Tree-of-Code: A Tree-Structured Exploring Framework for End-to-End Code Generation and Execution in Complex Task Handlingcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 7; 2026: 12.

19 papers.

Sort:

By area:

  1. 2025GitTaskBench: A Benchmark for Code Agents Solving Real-World Tasks Through Code Repository Leveragingcited by 25
  2. 2025Retrieval-Augmented Code Generation: A Survey with Focus on Repository-Level Approachescited by 23
  3. 2025AutoMLGen: Navigating Fine-Grained Optimization for Coding Agentscited by 18
  4. 2026Current Agents Fail to Leverage World Model as Tool for Foresightcited by 17
  5. 2025Code2MCP: Transforming Code Repositories into MCP Servicescited by 10
  6. 2025MINED: Probing and Updating with Multimodal Time-Sensitive Knowledge for Large Multimodal Modelscited by 7
  7. 2026Learning to Ideate for Machine Learning Engineering Agentscited by 7
  8. 2026EvoFSM: Controllable Self-Evolution for Deep Research with Finite State Machinescited by 5
  9. 2025MV-Debate: Multi-view Agent Debate with Dynamic Reflection Gating for Multimodal Harmful Content Detection in Social Mediacited by 4
  10. 2025Gistify! Codebase-Level Understanding via Runtime Executioncited by 4
  11. 2026HarmonyCell: Automating Single-Cell Perturbation Modeling under Semantic and Distribution Shiftscited by 4
  12. 2026ToolRosella: Translating Code Repositories into Standardized Tools for Scientific Agentscited by 2
7 more
  1. 2026Agentic Agile-V: From Vibe Coding to Verified Engineering in Software and Hardware Developmentcited by 2
  2. 2026DeepDiscovery: A Location-Inference Framework for Task-Level Repository Understandingcited by 1
  3. 2026SW-A2-Bench: Benchmarking Autonomous Software Agent Generation for Agentic Webcited by 0
  4. 2026AblateCell: A Reproduce-then-Ablate Agent for Virtual Cell Repositoriescited by 0
  5. 2026MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Serverscited by 0
  6. 2026MADE: Belief-Driven Dual-Agent Coordination for Autonomous Model Deploymentcited by 0
  7. 2026FeatLens: Feature-Guided Dynamic Code Graph Construction and Retrieval for Repository-Level Code Generationcited by 0