Collaborative Agents for Automated Program Repair in Ruby
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Automated Program Repair (APR) has advanced rapidly with Large Language Models (LLMs), but most existing methods remain computationally expensive, and focused on a small set of languages. Ruby, despite its widespread use in web development and the persistent challenges faced by its developers, has received little attention in APR research. In this paper, we introduce RAMP, a novel lightweight framework that formulates program repair as a feedback-driven, iterative process for Ruby. RAMP employs a team of collaborative agents that generate targeted tests, reflect on errors, and refine candidate fixes until a correct solution is found. Unlike prior approaches, RAMP is designed to avoid reliance on large multilingual repair databases or costly fine-tuning, instead operating directly on Ruby through lightweight prompting and test-driven feedback. Evaluation on the XCodeEval benchmark shows that RAMP achieves a pass@1 of 67% on Ruby, outper-forming prior approaches. RAMP converges quickly within five iterations, and ablation studies confirm that test generation and self-reflection are key drivers of its performance. Further analysis shows that RAMP is particularly effective at repairing wrong answers, compilation errors, and runtime errors. Our approach provides new insights into multi-agent repair strategies, and establishes a foundation for extending LLM-based debugging tools to under-studied languages.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 39 of its 63 references that are in the map. First posted on arXiv 6 Nov 2025.
Builds on
39 of 63 references.
Closest ancestors · 7
Same direction, newest first
- 2025Agent That Debugs: Dynamic State-Guided Vulnerability Repair10 Apr
- 2024SWE-Search: Enhancing Software Agents with Monte Carlo Tree Search and Iterative Refinement26 Oct
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
- 2024MapCoder: Multi-Agent Code Generation for Competitive Problem Solving18 May
- 2024UniDebugger: Hierarchical Multi-Agent Framework for Unified Software Debugging26 Apr
- 2024MAGIS: LLM-Based Multi-Agent Framework for GitHub Issue Resolution26 Mar
- 2023Self-collaboration Code Generation via ChatGPT15 Apr
Other references · 32
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,181
- 2025SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolutioncited by 263
- 2019SPoC: Search-based Pseudocode to Codecited by 176
- 2023Structured Chain-of-Thought Prompting for Code Generationcited by 138
- 2023Keep the Conversation Going: Fixing 162 out of 337 bugs for 0.42 each using ChatGPTcited by 125
- 2023InferFix: End-to-End Program Repair with LLMscited by 114
- 2025Learn-by-interact: A Data-Centric Framework for Self-Adaptive Agents in Realistic Environmentscited by 95
- 2023Is ChatGPT the Ultimate Programming Assistant -- How far is it?cited by 76
- 2024Code Repair with LLMs gives an Exploration-Exploitation Tradeoffcited by 51
- 2023RepairLLaMA: Efficient Representations and Fine-Tuned Adapters for Program Repaircited by 50
- 2023xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrievalcited by 47
20 more
- 2023What Makes Good In-context Demonstrations for Code Intelligence Tasks with LLMs?cited by 47
- 2023RAP-Gen: Retrieval-Augmented Patch Generation with CodeT5 for Automatic Program Repaircited by 44
- 2024Preference Optimization for Reasoning with Pseudo Feedbackcited by 39
- 2025Enhancing repository-level software repair via repository-aware knowledge graphscited by 27
- 2025A Survey of LLM-based Automated Program Repair: Taxonomies, Design Paradigms, and Applicationscited by 25
- 2023Domain Knowledge Matters: Improving Prompts with Fix Templates for Repairing Python Type Errorscited by 22
- 2024A Pair Programming Framework for Code Generation via Multi-Plan Exploration and Feedback-Driven Refinementcited by 21
- 2024ContrastRepair: Enhancing Conversation-Based Automated Program Repair via Contrastive Test Case Pairscited by 19
- 2024APPATCH: Automated Adaptive Prompting Large Language Models for Real-World Software Vulnerability Patchingcited by 19
- 2024RePair: Automated Program Repair with Process-based Feedbackcited by 16
- 2024CREF: An LLM-based Conversational Software Repair Framework for Programming Tutorscited by 15
- 2024When Large Language Models Confront Repository-Level Automatic Program Repair: How Well They Done?cited by 12
- 2024Aligning the Objective of LLM-based Program Repaircited by 12
- 2025Towards Effectively Leveraging Execution Traces for Program Repair with Code LLMscited by 11
- 2021SYNFIX: Automatically Fixing Syntax Errors using Compiler Diagnosticscited by 8
- 2024Enhancing Automated Program Repair with Solution Designcited by 8
- 2024Automated Program Repair: Emerging trends pose and expose problems for benchmarkscited by 7
- 2025Knowledge-Enhanced Program Repair for Data Science Codecited by 6
- 2025PredicateFix: Repairing Static Analysis Alerts with Bridging Predicatescited by 5
- 2025Unveiling Ruby: Insights from Stack Overflow and Developer Surveycited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Understanding Automated Program Repair Agents Through the Lens of Traceability: An Empirical Study
- 2025REFINE: Enhancing Program Repair Agents through Context-Aware Patch Refinement
- 2024An Empirical Evaluation of Pre-trained Large Language Models for Repairing Declarative Formal Specifications
- 2026Refine After Generation: Toward Correct and Concise Patches in LLM-based Program Repair
- 2025The Art of Repair: Optimizing Iterative Program Repair with Instruction-Tuned Models
- 2025FeedbackEval: A Benchmark for Evaluating Large Language Models in Feedback-Driven Code Repair Tasks
- 2026Kozuchi Agent: A Language-Agnostic Open-Weight Agent for Software Repair
- 2024RepairAgent: An Autonomous, LLM-Based Agent for Program Repair