mlsanityData to 7 Oct 2026

SWE-Synth: Synthesizing Verifiable Bug-Fix Data to Enable Large Language Models in Resolving Real-World Bugs

arXiv 2504.14757 ↗First posted 20 Apr 2025cs.SE cs.AIcited by 22

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are transforming automated program repair (APR) through agent-based approaches that localize bugs, generate patches, and verify fixes. However, the lack of high-quality, scalable training datasets, especially those with verifiable outputs and intermediate reasoning traces-limits progress, particularly for open-source models. In this work, we present SWE-Synth, a framework for synthesizing realistic, verifiable, and process-aware bug-fix datasets at the repository level. SWE-Synth leverages LLM agents to simulate debugging workflows, producing not only bug-fix pairs but also test cases and structured repair trajectories. Compared to manually curated datasets, our method scales with minimal human effort while preserving contextual richness and correctness. Experiments show that models trained on SWE-Synth outperform those trained on real-world datasets by 2.3% on SWE-Bench Lite. Our results highlight the potential of synthetic, agent-generated data to advance the state of the art in APR and software engineering automation.

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 74 of its 105 references that are in the map. First posted on arXiv 20 Apr 2025.

Builds on

74 of 105 references.

References · 74

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  4. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  5. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  6. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  7. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  8. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  9. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  10. 2022Competition-Level Code Generation with AlphaCodecited by 1,427
  11. 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,116
  12. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
38 more
  1. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 895
  2. 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 728
  3. 2023Instruction Tuning with GPT-4cited by 676
  4. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 655
  5. 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 527
  6. 2024Agentless: Demystifying LLM-based Software Engineering Agentscited by 400
  7. 2022CodeT: Code Generation with Generated Testscited by 369
  8. 2022CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learningcited by 342
  9. 2023CodeT5+: Open Code Large Language Models for Code Understanding and Generationcited by 327
  10. 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 300
  11. 2024AutoCodeRover: Autonomous Program Improvementcited by 272
  12. 2023Magicoder: Empowering Code Generation with OSS-Instructcited by 251
  13. 2025SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolutioncited by 246
  14. 2023LongLoRA: Efficient Fine-tuning of Long-Context Large Language Modelscited by 243
  15. 2024On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Surveycited by 240
  16. 2024RepairAgent: An Autonomous, LLM-Based Agent for Program Repaircited by 225
  17. 2024ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RLcited by 212
  18. 2022Is GPT-3 a Good Data Annotator?cited by 208
  19. 2024Advancing LLM Reasoning Generalists with Preference Treescited by 191
  20. 2023OctoPack: Instruction Tuning Code Large Language Modelscited by 178
  21. 2024Large Language Model-Based Agents for Software Engineering: A Surveycited by 173
  22. 2023Does Synthetic Data Generation of LLMs Help Clinical Text Mining?cited by 151
  23. 2023Self-Alignment with Instruction Backtranslationcited by 149
  24. 2022Practical Program Repair in the Era of Large Pre-trained Language Modelscited by 133
  25. 2024SWE-Search: Enhancing Software Agents with Monte Carlo Tree Search and Iterative Refinementcited by 124
  26. 2024AgentGym: Evolving Large Language Model-based Agents across Diverse Environmentscited by 120
  27. 2025KodCode: A Diverse, Challenging, and Verifiable Synthetic Dataset for Codingcited by 115
  28. 2023Jina Embeddings 2: 8192-Token General-Purpose Text Embeddings for Long Documentscited by 103
  29. 2024Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineeringcited by 100
  30. 2024SWE-Bench+: Enhanced Coding Benchmark for LLMscited by 95
  31. 2023Algorithm of Thoughts: Enhancing Exploration of Ideas in Large Language Modelscited by 92
  32. 2025ACECODER: Acing Coder RL via Automated Test-Case Synthesiscited by 89
  33. 2025SWE-Fixer: Training Open-Source LLMs for Effective and Efficient GitHub Issue Resolutioncited by 87
  34. 2021Improving Question Answering Model Robustness with Synthetic Adversarial Data Generationcited by 77
  35. 2022Less Training, More Repairing Please: Revisiting Automated Program Repair via Zero-shot Learningcited by 76
  36. 2024MathGenie: Generating Synthetic Data with Question Back-translation for Enhancing Mathematical Reasoning of LLMscited by 72
  37. 2023Large Language Models for Test-Free Fault Localizationcited by 67
  38. 2024HyperAgent: Generalist Software Engineering Agents to Solve Coding Tasks at Scalecited by 61

50 most cited of 74 All 74 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 8; 2026: 14.

22 papers.

Sort:

By area:

  1. 2025SWE-Exp: Experience-Driven Software Issue Resolutioncited by 64
  2. 2025SWE-EVO: Benchmarking Coding Agents in Long-Horizon Software Evolution Scenarioscited by 49
  3. 2026ProgramBench: Can Language Models Rebuild Programs From Scratch?cited by 47
  4. 2026Building Effective AI Coding Agents for the Terminal: Scaffolding, Harness, Context Engineering, and Lessons Learnedcited by 18
  5. 2025SWE-Dev: Evaluating and Training Autonomous Feature-Driven Software Developmentcited by 13
  6. 2026SERA: Soft-Verified Efficient Repository Agentscited by 10
  7. 2025SWE-Factory: Your Automated Factory for Issue Resolution Training Data and Evaluation Benchmarkscited by 6
  8. 2025Agentic Software Issue Resolution with Large Language Models: A Surveycited by 6
  9. 2026From SWE-ZERO to SWE-HERO: Execution-free to Execution-based Fine-tuning for Software Engineering Agentscited by 5
  10. 2025When Names Disappear: Revealing What LLMs Actually Understand About Codecited by 4
  11. 2026SWE-Hub: A Unified Production System for Scalable, Executable Software Engineering Taskscited by 4
  12. 2026SWE-Shepherd: Advancing PRMs for Reinforcing Code Agentscited by 4
10 more
  1. 2025Matrix: Peer-to-Peer Multi-Agent Synthetic Data Generation Frameworkcited by 3
  2. 2026MEnvAgent: Scalable Polyglot Environment Construction for Verifiable Software Engineeringcited by 3
  3. 2026BenchEvolver: Frontier Task Synthesis via Solution-Centric Evolutioncited by 3
  4. 2026Loc2Repair: A Framework for Evaluating the Impact of File-Level Issue Localization in Repo-Level LLM Repaircited by 3
  5. 2026Agentic Coding Needs Proactivity, Not Just Autonomycited by 2
  6. 2026Pull Requests as a Training Signal for Repo-Level Code Editingcited by 1
  7. 2026Anchored Self-Play for Code Repaircited by 1
  8. 2025PIPer: On-Device Environment Setup via Online Reinforcement Learningcited by 0
  9. 2026Beyond Text-to-SQL: Can LLMs Really Debug Enterprise ETL SQL?cited by 0
  10. 2026SWE-Journey: Towards More Realistic Evaluation of Coding Assistants through Long-Horizon, Multi-Turn Interactioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024An Empirical Study on LLM-based Agents for Automated Bug Fixing
  2. 2025REFINE: Enhancing Program Repair Agents through Context-Aware Patch Refinement
  3. 2026SelfHeal: Empirical Fix Pattern Analysis and Bug Repair in LLM Agents
  4. 2026SWE-CI: Evaluating Agent Capabilities in Maintaining Codebases via Continuous Integration
  5. 2026Multi-Perspective Agentic Program Repair via Code Property Graphs and Temporal Execution Graphs
  6. 2025Understanding Automated Program Repair Agents Through the Lens of Traceability: An Empirical Study
  7. 2026Active-SWE: Benchmarking Coding Agents for Proactive Bug Fixing without Issue Reports
  8. 2026Refine After Generation: Toward Correct and Concise Patches in LLM-based Program Repair