Socratic-SWE: Self-Evolving Coding Agents via Trace-Derived Agent Skills
On the map: LLM agents and tool use → Software engineering coding agents
also in 1 more
Abstract (arXiv)
LLM-driven software engineering agents have become a central testbed for real-world language-model capability, yet their training remains limited by the availability of high-quality SWE tasks. Existing synthetic data methods typically create tasks through fixed mutation or bug-injection procedures, making the resulting distributions largely independent of the agent's own weaknesses and training progress. We introduce Socratic-SWE, a closed-loop self-evolution framework that reuses the agent's historical solving traces as a source of training signal. Rather than treating traces only as evidence for reward computation, Socratic-SWE distills them into structured agent skills that summarize recurring failures and effective repair patterns. These skills then guide the generation of targeted repair tasks in real repositories. Candidate tasks are checked through execution-based validation and scored with a solver-gradient alignment reward, so that the retained tasks are both verifiable and useful for improving the Solver. The updated Solver produces new traces, enabling the task curriculum to adapt over successive rounds. Across SWE-bench Verified, SWE-bench Lite, SWE-bench Pro, and Terminal-Bench 2.0, Socratic-SWE consistently improves over self-evolving baselines under the same compute budget, reaching 50.40% on SWE-bench Verified after three iterations. These results suggest that solving traces can serve as a scalable substrate for self-evolving SWE agents.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 29 of its 35 references that are in the map. First posted on arXiv 5 Jun 2026.
Builds on
29 of 35 references.
Closest ancestors · 6
Same direction, newest first
- 2026BeyondSWE: Can Current Code Agent Survive Beyond Single-Repo Bug Fixing?3 Mar
- 2025Toward Training Superintelligent Software Agents through Self-Play SWE-RL21 Dec
- 2025SWE-smith: Scaling Data for Software Engineering Agents30 Apr
- 2024Training Software Engineering Agents and Verifiers with SWE-Gym30 Dec
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
Other references · 23
- 2023Let's Verify Step by Stepcited by 3,789
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2025Group Sequence Policy Optimizationcited by 835
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
- 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 497
- 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 344
- 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learningcited by 278
- 2025TTRL: Test-Time Reinforcement Learningcited by 275
- 2025SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolutioncited by 263
- 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 228
- 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 193
11 more
- 2025Agentic Reinforced Policy Optimizationcited by 172
- 2025SPIRAL: Self-Play on Zero-Sum Games Incentivizes Reasoning via Multi-Agent Multi-Turn Reinforcement Learningcited by 100
- 2025Soft Adaptive Policy Optimizationcited by 96
- 2025SPICE: Self-Play In Corpus Environments Improves Reasoningcited by 83
- 2021Self-Supervised Bug Detection and Repaircited by 59
- 2025Agentic Reinforcement Learning with Implicit Step Rewardscited by 47
- 2025Socratic-Zero : Bootstrapping Reasoning via Data-Free Agent Co-evolutioncited by 27
- 2026OPUS: Towards Efficient and Principled Data Selection in Large Language Model Pre-training in Every Iterationcited by 21
- 2026Agentic Proposing: Enhancing Large Language Model Reasoning via Compositional Skill Synthesiscited by 12
- 2026GradAlign: Gradient-Aligned Data Selection for LLM Reinforcement Learningcited by 12
- 2026Optimsyn: Influence-Guided Rubrics Optimization for Synthetic Data Generationcited by 6
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loopscited by 35
- 2026The Last AI Built by Humans: Toward Genuine Recursive Self-Improvementcited by 11
- 2026FrogNano: Training a 4B Coding Agent via Online Task Synthesiscited by 4
- 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agentscited by 3
- 2026What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agentscited by 3
- 2026Self-Evolving Coding Agentscited by 2
- 2026Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Designcited by 1
- 2026Where Is the Tradeoff in Using Third-Party API Routers for Agentic Software Development?cited by 0
- 2026How Much Evidence Should a Coding Agent's Self-Correction Carry? Adaptive Dirichlet Evidence for Self-Distillationcited by 0
- 2026How Much Evidence Should a Coding Agent's Self-Correction Carry? Adaptive Dirichlet Evidence for Self-Distillation6 Oct 2026
- 2026The Last AI Built by Humans: Toward Genuine Recursive Self-Improvement10 Sep 2026
- 2026FrogNano: Training a 4B Coding Agent via Online Task Synthesis7 Sep 2026
- 2026What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agents27 Aug 2026
- 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agents13 Aug 2026
- 2026Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Design10 Aug 2026
- 2026Self-Evolving Coding Agents4 Aug 2026
- 2026Where Is the Tradeoff in Using Third-Party API Routers for Agentic Software Development?26 Jul 2026
- 2026Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loops8 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2025Training Versatile Coding Agents in Synthetic Environments
- 2025Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?
- 2025Kimi-Dev: Agentless Training as Skill Prior for SWE-Agents
- 2026Certified Long-Horizon Code Agent Evolution via Validation-Gated Skill Optimization
- 2026CODESKILL: Learning Self-Evolving Skills for Coding Agents
- 2025SEW: Self-Evolving Agentic Workflows for Automated Code Generation
- 2026Learning Globally Reusable Skills for Coding Agents
- 2026SWE-Master: Unleashing the Potential of Software Engineering Agents via Post-Training