mlsanityData to 14 Oct 2026

SWE-Prime: Fewer Trajectories, Better Performance

arXiv 2608.27449 ↗First posted 27 Aug 2026cs.SE cs.AI cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

To improve large language models' ability to resolve real-world software issues, prior work has focused on constructing large-scale agent trajectory datasets and performing supervised fine-tuning (SFT) on successful trajectories. However, task success does not guarantee high-quality supervision: successful trajectories may still contain ineffective, redundant, or risky steps. Directly using such trajectories for SFT can introduce noisy supervision and encourage models to imitate undesirable problem-solving behaviors. Therefore, we propose SWE-Prime, a multi-granularity, two-stage SFT data selection method that progressively filters training data at the trajectory and segment levels. Specifically, the first stage performs trajectory-level screening based on process quality, result quality, and data representativeness, selecting a high-quality and representative subset of successful trajectories. The second stage performs segment-level selection by grouping consecutive steps into semantic segments and assessing each segment based on its contribution to the final solution, learnability, and potential risks. During SFT, all segments remain in the sequence to preserve context, while only selected segments contribute to the loss computation. Experiments on SWE-Bench Pro and SWE-Bench Verified show that training on the 10% trajectory subset selected by SWE-Prime outperforms training on the full resolved dataset, yielding relative performance gains of up to 12.2% and 24.2%, respectively.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 26 of its 43 references that are in the map. First posted on arXiv 27 Aug 2026.

Builds on

26 of 43 references.

References · 26

  1. 2023Let's Verify Step by Stepcited by 3,789
  2. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  3. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  4. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
  5. 2022Solving math word problems with process- and outcome-based feedbackcited by 901
  6. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 467
  7. 2023What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuningcited by 364
  8. 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 336
  9. 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 285
  10. 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 279
  11. 2025R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agentscited by 158
  12. 2024MAGIS: LLM-Based Multi-Agent Framework for GitHub Issue Resolutioncited by 134
14 more
  1. 2025Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Studycited by 49
  2. 2025Reducing Cost of LLM Agents with Trajectory Reductioncited by 48
  3. 2025ATLaS: Agent Tuning via Learning Critical Stepscited by 31
  4. 2024HumanEvo: An Evolution-aware Benchmark for More Realistic Evaluation of Repository-level Code Generationcited by 28
  5. 2026SWE-Master: Unleashing the Potential of Software Engineering Agents via Post-Trainingcited by 22
  6. 2024Evaluating Software Development Agents: Patch Patterns, Code Quality, and Issue Complexity in Real-World GitHub Scenarioscited by 18
  7. 2025Training LLM-Based Agents with Synthetic Self-Reflected Trajectories and Partial Maskingcited by 17
  8. 2025Beyond Final Code: A Process-Oriented Error Analysis of Software Development Agents in Real-World GitHub Scenarioscited by 14
  9. 2025WebSTAR: Scalable Data Synthesis for Computer Use Agents with Step-Level Filteringcited by 11
  10. 2025Towards an Understanding of Context Utilization in Code Intelligencecited by 10
  11. 2026Advances and Frontiers of LLM-based Issue Resolution in Software Engineering: A Comprehensive Surveycited by 10
  12. 2026SERA: Soft-Verified Efficient Repository Agentscited by 10
  13. 2026SWE-Next: Scalable Real-World Software Engineering Tasks for Agentscited by 9
  14. 2026PhoenixRepair: Rethinking Repair Strategy Exploration in Software Agentscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.