SWE-Future: Forecast-Conditioned Data Synthesis for Future-Oriented Software Engineering Agents
On the map: LLM agents and tool use → Software engineering coding agents
also in 1 more
Abstract (arXiv)
Realistic coding-agent benchmarks often replay public GitHub issues and pull requests, making them vulnerable to overlap with model pretraining, fine-tuning, synthetic-data generation, or benchmark-driven model selection. Fully synthetic tasks avoid direct historical replay, but can drift away from real repository needs. We propose SWE-Future, a forecast-conditioned data synthesis method for future-oriented coding tasks. Given a forecast snapshot at time T0, the method uses only pre-T0 repository evidence to forecast future feature implementation/enhancement, bugfix, and refactor task families. We first validate this forecasting step retrospectively: after forecasts are fixed, later pull requests are used only to measure whether the predicted task families match future repository work. In an 80-repository study, the forecaster achieves 58.1% future-work relevance under the main semantic matching metric. We then use validated forecast families as conditioning signals to synthesize a 200-task coding-agent dataset across 61 repositories from a task-generation snapshot, rather than replaying the later pull requests used for validation. SWE-Future shows that repository-evolution forecasts can guide realistic, future-oriented coding-task synthesis while reducing direct dependence on historical pull-request replay.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 7 of its 14 references that are in the map. First posted on arXiv 17 Jun 2026.
Builds on
7 of 14 references.
Closest ancestors · 1
Same direction, newest first
Other references · 6
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2024Quantifying Contamination in Evaluating Code Generation Capabilities of Language Modelscited by 65
- 2025FEA-Bench: A Benchmark for Evaluating Repository-Level Code Generation for Feature Implementationcited by 58
- 2024On Leakage of Code Generation Evaluation Datasetscited by 32
- 2025SWE-Bench++: A Framework for the Scalable Generation of Software Engineering Benchmarks from Open-Source Repositoriescited by 28
- 2026ATime-Consistent Benchmark for Repository-Level Software Engineering Evaluationcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SWE-Next: Scalable Real-World Software Engineering Tasks for Agents
- 2026SWE-Stream: Scaling Executable Training Data for SWE Agents via Progressive Construction and Elastic Streaming
- 2026Beyond Isolated Tasks: A Framework for Evaluating Coding Agents on Sequential Software Evolution
- 2026Understanding by Reconstruction: Reversing the Software Development Process for LLM Pretraining
- 2026SWE-Replay: Efficient Test-Time Scaling for Software Engineering Agents
- 2025SWE-rebench: An Automated Pipeline for Task Collection and Decontaminated Evaluation of Software Engineering Agents
- 2026Socratic-SWE: Self-Evolving Coding Agents via Trace-Derived Agent Skills
- 2026SWE-Master: Unleashing the Potential of Software Engineering Agents via Post-Training