Self-Supervised Scaling of Terminal Environments for Scientific Domains
Not on the map. Why?
Abstract (arXiv)
Terminal agents are increasingly deployed beyond software engineering in science and other specialized domains. Constructing training environments requires executable reference behavior and a domain-specific verifier that distinguishes semantic correctness from superficially plausible artifacts. Authoring these components for each task requires repeated engineering and limits reuse. We introduce software-in-the-loop reconstruction, a self-supervised framework that obtains reference outputs and verification targets from existing software workflows, executable programs mapping structured inputs to outputs. For each workflow, we execute multiple input configurations and partition cases into public observations and hidden evaluations. Given the instruction, input schema, and public input--output observations, an agent constructs an editable program without access to the source workflow. The candidate is evaluated on hidden configurations against workflow outputs. A hierarchical verifier combines domain-specific semantic comparison, structural validity, and anti-shortcut checks, while public feedback supports iterative revision. The construction admits additional workflows and configurations without authoring a reference solution for each task. We instantiate SWR with 500 workflows and 46 software families across six domains. Across three attempts per task, Qwen3.8-Max solves 838 tasks and produces 1,422 verified trajectories, which we oversample to 3,000 reconstruction-only training examples. Supervised fine-tuning of Qwen3.8-27B improves mean Terminal-Bench 2 performance from 47.94% to 53.56% across three seeds and achieves the highest mean among four matched-token corpus controls on all four reported evaluations. These results indicate that existing scientific software can provide scalable, behaviorally verified supervision for terminal agents.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 32 of its 41 references that are in the map. First posted on arXiv 2 Oct 2026.
Builds on
32 of 41 references.
References · 32
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
- 2018World Modelscited by 1,513
- 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,353
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
20 more
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
- 2023GAIA: a benchmark for General AI Assistantscited by 1,128
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
- 2021Measuring Coding Challenge Competence With APPScited by 902
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
- 2022CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learningcited by 358
- 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 336
- 2023InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedbackcited by 238
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 205
- 2016DeepCoder: Learning to Write Programscited by 149
- 2017RobustFill: Neural Program Learning under Noisy I/Ocited by 126
- 2015Neural Programmer-Interpreterscited by 101
- 2020Metamorphic Testing: A New Approach for Generating Next Test Casescited by 75
- 2026On Data Engineering for Scaling LLM Terminal Capabilitiescited by 43
- 2026Tmax: A simple recipe for terminal agentscited by 33
- 2026SETA: Scaling Environments for Terminal Agentscited by 12
- 2026OpenThoughts-Agent: Data Recipes for Agentic Modelscited by 11
- 2026LiteCoder-Terminal: Scaling Long-Horizon Terminal Environments for Learning Language Agentscited by 8
- 2026Trust the Right Teacher: Quality-Aware Self-Distillation for GUI Groundingcited by 4
- 2026Terminal Agents: A Survey of AI Agents in Command-Line Environmentscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.