mlsanityData to 14 Oct 2026

Self-Supervised Scaling of Terminal Environments for Scientific Domains

arXiv 2610.02710 ↗First posted 2 Oct 2026cs.SE cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Terminal agents are increasingly deployed beyond software engineering in science and other specialized domains. Constructing training environments requires executable reference behavior and a domain-specific verifier that distinguishes semantic correctness from superficially plausible artifacts. Authoring these components for each task requires repeated engineering and limits reuse. We introduce software-in-the-loop reconstruction, a self-supervised framework that obtains reference outputs and verification targets from existing software workflows, executable programs mapping structured inputs to outputs. For each workflow, we execute multiple input configurations and partition cases into public observations and hidden evaluations. Given the instruction, input schema, and public input--output observations, an agent constructs an editable program without access to the source workflow. The candidate is evaluated on hidden configurations against workflow outputs. A hierarchical verifier combines domain-specific semantic comparison, structural validity, and anti-shortcut checks, while public feedback supports iterative revision. The construction admits additional workflows and configurations without authoring a reference solution for each task. We instantiate SWR with 500 workflows and 46 software families across six domains. Across three attempts per task, Qwen3.8-Max solves 838 tasks and produces 1,422 verified trajectories, which we oversample to 3,000 reconstruction-only training examples. Supervised fine-tuning of Qwen3.8-27B improves mean Terminal-Bench 2 performance from 47.94% to 53.56% across three seeds and achieves the highest mean among four matched-token corpus controls on all four reported evaluations. These results indicate that existing scientific software can provide scalable, behaviorally verified supervision for terminal agents.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 32 of its 41 references that are in the map. First posted on arXiv 2 Oct 2026.

Builds on

32 of 41 references.

References · 32

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  3. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  4. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  5. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  6. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
  7. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  8. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  9. 2018World Modelscited by 1,513
  10. 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,353
  11. 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
  12. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
20 more
  1. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
  2. 2023GAIA: a benchmark for General AI Assistantscited by 1,128
  3. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
  4. 2021Measuring Coding Challenge Competence With APPScited by 902
  5. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
  6. 2022CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learningcited by 358
  7. 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 336
  8. 2023InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedbackcited by 238
  9. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 205
  10. 2016DeepCoder: Learning to Write Programscited by 149
  11. 2017RobustFill: Neural Program Learning under Noisy I/Ocited by 126
  12. 2015Neural Programmer-Interpreterscited by 101
  13. 2020Metamorphic Testing: A New Approach for Generating Next Test Casescited by 75
  14. 2026On Data Engineering for Scaling LLM Terminal Capabilitiescited by 43
  15. 2026Tmax: A simple recipe for terminal agentscited by 33
  16. 2026SETA: Scaling Environments for Terminal Agentscited by 12
  17. 2026OpenThoughts-Agent: Data Recipes for Agentic Modelscited by 11
  18. 2026LiteCoder-Terminal: Scaling Long-Horizon Terminal Environments for Learning Language Agentscited by 8
  19. 2026Trust the Right Teacher: Quality-Aware Self-Distillation for GUI Groundingcited by 4
  20. 2026Terminal Agents: A Survey of AI Agents in Command-Line Environmentscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.