mlsanityData to 14 Oct 2026

EnvHarness: Awakening Static Worlds for Agent Learning

arXiv 2608.19880 ↗First posted 20 Aug 2026cs.AI cs.CL cs.LGcited by 13

On the map: LLM agents and tool use → Reinforcement learning for LLM agents

Abstract (arXiv)

LLM agents learn by interacting with environments, yet these environments are hand-built and static: blind to an agent's weaknesses, and quickly left behind as it improves. While recent environment generation methods attempt to address this, they require domain-specific pipelines, rely on expensive or unreliable verifiers, and still produce static environments. To alleviate the engineering burden of rebuilding environments from scratch, we propose Environment Harness (EnvHarness), a programmable layer of plug-in components that wraps a static environment to reshape its behavior without modifying the underlying logic. Operating through standard interfaces, EnvHarness applies across diverse domains while ensuring every reshaped environment retains its original verifier. To automate this process, we introduce EnvRigger, which treats the target policy as a black box, observing its execution trajectories to synthesize EnvHarness components targeting diagnosed flaws, and validating them via fresh rollouts. Across five benchmarks in four domains, EnvHarness outperforms both original environments and domain-specific environment generation pipelines, achieving up to a 9.0-point improvement on held-out instances with 9.8% fewer execution steps. Furthermore, EnvHarness provides a superior optimization signal for reinforcement learning, enabling continuous, targeted co-evolution of the policy and its environment.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in Reinforcement learning for LLM agents, one of 16 directions in LLM agents and tool use. Builds on 51 of its 62 references that are in the map. First posted on arXiv 20 Aug 2026.

Builds on

51 of 62 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Don't Just Fine-tune the Agent, Tune the Environment11 Oct
  2. 2024EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents18 Mar
  3. 2023Voyager: An Open-Ended Embodied Agent with Large Language Models25 May
  4. 2023Reflexion: Language Agents with Verbal Reinforcement Learning20 Mar

Other references · 47

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  5. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  6. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
  7. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  8. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
  9. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
  10. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
  11. 2024Self-Rewarding Language Modelscited by 681
  12. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
35 more
  1. 2024Agent Workflow Memorycited by 383
  2. 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 353
  3. 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 344
  4. 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 336
  5. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
  6. 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 285
  7. 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 284
  8. 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learningcited by 278
  9. 2020Emergent Complexity and Zero-shot Transfer via Unsupervised Environment Designcited by 275
  10. 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 228
  11. 2020Prioritized Level Replaycited by 198
  12. 2019Paired Open-Ended Trailblazer (POET): Endlessly Generating Increasingly Complex and Diverse Learning Environments and Their Solutionscited by 192
  13. 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systemscited by 183
  14. 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 148
  15. 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 111
  16. 2025Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoningcited by 75
  17. 2026Agent World Model: Infinity Synthetic Environments for Agentic Reinforcement Learningcited by 66
  18. 2026EnvScaler: Scaling Tool-Interactive Environments for LLM Agent via Programmatic Synthesiscited by 63
  19. 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligencecited by 54
  20. 2025VisPlay: Self-Evolving Vision-Language Models from Imagescited by 47
  21. 2025GenEnv: Difficulty-Aligned Co-Evolution Between LLM Agents and Environment Simulatorscited by 42
  22. 2026MetaClaw: Just Talk -- An Agent That Meta-Learns and Evolves in the Wildcited by 37
  23. 2025InSTA: Towards Internet-Scale Training For Agentscited by 32
  24. 2026Qwen-AgentWorld: Language World Models for General Agentscited by 28
  25. 2026SWE-World: Building Software Engineering Agents in Docker-Free Environmentscited by 25
  26. 2026From Raw Experience to Skill Consumption: A Systematic Study of Model-Generated Agent Skillscited by 22
  27. 2024Refining Minimax Regret for Unsupervised Environment Designcited by 18
  28. 2025LLMs as Scalable, General-Purpose Simulators For Evolving Digital Agent Trainingcited by 18
  29. 2026G-Zero: Self-Play for Open-Ended Generation from Zero Datacited by 17
  30. 2025Environment Scaling for Interactive Agentic Experience Collection: A Surveycited by 13
  31. 2026SEAL: Synergistic Co-Evolution of Agents and Learning Environmentscited by 12
  32. 2026SPADE: Self-Play in Adaptive Synthetic Executable Environmentscited by 12
  33. 2026Safe and Scalable Web Agent Learning via Recreated Websitescited by 11
  34. 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
  35. 2026Simulate to Generalize: Scaling Stateful Supervision for API-calling Agents using LLM World Modelscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 13.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026MemoHarness: Agent Harnesses That Learn from Experience
  2. 2026EnvCraft: Synthesizing Executable Environments in Agentic RL for Claw-like Agent
  3. 2026EvoHarness-RL: Learning Self-Evolving Runtime Harness for Long-Horizon LLM Agents
  4. 2026Adapting the Interface, Not the Model: Runtime Harness Adaptation for Deterministic LLM Agents
  5. 2026EnvFactory: Scaling Tool-Use Agents via Executable Environments Synthesis and Robust RL
  6. 2026EnvACE: Internalizing Environment Dynamics via World Rehearsal for Agentic Reinforcement Learning
  7. 2026EnvRL: Learn from Environment Dynamics in Agentic Reinforcement Learning
  8. 2026Harness-Zero: Harness Distillation via Agent-as-Harness