mlsanityData to 14 Oct 2026

Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application

arXiv 2606.12191 ↗First posted 10 Jun 2026cs.CL cs.AIcited by 8

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Environments serve as interactive systems for large language model (LLM) based agents across diverse scenarios and play a crucial role in driving the continual evolution of model capabilities. Despite this importance, existing work lacks a systematic categorization and deep analysis. This paper systematically studies current researches on agentic environments from the perspective of the environment engineering lifecycle, covering their modeling, synthesis, evaluation and application. Specifically, the paper first introduces representative environments from the perspectives of eight attributes and eight domains, providing detailed analyses of their development paths and highlighting their core capabilities. Second, for automated environment synthesis, two paradigms are introduced, such as symbolic synthesis and neural synthesis. This paper also shows different environment evaluation methods in each paradigm. Thirdly, the corresponding environment applications from the perspective of agent-environment co-evolution are discussed. In specific, the paper characterizes the primary pathways for agent evolution in dynamic environments from four complementary perspectives: memory-centric experience evolution, orchestration-centric workflow evolution, trajectory-centric offline evolution, and exploration-centric online evolution. And three paradigms of environment evolution are identified, namely neural-driven, difficulty-driven, and scaling-driven approaches. At last, several promising future directions are discussed, including Environment-as-a-Service, Multi-agent Environments, and Neural-Symbolic Environments.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 412 of its 582 references that are in the map. First posted on arXiv 10 Jun 2026.

Builds on

412 of 582 references.

Closest ancestors · 52

Same direction, newest first

  1. 2026Claw-Eval: Towards Trustworthy Evaluation of Autonomous Agents7 Apr
  2. 2026ClawArena: Benchmarking AI Agents in Evolving Information Environments5 Apr
  3. 2026LOGIGEN: Logic-Driven Generation of Verifiable Agentic Tasks28 Feb
  4. 2026MagicAgent: Towards Generalized Agent Planning22 Feb
  5. 2026Agent World Model: Infinity Synthetic Environments for Agentic Reinforcement Learning10 Feb
  6. 2026WideSeek-R1: Exploring Width Scaling for Broad Information Seeking via Multi-Agent Reinforcement Learning4 Feb
  7. 2026AOrchestra: Automating Sub-Agent Creation for Agentic Orchestration3 Feb
  8. 2026IntentRL: Training Proactive User-intent Agents for Open-ended Deep Research via Reinforcement Learning3 Feb
  9. 2026LongCat-Flash-Thinking-2601 Technical Report23 Jan
  10. 2026Computer Environments Elicit General Agentic Intelligence in LLMs22 Jan
  11. 2026Toward Efficient Agents: Memory, Tool learning, and Planning20 Jan
  12. 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents18 Jan
38 more
  1. 2026AgencyBench: Benchmarking the Frontiers of Autonomous Agents in 1M-Token Real-World Contexts16 Jan
  2. 2026ACE-Router: Generalizing History-Aware Routing from MCP Tools to the Agent Web13 Jan
  3. 2025CASCADE: Cumulative Agentic Skill Creation through Autonomous Development and Evolution29 Dec
  4. 2025Agent2World: Learning to Generate Symbolic World Models via Adaptive Multi-Agent Feedback26 Dec
  5. 2025GenEnv: Difficulty-Aligned Co-Evolution Between LLM Agents and Environment Simulators22 Dec
  6. 2025Adaptation of Agentic AI: A Survey of Post-Training, Memory, and Skills18 Dec
  7. 2025Grammar Search for Multi-Agent Systems16 Dec
  8. 2025AgentEvolver: Towards Efficient Self-Evolving Agent System13 Nov
  9. 2025FLEX: Continuous Agent Evolution via Forward Learning from Experience9 Nov
  10. 2025Real-Time Reasoning Agents in Evolving Environments7 Nov
  11. 2025TPS-Bench: Evaluating AI Agents' Tool Planning & Scheduling Abilities in Compounding Tasks3 Nov
  12. 2025AgentFrontier: Expanding the Capability Frontier of LLM Agents with ZPD-Guided Data Synthesis28 Oct
  13. 2025DeepAgent: A General Reasoning Agent with Scalable Toolsets24 Oct
  14. 2025R-WoM: Retrieval-augmented World Model For Computer-use Agents13 Oct
  15. 2025Learning on the Job: An Experience-Driven Self-Evolving Agent for Long-Horizon Tasks9 Oct
  16. 2025Scaling Synthetic Task Generation for Agents via Exploration29 Sep
  17. 2025ARE: Scaling Up Agent Environments and Evaluations21 Sep
  18. 2025Towards General Agentic Intelligence via Environment Scaling16 Sep
  19. 2025Scaling Agents via Continual Pre-training16 Sep
  20. 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems10 Aug
  21. 2025Chain-of-Agents: End-to-End Agent Foundation Models via Multi-Agent Distillation and Agentic RL6 Aug
  22. 2025General Agentic Planning Through Simulative Reasoning with World Models31 Jul
  23. 2025UserBench: An Interactive Gym Environment for User-Centric Agents29 Jul
  24. 2025AgentSynth: Scalable Task Generation for Generalist Computer-Use Agents17 Jun
  25. 2025TaskCraft: Automated Generation of Agentic Tasks11 Jun
  26. 2025World Modelling Improves Language Model Agents3 Jun
  27. 2025Self-Challenging Language Model Agents2 Jun
  28. 2025Dyna-Think: Synergizing Reasoning, Acting, and World Model Simulation in AI Agents31 May
  29. 2025OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automation29 May
  30. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agents29 May
  31. 2025Multi-Agent Collaboration via Evolving Orchestration26 May
  32. 2025APIGen-MT: Agentic Pipeline for Multi-Turn Data Generation via Simulated Agent-Human Interplay4 Apr
  33. 2025OctoTools: An Agentic Framework with Extensible Tools for Complex Reasoning16 Feb
  34. 2024CoPS: Empowering LLM Agents with Provable Cross-Task Experience Sharing22 Oct
  35. 2024AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generation1 Aug
  36. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun
  37. 2024AgentGym: Evolving Large Language Model-based Agents across Diverse Environments6 Jun
  38. 2024Embodied LLM Agents Learn to Cooperate in Organized Teams19 Mar

50 newest of 52 All 52 (JSON)

Other references · 360

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2025Qwen3 Technical Reportcited by 8,820
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  6. 2021Program Synthesis with Large Language Modelscited by 3,637
  7. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  8. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  9. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  10. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  11. 2016OpenAI Gymcited by 1,736
  12. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
38 more
  1. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  2. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  3. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
  4. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  5. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
  6. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
  7. 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 610
  8. 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
  9. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
  10. 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 501
  11. 2026Kimi K2.5: Visual Agentic Intelligencecited by 501
  12. 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 497
  13. 2026World Action Models are Zero-shot Policiescited by 465
  14. 2024Agentless: Demystifying LLM-based Software Engineering Agentscited by 421
  15. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 407
  16. 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Casescited by 393
  17. 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 392
  18. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 386
  19. 2025RAGEN: Understanding Self-Evolution in LLM Agents via Multi-Turn Reinforcement Learningcited by 386
  20. 2024Agent Workflow Memorycited by 383
  21. 2024Measuring short-form factuality in large language modelscited by 373
  22. 2025ToolRL: Reward is All Tool Learning Needscited by 362
  23. 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 344
  24. 2025R1-Searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learningcited by 336
  25. 2023Minigrid & Miniworld: Modular & Customizable Reinforcement Learning Environments for Goal-Oriented Taskscited by 327
  26. 2026Causal World Modeling for Robot Controlcited by 321
  27. 2023Android in the Wild: A Large-Scale Dataset for Android Device Controlcited by 319
  28. 2025Memory in the Age of AI Agentscited by 303
  29. 2024CRUXEval: A Benchmark for Code Reasoning, Understanding and Executioncited by 300
  30. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
  31. 2024Diffusion Models Are Real-Time Game Enginescited by 296
  32. 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 285
  33. 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 284
  34. 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 279
  35. 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learningcited by 278
  36. 2020Emergent Complexity and Zero-shot Transfer via Unsupervised Environment Designcited by 275
  37. 2024TextGrad: Automatic "Differentiation" via Textcited by 273
  38. 2025DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agentscited by 248

50 most cited of 360 All 360 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Test-Time Adaptation for LLM Agents via Environment Interaction
  2. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challenges
  3. 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence
  4. 2026Position: Agentic Evolution is the Path to Evolving LLMs
  5. 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms
  6. 2026EvoArena: Tracking Memory Evolution for Robust LLM Agents in Dynamic Environments
  7. 2023Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectives
  8. 2026HERA: Harness-Environment Co-Evolution for Reliable Agentic Abstention