Agent-Editing World Model: Rethinking World Modeling for LLM Agents
On the map: World models → World models for language agents
also in 2 more
Abstract (arXiv)
Recent advances in large language models (LLMs) have enabled agents to tackle long-horizon tasks across diverse environments. To further improve agent performance, existing language world models typically predict environment observations, yet reconstructing high-entropy, execution-dependent tool responses offers limited value when real feedback is available. Meanwhile, agents suffer from task-state contamination, where unsupported assumptions and outdated plans persist in history and distort subsequent decisions. We propose the Agent-Editing World Model (AEWM), which models how reasoning and actions shape future task progress rather than simulating tool responses. AEWM combines Action Judge to distinguish textscCritical, textscExploratory, and textscNoisy decisions with State Revision to edit noisy reasoning--action continuations from the same observed history. EditAct integrates these capabilities with real execution, directly changing the state underlying subsequent decisions rather than merely providing critiques. We train AEWM across Search, Terminal, and Software Engineering through mid-training and supervised fine-tuning. AEWM achieves 70.5% macro-F1 on our Action Judge benchmark, exceeding the strongest frontier baseline by 10.6 points. Across six benchmarks and three agent backbones, EditAct improves average scores by 3.2--6.7 points over the strongest baseline. Furthermore, rejection sampling fine-tuning on verified EditAct trajectories, termed AEWM-RFT, improves over Self-RFT by 2.2--2.6 points across three domains without online AEWM guidance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 32 of its 59 references that are in the map. First posted on arXiv 23 Sep 2026.
Builds on
32 of 59 references.
Closest ancestors · 10
Same direction, newest first
- 2026Discriminative World Models for Web Agents2 Sep
- 2026Qwen-AgentWorld: Language World Models for General Agents23 Jun
- 2026ECHO: Terminal Agents Learn World Models for Free23 May
- 2026World-Model-Augmented Web Agents with Action Correction17 Feb
- 2026WebWorld: A Large-Scale World Model for Web Agent Training16 Feb
- 2026Agent World Model: Infinity Synthetic Environments for Agentic Reinforcement Learning10 Feb
- 2026Reinforcement World Model Learning for LLM-based Agents5 Feb
- 2025Agent2World: Learning to Generate Symbolic World Models via Adaptive Multi-Agent Feedback26 Dec
- 2025CWM: An Open-Weights LLM for Research on Code Generation with World Models30 Sep
- 2025World Modelling Improves Language Model Agents3 Jun
Other references · 22
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 502
- 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 254
- 2025ZeroSearch: Incentivize the Search Capability of LLMs without Searchingcited by 203
- 2025Agent-R: Training Language Model Agents to Reflect via Iterative Self-Trainingcited by 74
- 2025NL2Repo-Bench: Towards Long-Horizon Repository Generation Evaluation of Coding Agentscited by 56
- 2023Introduction to Latent Variable Energy-Based Models: A Path Towards Autonomous Machine Intelligencecited by 52
- 2025Simulating Environments with Reasoning Models for Agent Trainingcited by 52
10 more
- 2026DeepSearchQA: Bridging the Comprehensiveness Gap for Deep Research Agentscited by 44
- 2026SWE-World: Building Software Engineering Agents in Docker-Free Environmentscited by 21
- 2026Immersion in the GitHub Universe: Scaling Coding Agents to Masterycited by 20
- 2026BeyondSWE: Can Current Code Agent Survive Beyond Single-Repo Bug Fixing?cited by 20
- 2026SWE-Master: Unleashing the Potential of Software Engineering Agents via Post-Trainingcited by 18
- 2026Toward Autonomous Long-Horizon Engineering for ML Researchcited by 15
- 2026ClawGym: A Scalable Framework for Building Effective Claw Agentscited by 11
- 2026DeNovoSWE: Scaling Long-Horizon Environments for Generating Entire Repositories from Scratchcited by 6
- 2026SRR-Judge: Step-Level Rating and Refinement for Enhancing Search-Integrated Reasoning in Search Agentscited by 5
- 2026CalibForge: Adversarial Solver Calibration for Scaling Learnable Terminal Taskscited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Bridging the Agent-World Gap: Text World Models for LLM-based Agents
- 2025R-WoM: Retrieval-augmented World Model For Computer-use Agents
- 2026AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real-World Environments
- 2026From Task Solving to Robust Real-World Adaptation in LLM Agents
- 2026Self-Evolving World Models for LLM Agent Planning
- 2026PatchWorld: Gradient-Free Optimization of Executable World Models for Agent Environments
- 2026AgentAbstain: Do LLM Agents Know When Not to Act?
- 2025From Word to World: Can Large Language Models be Implicit Text-based World Models?