Revisable by Design: A Theory of Streaming LLM Agent Execution
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Current LLM agents operate under an implicit but universal assumption: execution is a transaction -- the user submits a request, the agent works in isolation, and only upon completion does the dialogue resume. This forces users into a binary choice: wait for a potentially incorrect output, or interrupt and lose all progress. We reject this assumption and propose the stream paradigm, in which agent execution and user intervention are concurrent, interleaved processes sharing a bidirectional channel. We formalize this paradigm through a reversibility taxonomy that classifies every agent action as Idempotent, Reversible, Compensable, or Irreversible, and arrive at a core conclusion: an agent's flexibility is bounded by its reversibility. We prove that conflicting compensable actions impose unavoidable adaptation costs and that conflicting irreversible actions make full specification satisfaction impossible -- these costs are properties of the action space, not of the algorithm. Guided by this insight, we present the Revision Absorber, a reactive algorithm based on the Earliest-Conflict Rollback rule that is structurally optimal under mild assumptions. Experiments on StreamBench with real LLM agents validate all predictions: the Absorber matches the quality of a brute-force full-restart baseline while wasting an order of magnitude fewer steps of already-completed work, turning mid-execution revisions from a dead-end into a first-class interaction.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 41 of its 69 references that are in the map. First posted on arXiv 25 Apr 2026.
Builds on
41 of 69 references.
Closest ancestors · 8
Same direction, newest first
- 2024Collaborative Gym: A Framework for Enabling and Evaluating Human-Agent Collaboration20 Dec
- 2023The Rise and Potential of Large Language Model Based Agents: A Survey14 Sep
- 2023Cognitive Architectures for Language Agents5 Sep
- 2023A Survey on Large Language Model based Autonomous Agents22 Aug
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors21 Aug
- 2023AgentBench: Evaluating LLMs as Agents7 Aug
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar
Other references · 33
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2017Deep reinforcement learning from human preferencescited by 3,912
21 more
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
- 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,141
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
- 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 560
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 556
- 2023Augmented Language Models: a Surveycited by 403
- 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 399
- 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Casescited by 393
- 2022PlanBench: An Extensible Benchmark for Evaluating Large Language Models on Planning and Reasoning about Changecited by 382
- 2025CowPilot: A Framework for Autonomous and Human-Agent Collaborative Web Navigationcited by 36
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Cost-Utility Alignment in LLM Agent Trajectories:Profiling,Attribution,Diagnosis,Adaptation,and Evaluationcited by 2
- 2026SpecPath: Testing Coding Agents Across Contract-Equivalent Specification Historiescited by 1
- 2026FinalityBench: An Effect-Level Benchmark for Agent Decisions Under Delayed and Conflicting Financial Finalitycited by 1
- 2026REVISE: Validity-Guided Recovery for Online Revisions in Agent Workflowscited by 0
- 2026When Tool Calls Succeed but Workflows Fail: Anomalies at the Agent-Tool Boundarycited by 0
- 2026When Tool Calls Succeed but Workflows Fail: Anomalies at the Agent-Tool Boundary14 Sep 2026
- 2026FinalityBench: An Effect-Level Benchmark for Agent Decisions Under Delayed and Conflicting Financial Finality4 Sep 2026
- 2026REVISE: Validity-Guided Recovery for Online Revisions in Agent Workflows1 Sep 2026
- 2026Cost-Utility Alignment in LLM Agent Trajectories:Profiling,Attribution,Diagnosis,Adaptation,and Evaluation25 Aug 2026
- 2026SpecPath: Testing Coding Agents Across Contract-Equivalent Specification Histories10 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026From Agent Loops to Structured Graphs:A Scheduler-Theoretic Framework for LLM Agent Execution
- 2026LLMs are General Asynchronous Agents
- 2026Auditing Action Settlement in LLM Agent Environments: Order, Progress, and Replay
- 2026Forgetting Without Restarting: Execution-State Unlearning for Stateful LLM Agents
- 2026The Replay Gap: Static Evaluation of Model Switching in LLM Agents Scores the Wrong World
- 2026Callability Is Not Operability: Controlled Interface Interventions for LLM Agents
- 2026From Approval to Execution: Reconstruction-Aware Repair Analysis for LLM-Agent Software
- 2026A Stackelberg Framework for Resource-Aware LLM Agents: Learning, Repair, and Conditional Guarantees