mlsanityData to 7 Oct 2026

LazyAgent: Demand-Driven Materialization and Physical Optimization of Agentic Programs

arXiv 2609.23058 ↗First posted 19 Sep 2026cs.AIcited by 0

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Current agent runtimes that plan before acting generally execute a step once it becomes ready. We present LazyAgent, a unified execution framework for agent-authored programs organized around a live, goal-derived demanded set. LazyAgent refreshes a backward closure from requested outputs as execution state changes and materializes a ready node only when the active goal requires it. This replaces repeated local judgments with one linear-time graph analysis followed by constant-time membership tests, allowing programs to remain broad while execution stays request-specific. On programs that describe more than the current request needs, LazyAgent consistently outperforms the strongest goal-stopping eager baseline by refusing unrelated work before it starts. Adding one unrelated product raises the eager bill by 22.5% and LazyAgent's by 0.0%. LazyAgent saves 42.0% of measured CPU on production scientific workflows and 51.7% of container time on a live release gate spanning four repositories. We also prove and verify exact equivalence when the request reaches the whole graph, leaving no unrelated work to avoid. Beyond permission, goal-relative output projection saves up to approximately 90% of a shared step on two third-party test suites while the identical eager control saves 0.0%; the advantage disappears when the omitted output has no other consumer or the request needs it. Ordering, reuse, and pruning can also save cost, but do not replace permission. Finally, we show that current public benchmarks are eager-shaped and contain almost no unrequested work. A pre-registered planning intervention did not broaden them. These findings motivate benchmarks built from standing programs and sequences.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 17 of its 51 references that are in the map. First posted on arXiv 19 Sep 2026.

Builds on

17 of 51 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026Efficient LLM Serving for Agentic Workflows: A Data Systems Perspective17 Mar

Other references · 16

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  3. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  4. 2022Fast Inference from Transformers via Speculative Decodingcited by 1,615
  5. 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
  6. 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 633
  7. 2023Prompt Cache: Modular Attention Reuse for Low-Latency Inferencecited by 255
  8. 2023ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Modelscited by 174
  9. 2023An LLM Compiler for Parallel Function Callingcited by 170
  10. 2025Measuring what Matters: Construct Validity in Large Language Model Benchmarkscited by 102
  11. 2025DataSciBench: An LLM Agent Benchmark for Data Sciencecited by 53
  12. 2018Dissection of a Bug Dataset: Anatomy of 395 Patches from Defects4Jcited by 14
4 more
  1. 2021WfCommons: A Framework for Enabling Scientific Workflow Research and Developmentcited by 7
  2. 2026To Call or Not to Call: A Framework to Assess and Optimize LLM Tool Callingcited by 7
  3. 2026SimulCost: A Cost-Aware Benchmark and Toolkit for Automating Physics Simulations with LLMscited by 3
  4. 2026Cost-Aware Optimization for Agentic Query Executioncited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SkillEffect: Checked Lowering for Memory-Bounded Agent Tools
  2. 2026Agentic AI Workload Characteristics
  3. 2026A Policy-Driven Runtime Layer for Agentic LLM Serving
  4. 2026GraphBit: A Graph-based Agentic Framework for Non-Linear Agent Orchestration
  5. 2026Aethon: A Reference-Based Replication Primitive for Constant-Time Instantiation of Stateful AI Agents
  6. 2026TomasuLLM: Out-of-Order Speculative Execution for LLM Agents
  7. 2026Serving Agentic Workflows with a Physical-Plan Compiler and Adaptive Runtime
  8. 2026SAGA: Workflow-Atomic Scheduling for AI Agent Inference on GPU Clusters