mlsanityData to 7 Oct 2026

Scoped Verification for Reliable Long-Horizon Agentic Context Evolution under Distribution Shift

arXiv 2607.09175 ↗First posted 10 Jul 2026cs.AI cs.CLcited by 1

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Deployed LLM agents rely on agentic context, the model-external textual control content assembled by an operational harness. In this work, the mutable component of that context is a persistent system-level instruction that is updated from operational experience while the model, tools, and harness remain fixed. Over long evolution horizons, flat-text maintenance makes verification increasingly difficult as accumulated instructions grow and interact. We propose Graph-Regularized Agentic Context Evolution (GRACE), which maintains the persistent instruction component as a typed semantic graph and validates proposed updates within the local typed neighborhoods of modified nodes. Accepted graph updates are reconstructed as incremental edits to the textual instruction checkpoint used at deployment. We evaluate GRACE within a fixed telecom agent harness derived from τ2-bench under a controlled distribution-shift protocol. Across five independent replications, GRACE improves strict reliability, measured by pass3, from the Gemini 2.5 Flash zero-shot value of 0.091 to 0.673±0.136 at the final checkpoint. This exceeds a Gemini 3.1 Pro zero-shot reference of 0.242 on the same held-out set, while the flat-text HCE baseline finishes at 0.191±0.051. These results identify two requirements for reliable long-horizon context evolution, a structural substrate that makes verification local and a consolidation mechanism that keeps accumulated instruction content usable.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 26 of its 43 references that are in the map. First posted on arXiv 10 Jul 2026.

Builds on

26 of 43 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026Position: Agentic Evolution is the Path to Evolving LLMs30 Jan
  2. 2025SCOPE: Prompt Evolution for Enhancing Agent Effectiveness17 Dec
  3. 2025EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecycle17 Oct
  4. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun
  5. 2023ExpeL: LLM Agents Are Experiential Learners20 Aug

Other references · 21

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  3. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  4. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  5. 2017Gradient Episodic Memory for Continual Learningcited by 1,871
  6. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
  7. 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,366
  8. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
  9. 2023Large Language Models as Optimizerscited by 830
  10. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
  11. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
  12. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
9 more
  1. 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
  2. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
  3. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
  4. 2024Agent Workflow Memorycited by 342
  5. 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 273
  6. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 248
  7. 2025Dynamic Cheatsheet: Test-Time Learning with Adaptive Memorycited by 146
  8. 2024Aligning to Thousands of Preferences via System Message Generalizationcited by 84
  9. 2026The World Won't Stay Still: Programmable Evolution for Agent Benchmarkscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Argus: A General-Purpose Agentic Reasoning Runtime for Long-Horizon Tasks
  2. 2026Verification as an Architectural Layer for LLM Agents: A V-Model Design, and a Pilot Study of Its Deterministic Core
  3. 2026Verified Tool Calls Improve LLM Agent Reliability Under Non-Atomic Failures
  4. 2026MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers
  5. 2026ASCENT: Online Test-Time Training of Long-Horizon Agents via Self-Distillation of Verified Experience
  6. 2026Trace2Skill: Verifier-Guided Skill Evolution for Long-Context EDA Agents
  7. 2026From Natural Language Policies to Executable Obligations: A Verification Harness for Dependable In-Car LLM Agents
  8. 2026MOSS: Self-Evolution through Source-Level Rewriting in Autonomous Agent Systems