Beyond the Attention Stability Boundary: Agentic Self-Synthesizing Reasoning Protocols
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
As LLM agents transition to autonomous digital coworkers, maintaining deterministic goal-directedness in non-linear multi-turn conversations emerged as an architectural bottleneck. We identify and formalize a systemic failure mode termed the Attention Latch in decoder-only autoregressive Transformers. This phenomenon, a behavioral manifestation of Information Over-squashing, occurs when the cumulative probabilistic weight of historical context overrides mid-task updates, causing agents to remain anchored to obsolete constraints despite explicit contradictory instructions. We propose Self-Synthesizing Reasoning Protocols (SSRP), a metacognitive framework that implements a discrete separation between high-level architectural planning (Architect) and turn-by-turn procedural execution (Executive). We evaluate SSRP across 9K trajectories using the MultiWOZ 2.2 dataset and the Aggregate Pivot Accuracy (APA), a novel metric we validate by mapping its scores to the U-shaped 'Lost in the Middle' curve. We present 3 experimental tiers: a shallow recency-based retrieval pilot, a high-entropy SOP, and a semantic hijacked 3-hop Multi-Fact Synthesis task. Our results empirically locate the Attention Stability Boundary, where stateless Vanilla ReAct baselines for GPT 5.4 collapse to 0.1% success while SSRP achieves a 715X Resilience Lift. We demonstrate statistically significant gains across Gemini 3.1 Pro, Claude Sonnet 4.6 and DeepSeek V3.2. Audits confirm SSRP necessity by proving attentional lapse via a recursive reflexion baseline (100% success); decoupling the latch from positional bias through equidistant stress testing (90% accuracy); and formalizing SSRP via the Information Bottleneck principle and granularity ablations. Procedural Integrity audit (98.8% adherence) reveals a Grounding Paradox where high-stability models fail by refusing to hallucinate under retrieval-reasoning contamination.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 19 of its 21 references that are in the map. First posted on arXiv 27 Apr 2026.
Builds on
19 of 21 references.
References · 19
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
- 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Taskscited by 306
- 2024Titans: Learning to Memorize at Test Timecited by 303
- 2020MultiWOZ 2.2 : A Dialogue Dataset with Additional Annotation Corrections and State Tracking Baselinescited by 201
7 more
- 2024Transformers need glasses! Information over-squashing in language taskscited by 87
- 2026Memory Poisoning Attack and Defense on Memory Based LLM-Agentscited by 40
- 2025Exploring Autonomous Agents: A Closer Look at Why They Fail When Completing Taskscited by 20
- 2025DeepCrossAttention: Supercharging Transformer Residual Connectionscited by 7
- 2026From Prompt-Response to Goal-Directed Systems: The Evolution of Agentic AI Software Architecturecited by 4
- 2025Fuzzy, Symbolic, and Contextual: Enhancing LLM Instruction via Cognitive Scaffoldingcited by 2
- 2025AI Agents with Human-Like Collaborative Tools: Adaptive Strategies for Enhanced Problem-Solvingcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Thinking Before Thinking: Scaling Agentic Inference Through Meta-Reasoning
- 2026The Path Ahead for Agentic AI: Challenges and Opportunities
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents
- 2025Task Memory Engine: Spatial Memory for Robust Multi-Step LLM Agents
- 2026SAM: State-Adaptive Memory for Long-Horizon Reasoning Agent
- 2025United Minds or Isolated Agents? Exploring Coordination of LLMs under Cognitive Load Theory
- 2025Reasoning-Aware Prompt Orchestration: A Foundation Model for Multi-Agent Language Model Coordination
- 2025Structured Cognitive Loop for Behavioral Intelligence in Large Language Model Agents (Extended Revision: From Behavioral Architecture to Epistemic Accountability)