mlsanityData to 7 Oct 2026

Reasoner-Executor-Synthesizer: Scalable Agentic Architecture with Static O(1) Context Window

arXiv 2603.22367 ↗First posted 23 Mar 2026cs.IR cs.AIcited by 0

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

also in 2 more
Abstract (arXiv)

Large Language Models (LLMs) deployed as autonomous agents commonly use Retrieval-Augmented Generation (RAG), feeding retrieved documents into the context window, which creates two problems: the risk of hallucination grows with context length, and token cost scales linearly with dataset size. We propose the Reasoner-Executor-Synthesizer (RES) architecture, a three-layer design that strictly separates intent parsing (Reasoner), deterministic data retrieval and aggregation (Executor), and narrative generation (Synthesizer). The Executor uses zero LLM tokens and passes only fixed-size statistical summaries to the Synthesizer. We formally prove that RES achieves O(1) token complexity with respect to dataset size, and validate this on ScholarSearch, a scholarly research assistant backed by the Crossref API (130M+ articles). Across 100 benchmark runs, RES achieves a mean token cost of 1,574 tokens regardless of whether the dataset contains 42,000 or 16.3 million articles. The architecture eliminates data hallucination by construction: the LLM never sees raw records. KEYWORDS LLM agents; agentic architecture; hallucination elimination; token optimization; context window; retrieval-augmented generation; deterministic execution; scholarly metadata; Crossref API; O(1) complexity.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 20 of its 32 references that are in the map. First posted on arXiv 23 Mar 2026.

Builds on

20 of 32 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Retrieval-Augmented Generation for Large Language Models: A Survey18 Dec

Other references · 19

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 2020Scaling Laws for Neural Language Modelscited by 6,411
  5. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  6. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  7. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  8. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  9. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  10. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  11. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
  12. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
7 more
  1. 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 895
  2. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
  3. 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 667
  4. 2022PAL: Program-aided Language Modelscited by 635
  5. 2024LongRoPE: Extending LLM Context Window Beyond 2 Million Tokenscited by 302
  6. 2023How is ChatGPT's behavior changing over time?cited by 265
  7. 2022Evaluating the Text-to-SQL Capabilities of Large Language Modelscited by 101

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026ContextPipe: Database-Inspired Context Assembly for Long-Horizon Agents
  2. 2026LongSeeker: Elastic Context Orchestration for Long-Horizon Search Agents
  3. 2026Toward a Theory of Hierarchical Memory for Language Agents
  4. 2026Trained Agentic Context Management
  5. 2026RECON: Benchmarking Agent Memory for Compositional Reasoning over Long Contexts
  6. 2025RAGCap-Bench: Benchmarking Capabilities of LLMs in Agentic Retrieval Augmented Generation Systems
  7. 2026Agentic Context Cracking: Token-Efficient Data Reasoning Agents via Adaptive Structuring of Unstructured Data
  8. 2026SoK: Agentic Retrieval-Augmented Generation (RAG): Taxonomy, Architectures, Evaluation, and Research Directions