mlsanityData to 14 Oct 2026

A Control Architecture for Training-Free Memory Use

arXiv 2604.18206 ↗First posted 20 Apr 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Prompt-injected memory can improve reasoning without updating model weights, but it also creates a control problem: retrieved content helps only when it is applied in the right state. We study this problem in a strict training-free setting and formulate it as applicability control: when to trigger a memory-assisted second pass, when to trust it, and how to maintain the memory bank over time. Our method combines uncertainty-based routing, confidence-based selective acceptance, bank selection across rule and exemplar memory, and evidence-based governance of the memory bank over time. Under a locked training-free protocol with compute-matched controls, it improves two core arithmetic benchmarks by +7.0 points on SVAMP and +7.67 points on ASDiv over baseline. The same architecture also transfers to QA and agent benchmarks with smaller positive effects and shows the same positive direction on a second checkpoint for the main arithmetic tasks. On arithmetic, the main empirical pattern is that the control architecture, rather than raw memory exposure, drives the improvements on SVAMP and ASDiv. Mechanistically, confidence separates helpful from harmful rule-bank interventions, and under fixed retrieval the repair-versus-corrupt difference localizes to rows whose retrieved set actually contains the edited entries.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 33 references that are in the map. First posted on arXiv 20 Apr 2026.

Builds on

29 of 33 references.

References · 29

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  4. 2017On Calibration of Modern Neural Networkscited by 4,960
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  6. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  7. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  8. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  9. 2022Language Models (Mostly) Know What They Knowcited by 1,856
  10. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
  11. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  12. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
17 more
  1. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
  2. 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 974
  3. 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 878
  4. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
  5. 2023Large Language Models as Optimizerscited by 864
  6. 2017Selective Classification for Deep Neural Networkscited by 852
  7. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
  8. 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 819
  9. 2022Teaching Models to Express Their Uncertainty in Wordscited by 751
  10. 2023Active Retrieval Augmented Generationcited by 516
  11. 2016Solving General Arithmetic Word Problemscited by 360
  12. 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 327
  13. 2021A Diverse Corpus for Evaluating and Developing English Math Word Problem Solverscited by 318
  14. 2020Selective Question Answering under Domain Shiftcited by 238
  15. 2024Corrective Retrieval Augmented Generationcited by 197
  16. 2023CLIN: A Continually Learning Language Agent for Rapid Task Adaptation and Generalizationcited by 95
  17. 2024SeaKR: Self-aware Knowledge Retrieval for Adaptive Retrieval Augmented Generationcited by 40

Built on by

Not cited yet.