Memory Is Not Always Needed: Characterizing Conditional Memory in Scientific Reasoning
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Scientific reasoning requires language models to retrieve specialized knowledge and incorporate it reliably into multi-step computation. Conditional memory provides an explicit lookup pathway that complements dense neural representations, but its usefulness is inherently input- and computation-dependent: retrieved information may repair missing scientific associations, yet it may also introduce distracting shortcuts or interfere with reasoning that the base model can already perform correctly. In this work, we systematically investigate when, where, and to what extent conditional memory should participate in scientific reasoning. We characterize the scientific knowledge boundary and controlled interventions on memory-enabled knowledge-circuit nodes. Based on these analyses, we propose a Knowledge Boundary-Aware Router that uses task-specific input proxies available before generation to determine whether memory is activated, which layer-stage nodes receive memory signals, and how strongly these signals contribute. Experiments on biological and chemical reasoning benchmarks, covering two backbone families and six task types, show that memory effects vary substantially across inputs, tasks, and injection locations. Compared with static and activation-rate-matched random routing, our approach more consistently preserves beneficial memory contributions while suppressing memory-induced regressions, establishing selective memory allocation as an important principle for reliable scientific reasoning.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 12 of its 40 references that are in the map. First posted on arXiv 25 Aug 2026.
Builds on
12 of 40 references.
References · 12
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2022Language Models (Mostly) Know What They Knowcited by 1,856
- 2022Solving math word problems with process- and outcome-based feedbackcited by 901
- 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 77
- 2024Larimar: Large Language Models with Episodic Memory Controlcited by 53
- 2025Intern-S1: A Scientific Multimodal Foundation Modelcited by 53
- 2025Beyond Chemical QA: Evaluating LLM's Chemical Reasoning with Modular Chemical Operationscited by 49
- 2023Personalized Large Language Model Assistant with Evolving Conditional Memorycited by 25
- 2025BioProBench: A Corpus and Benchmark for Biological Protocol Reasoning in Autonomous Sciencecited by 16
- 2026MeKi: Memory-based Expert Knowledge Injection for Efficient LLM Scalingcited by 7
- 2026Beyond Conditional Computation: Retrieval-Augmented Genomic Foundation Models with Gengramcited by 1
- 2026Augmenting Molecular Language Models with Local n-gram Memorycited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026A3-Bench: Benchmarking Memory-Driven Scientific Reasoning via Anchor and Attractor Activation
- 2026MemoBrain: Executive Memory as an Agentic Brain for Reasoning
- 2026Unlocking the Working Memory of Large Language Models for Latent Reasoning
- 2024Disentangling Memory and Reasoning Ability in Large Language Models
- 2026Memory is Reconstructed, Not Retrieved: Graph Memory for LLM Agents
- 2025Disentangling Recall and Reasoning in Transformer Models through Layer-wise Attention and Activation Analysis
- 2025Forgetting as a Feature: Cognitive Alignment of Large Language Models
- 2025Reason to Rote: Rethinking Memorization in Reasoning