A3-Bench: Benchmarking Memory-Driven Scientific Reasoning via Anchor and Attractor Activation
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Scientific reasoning relies not only on logical inference but also on activating prior knowledge and experiential structures. Memory can efficiently reuse knowledge and enhance reasoning consistency and stability. However, existing benchmarks mainly evaluate final answers or step-by-step coherence, overlooking the textitmemory-driven mechanisms that underlie human reasoning, which involves activating anchors and attractors, then integrating them into multi-step inference. To address this gap, we propose A3-Bench~ https://a3-bench.github.io, a benchmark designed to evaluate scientific reasoning through dual-scale memory-driven activation, grounded in Anchor and Attractor Activation. First, we annotate 2,198 science reasoning problems across domains using the SAPM process(subject, anchor & attractor, problem, and memory developing). Second, we introduce a dual-scale memory evaluation framework utilizing anchors and attractors, along with the AAUI(Anchor--Attractor Utilization Index) metric to measure memory activation rates. Finally, through experiments with various base models and paradigms, we validate A3-Bench and analyze how memory activation impacts reasoning performance, providing insights into memory-driven scientific reasoning.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 30 of its 52 references that are in the map. First posted on arXiv 14 Jan 2026.
Builds on
30 of 52 references.
References · 30
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2025Qwen3 Technical Reportcited by 8,195
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,099
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 800
- 2024DeepSeek-V3 Technical Reportcited by 724
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
18 more
- 2020Aligning AI With Shared Human Valuescited by 706
- 2025Humanity's Last Examcited by 467
- 2025Memory OS of AI Agentcited by 140
- 2025Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmarkcited by 132
- 2025MemOS: A Memory OS for AI Systemcited by 129
- 2024HybridRAG: Integrating Knowledge Graphs and Vector Retrieval Augmented Generation for Efficient Information Extractioncited by 92
- 2024MEMORYLLM: Towards Self-Updatable Large Language Modelscited by 89
- 2024Are Your LLMs Capable of Stable Reasoning?cited by 65
- 2025PhysReason: A Comprehensive Benchmark towards Physics-Based Reasoningcited by 58
- 2024M-RAG: Reinforcing Large Language Model Performance through Retrieval-Augmented Generation with Multiple Partitionscited by 38
- 2024KARMA: Augmenting Embodied AI Agents with Long-and-short Term Memory Systemscited by 38
- 2025A Systematic Review of Key Retrieval-Augmented Generation (RAG) Systems: Progress, Gaps, and Future Directionscited by 30
- 2024SciKnowEval: Evaluating Multi-level Scientific Knowledge of Large Language Modelscited by 19
- 2025Assessing the Chemical Intelligence of Large Language Modelscited by 14
- 2025ChartSketcher: Reasoning with Multimodal Feedback and Reflection for Chart Understandingcited by 13
- 2025SUPERChem: A Multimodal Reasoning Benchmark in Chemistrycited by 7
- 2025CoFFT: Chain of Foresight-Focus Thought for Visual Language Modelscited by 6
- 2025MAPS: Multi-Agent Personality Shaping for Collaborative Reasoningcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Memory Is Not Always Needed: Characterizing Conditional Memory in Scientific Reasoning
- 2026Reasoning as Attractor Dynamics: Latent Memory Retrieval via Gibbs-Weighted Energy Minimization
- 2026SciR: A Controllable Benchmark for Scientific Reasoning in LLMs
- 2026eMoT: evolving Memory-of-Thought via Symbolic Anchoring and Memory Corrosion
- 2026SciIF: Benchmarking Scientific Instruction Following Towards Rigorous Scientific Intelligence
- 2026Equilibrium Reasoners: Learning Attractors Enables Scalable Reasoning
- 2026SciVQR: A Multidisciplinary Multimodal Benchmark for Advanced Scientific Reasoning Evaluation
- 2025Cognitive Loop via In-Situ Optimization: Self-Adaptive Reasoning for Science