SynapticRAG: Enhancing Temporal Memory Retrieval in Large Language Models through Synaptic Mechanisms
Not on the map. Why?
Abstract (arXiv)
Existing retrieval methods in Large Language Models show degradation in accuracy when handling temporally distributed conversations, primarily due to their reliance on simple similarity-based retrieval. Unlike existing memory retrieval methods that rely solely on semantic similarity, we propose SynapticRAG, which uniquely combines temporal association triggers with biologically-inspired synaptic propagation mechanisms. Our approach uses temporal association triggers and synaptic-like stimulus propagation to identify relevant dialogue histories. A dynamic leaky integrate-and-fire mechanism then selects the most contextually appropriate memories. Experiments on four datasets of English, Chinese and Japanese show that compared to state-of-the-art memory retrieval methods, SynapticRAG achieves consistent improvements across multiple metrics up to 14.66% points. This work bridges the gap between cognitive science and language model development, providing a new framework for memory management in conversational systems.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 15 of its 48 references that are in the map. First posted on arXiv 17 Oct 2024.
Builds on
15 of 48 references.
References · 15
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,850
- 2021Improving language models by retrieving from trillions of tokenscited by 1,293
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
- 2018Neural Approaches to Conversational AIcited by 165
- 2023Information Retrieval: Recent Advances and Beyondcited by 49
- 2024"My agent understands me better": Integrating Dynamic Human-like Memory Recall and Consolidation in LLM-Based Agentscited by 29
- 2024Improving Conversational Abilities of Quantized Large Language Models via Direct Preference Alignmentcited by 9
- 2018Memory-augmented Dialogue Management for Task-oriented Dialogue Systemscited by 8
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Gated Differentiable Working Memory for Long-Context Language Modelingcited by 6
- 2026Learning User-Aware Recall: Personalized Retrieval in Long-Term Conversational Memorycited by 2
- 2026PathMem: Toward Cognition-Aligned Memory Transformation for Pathology MLLMscited by 1
- 2026Soul Computing: A Theoretical Framework and Technical Architecture for Intelligent Agents with Independent Consciousnesscited by 0
- 2026EvoWiki: Incremental State Overwriting and Traceable Question Answering for Cross-Meeting Knowledge Evolutioncited by 0
- 2026EvoWiki: Incremental State Overwriting and Traceable Question Answering for Cross-Meeting Knowledge Evolution24 Aug 2026
- 2026Soul Computing: A Theoretical Framework and Technical Architecture for Intelligent Agents with Independent Consciousness9 Jun 2026
- 2026Learning User-Aware Recall: Personalized Retrieval in Long-Term Conversational Memory28 May 2026
- 2026PathMem: Toward Cognition-Aligned Memory Transformation for Pathology MLLMs10 Mar 2026
- 2026Gated Differentiable Working Memory for Long-Context Language Modeling19 Jan 2026