mlsanityData to 13 Oct 2026

Memory-Augmented Architecture for Long-Term Context Handling in Large Language Models

arXiv 2506.18271 ↗First posted 23 Jun 2025cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Large Language Models face significant challenges in maintaining coherent interactions over extended dialogues due to their limited contextual memory. This limitation often leads to fragmented exchanges and reduced relevance in responses, diminishing user experience. To address these issues, we propose a memory-augmented architecture that dynamically retrieves, updates, and prunes relevant information from past interactions, ensuring effective long-term context handling. Experimental results demonstrate that our solution significantly improves contextual coherence, reduces memory overhead, and enhances response quality, showcasing its potential for real-time applications in interactive systems.

Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 21 of its 30 references that are in the map. First posted on arXiv 23 Jun 2025.

Builds on

21 of 30 references.

References · 21

  1. 2024The Llama 3 Herd of Modelscited by 14,486
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,221
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,107
  4. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,968
  5. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,435
  6. 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,386
  7. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 824
  8. 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 714
  9. 2019Compressive Transformers for Long-Range Sequence Modellingcited by 707
  10. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 683
  11. 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
  12. 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 551
9 more
  1. 2018Universal Sentence Encodercited by 488
  2. 2021Beyond Goldfish Memory: Long-Term Open-Domain Conversationcited by 267
  3. 2023Augmenting Language Models with Long-Term Memorycited by 188
  4. 2022SCROLLS: Standardized CompaRison Over Long Language Sequencescited by 170
  5. 2020Can You Put it All Together: Evaluating Conversational Agents' Ability to Blend Skillscited by 131
  6. 2023RecurrentGPT: Interactive Generation of (Arbitrarily) Long Textcited by 84
  7. 2024Larimar: Large Language Models with Episodic Memory Controlcited by 53
  8. 2024CAMELoT: Towards Large Language Models with Training-Free Consolidated Associative Memorycited by 24
  9. 2023Injecting the BM25 Score as Text Improves BERT-Based Re-rankerscited by 17

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.