mlsanityData to 7 Oct 2026

PerLTQA: A Personal Long-Term Memory Dataset for Memory Classification, Retrieval, and Synthesis in Question Answering

arXiv 2402.16288 ↗First posted 26 Feb 2024cs.CL cs.AI cs.IRcited by 34

Not on the map. Why?

Abstract (arXiv)

Long-term memory plays a critical role in personal interaction, considering long-term memory can better leverage world knowledge, historical information, and preferences in dialogues. Our research introduces PerLTQA, an innovative QA dataset that combines semantic and episodic memories, including world knowledge, profiles, social relationships, events, and dialogues. This dataset is collected to investigate the use of personalized memories, focusing on social interactions and events in the QA task. PerLTQA features two types of memory and a comprehensive benchmark of 8,593 questions for 30 characters, facilitating the exploration and application of personalized memories in Large Language Models (LLMs). Based on PerLTQA, we propose a novel framework for memory integration and generation, consisting of three main components: Memory Classification, Memory Retrieval, and Memory Synthesis. We evaluate this framework using five LLMs and three retrievers. Experimental results demonstrate that BERT-based classification models significantly outperform LLMs such as ChatGLM3 and ChatGPT in the memory classification task. Furthermore, our study highlights the importance of effective memory integration in the QA task.

Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). Builds on 25 of its 33 references that are in the map. First posted on arXiv 26 Feb 2024.

Builds on

25 of 33 references.

References · 25

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  4. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  5. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,203
  6. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
  7. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 786
  8. 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
  9. 2018CoQA: A Conversational Question Answering Challengecited by 674
  10. 2023Baichuan 2: Open Large-scale Language Modelscited by 664
  11. 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
  12. 2023InternLM-XComposer: A Vision-Language Large Model for Advanced Text-image Comprehension and Compositioncited by 297
13 more
  1. 2021Beyond Goldfish Memory: Long-Term Open-Domain Conversationcited by 266
  2. 2020HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Datacited by 263
  3. 2020Open Question Answering over Tables and Textcited by 163
  4. 2023ChatDB: Augmenting LLMs with Databases as Their Symbolic Memorycited by 136
  5. 2022Long Time No See! Open-Domain Conversation with Long-Term Persona Memorycited by 107
  6. 2023Topical-Chat: Towards Knowledge-Grounded Open-Domain Conversationscited by 88
  7. 2019Personalized Dialogue Generation with Diversified Traitscited by 73
  8. 2023Prompted LLMs as Chatbot Modules for Long Open-domain Conversationcited by 61
  9. 2023LLM-based Medical Assistant Personalization with Short- and Long-Term Memory Coordinationcited by 46
  10. 2022HybriDialogue: An Information-Seeking Dialogue Dataset Grounded on Tabular and Textual Datacited by 28
  11. 2023A Survey of the Evolution of Language Model-Based Dialogue Systems: Data, Task and Modelscited by 23
  12. 2023GLM-Dialog: Noise-tolerant Pre-training for Knowledge-grounded Dialogue Generationcited by 9
  13. 2023UniMC: A Unified Framework for Long-Term Memory Conversation via Relevance Representation Learningcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 11; 2026: 19.

34 papers.

Sort:

By area:

  1. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 656
  2. 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
  3. 2025A Survey of Context Engineering for Large Language Modelscited by 120
  4. 2025MemBench: Towards More Comprehensive Evaluation on the Memory of LLM-based Agentscited by 82
  5. 2025A Survey of Personalized Large Language Models: Progress and Future Directionscited by 65
  6. 2025MemoryBench: A Benchmark for Memory and Continual Learning in LLM Systemscited by 56
  7. 2025Rethinking Memory in LLM based Agents: Representations, Operations, and Emerging Topicscited by 36
  8. 2026Graph-based Agent Memory: Taxonomy, Techniques, and Applicationscited by 22
  9. 2025Toward Multi-Session Personalized Conversation: A Large-Scale Dataset and Hierarchical Tree Framework for Implicit Reasoningcited by 21
  10. 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanismscited by 19
  11. 2026LongMemEval-V2: Evaluating Long-Term Agent Memory Toward Experienced Colleaguescited by 17
  12. 2025Explicit v.s. Implicit Memory: Exploring Multi-hop Complex Reasoning Over Personalized Informationcited by 16
22 more
  1. 2026PERMA: Benchmarking Personalized Memory Agents via Event-Driven Preference and Realistic Task Environmentscited by 13
  2. 2025Evolutionary Perspectives on the Evaluation of LLM-Based AI Agents: A Comprehensive Surveycited by 12
  3. 2026According to Me: Long-Term Personalized Referential Memory QAcited by 12
  4. 2025Convomem Benchmark: Why Your First 150 Conversations Don't Need RAGcited by 10
  5. 2026EMemBench: Interactive Benchmarking of Episodic Memory for VLM Agentscited by 7
  6. 2024SHARE: Shared Memory-Aware Open-Domain Long-Term Dialogue Dataset Constructed from Movie Scriptcited by 6
  7. 2024A Multi-Task Role-Playing Agent Capable of Imitating Character Linguistic Stylescited by 6
  8. 2026Learning to Remember: End-to-End Training of Memory Agents for Long-Context Reasoningcited by 6
  9. 2026LMEB: Long-horizon Memory Embedding Benchmarkcited by 6
  10. 2026EvolMem: A Cognitive-Driven Benchmark for Multi-Session Dialogue Memorycited by 4
  11. 2026MemSifter: Offloading LLM Memory Retrieval via Outcome-Driven Proxy Reasoningcited by 3
  12. 2026MemLens: Benchmarking Multimodal Long-Term Memory in Large Vision-Language Modelscited by 3
  13. 2026MemoryRewardBench: Benchmarking Reward Models for Long-Term Memory Management in Large Language Modelscited by 2
  14. 2026VehicleMemBench: An Executable Benchmark for Multi-User Long-Term Memory in In-Vehicle Agentscited by 2
  15. 2025MemoCue: Empowering LLM-Based Agents for Human Memory Recall via Strategy-Guided Queryingcited by 1
  16. 2025Fidelity Before Structure: Verbatim Chunks Beat Lossy Artifact Extraction in Long-Conversation LLM Memorycited by 1
  17. 2026HiNS: Hierarchical Negative Sampling for More Comprehensive Memory Retrieval Embedding Modelcited by 1
  18. 2026LATTE: Forecasting Peer Anchored Preference Trajectories for Personalized LLM Generationcited by 1
  19. 2026ENPMR-Bench: Benchmarking Proactive Memory Retrieval for Emotional Support Agentscited by 1
  20. 2026Memory Beyond Recall: A Dual-Process Cognitive Memory System for Self-Evolving LLM Agentscited by 1
  21. 2026Life-Bench: A Benchmark and Knowledge Graph Framework for Multimodal Personalization Beyond Concept Recognitioncited by 0
  22. 2026Setoka: A Benchmark for Hierarchical User Understanding in Personalized Agents over Heterogeneous Datacited by 0