PersonalAI: A Systematic Comparison of Knowledge Graph Storage and Retrieval Approaches for Personalized LLM agents
On the map: LLM agents and tool use → Agent memory systems
Abstract (arXiv)
Personalizing language models by effectively incorporating user interaction history remains a central challenge in the development of adaptive AI systems. While large language models (LLMs), combined with Retrieval-Augmented Generation (RAG), have improved factual accuracy, they often lack structured memory and fail to scale in complex, long-term interactions. To address this, we propose a flexible external memory framework based on a knowledge graph that is constructed and updated automatically by the LLM. Building upon the AriGraph architecture, we introduce a novel hybrid graph design that supports both standard edges and two types of hyper-edges, enabling rich and dynamic semantic and temporal representations. Our framework also supports diverse retrieval mechanisms, including A*, WaterCircles traversal, beam search, and hybrid methods, making it adaptable to different datasets and LLM capacities. We evaluate our system on TriviaQA, HotpotQA, DiaASQ benchmarks and demonstrate that different memory and retrieval configurations yield optimal performance depending on the task. Additionally, we extend the DiaASQ benchmark with temporal annotations and internally contradictory statements, showing that our system remains robust and effective in managing temporal dependencies and context-aware reasoning
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 29 of its 51 references that are in the map. First posted on arXiv 20 Jun 2025.
Builds on
29 of 51 references.
Closest ancestors · 2
Same direction, newest first
- 2024AriGraph: Learning Knowledge Graph World Models with Episodic Memory for LLM Agents5 Jul
- 2024A Human-Inspired Reading Agent with Gist Memory of Very Long Contexts15 Feb
Other references · 27
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2021Improving language models by retrieving from trillions of tokenscited by 1,293
- 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 952
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
- 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
- 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 532
15 more
- 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 328
- 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 281
- 2023Knowledge Graph Prompting for Multi-Document Question Answeringcited by 152
- 2021End-to-End Training of Multi-Document Reader and Retriever for Open-Domain Question Answeringcited by 133
- 2023Walking Down the Memory Maze: Beyond Context Limit through Interactive Readingcited by 133
- 2024GRAG: Graph Retrieval-Augmented Generationcited by 78
- 2020Relevance-guided Supervision for OpenQA with ColBERTcited by 71
- 2024Think-on-Graph 2.0: Deep and Faithful Large Language Model Reasoning with Knowledge-guided Retrieval Augmented Generationcited by 64
- 2024Graph-constrained Reasoning: Faithful Reasoning on Knowledge Graphs with Large Language Modelscited by 48
- 2022Questions Are All You Need to Train a Dense Passage Retrievercited by 47
- 2024GraphReader: Building Graph-based Agent to Enhance Long-Context Abilities of Large Language Modelscited by 43
- 2022DiaASQ : A Benchmark of Conversational Aspect-based Sentiment Quadruple Analysiscited by 27
- 2024Debate on Graph: a Flexible and Reliable Reasoning Framework for Large Language Modelscited by 19
- 2024Enhancing Large Language Models with Pseudo- and Multisource- Knowledge Graphs for Open-ended Question Answeringcited by 8
- 2023Two-Server Private Information Retrieval with Optimized Download Rate and Result Verificationcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026PersonalAI 2.0: Enhancing knowledge graph traversal/retrieval with planning mechanism for Personalized LLM Agents
- 2026Graph-Based Personalized Memory for LLM Agents: Representation, Evolution, Retrieval, and Evaluation
- 2026MemORAI: Memory Organization and Retrieval via Adaptive Graph Intelligence for LLM Conversational Agents
- 2025Enabling Personalized Long-term Interactions in LLM-based Agents through Persistent Memory and User Profiles
- 2026GAAMA: Graph Augmented Associative Memory for Agents
- 2026MemMachine: A Ground-Truth-Preserving Memory System for Personalized AI Agents
- 2025A-MEM: Agentic Memory for LLM Agents
- 2026TAGGRAPH: Tag-Augmented Graphs for Graph Retrieval of Agent Persistent Histories