mlsanityData to 7 Oct 2026

PersonalAI 2.0: Enhancing knowledge graph traversal/retrieval with planning mechanism for Personalized LLM Agents

arXiv 2605.13481 ↗First posted 13 May 2026cs.CLcited by 0

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

We introduce PersonalAI 2.0 (PAI-2), a novel framework designed to enhance LLM-based systems through integration of external knowledge graphs (KGs). The proposed approach addresses key limitations of existing Graph Retrieval-Augmented Generation (GraphRAG) methods by incorporating a dynamic, multistage query-processing pipeline. The central point of the PAI-2 design is its ability to perform adaptive, iterative information search, guided by extracted entities, matched graph vertices, and generated clue-queries. An evaluation conducted on five benchmarks (Natural Questions, TriviaQA, HotpotQA, 2WikiMultihopQA, and MuSiQue) demonstrates an improvement in the factual correctness of generated answers compared to analogue methods (LightRAG, RAPTOR, HippoRAG 2, and PAI-1). PAI-2 achieves a 9% average gain by LLM-as-a-Judge on the 2WikiMultihopQA and MuSiQue benchmarks, and attains accuracy comparable to HippoRAG 2 on the TriviaQA and HotpotQA benchmarks, reflecting its effectiveness in reducing hallucination rates and increasing precision. We show that enabled search plan enhancement mechanism gain 18% boost compared to disabled one by LLM-as-a-Judge across five benchmarks. In addition, an ablation study reveals that PAI-2 achieves SOTA result on the MINE-1 benchmark, obtaining an 89% information-retention score with LLMs in the 7--15B tiers. Collectively, these findings underscore the potential of PAI-2 to serve as a reusable component for personalized AI applications, which require scalable, context-aware knowledge-representation and reasoning capabilities. The source code of PAI-2 is available at the following link: https://github.com/Dzigen/PersonalAI.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 21 of its 36 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

21 of 36 references.

References · 21

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  3. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  4. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  5. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  6. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  7. 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
  8. 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 519
  9. 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 372
  10. 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 326
  11. 2024Graph Retrieval-Augmented Generation: A Surveycited by 320
  12. 2024AriGraph: Learning Knowledge Graph World Models with Episodic Memory for LLM Agentscited by 100
9 more
  1. 2024GRAG: Graph Retrieval-Augmented Generationcited by 77
  2. 2024Extract, Define, Canonicalize: An LLM-based Framework for Knowledge Graph Constructioncited by 70
  3. 2025KGGen: Extracting Knowledge Graphs from Plain Text with Language Modelscited by 49
  4. 2024Graph-constrained Reasoning: Faithful Reasoning on Knowledge Graphs with Large Language Modelscited by 47
  5. 2022DiaASQ : A Benchmark of Conversational Aspect-based Sentiment Quadruple Analysiscited by 27
  6. 2024Debate on Graph: a Flexible and Reliable Reasoning Framework for Large Language Modelscited by 19
  7. 2024Enhancing Large Language Models with Pseudo- and Multisource- Knowledge Graphs for Open-ended Question Answeringcited by 8
  8. 2025T-GRAG: A Dynamic GraphRAG Framework for Resolving Temporal Conflicts and Redundancy in Knowledge Retrievalcited by 6
  9. 2025Wikontic: Constructing Wikidata-Aligned, Ontology-Aware Knowledge Graphs with Large Language Modelscited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025PersonalAI: A Systematic Comparison of Knowledge Graph Storage and Retrieval Approaches for Personalized LLM agents
  2. 2025RJE: A Retrieval-Judgment-Exploration Framework for Efficient Knowledge Graph Question Answering with LLMs
  3. 2025Think-on-Graph 3.0: Efficient and Adaptive LLM Reasoning on Heterogeneous Graphs via Multi-Agent Dual-Evolving Context Retrieval
  4. 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generation
  5. 2025Graph Counselor: Adaptive Graph Exploration via Multi-Agent Synergy to Enhance LLM Reasoning
  6. 2026A Human-in-the-Loop, LLM-Centered Architecture for Knowledge-Graph Question Answering
  7. 2025BYOKG-RAG: Multi-Strategy Graph Retrieval for Knowledge Graph Question Answering
  8. 2024Towards Evaluating Large Language Models for Graph Query Generation