mlsanityData to 7 Oct 2026

AriGraph: Learning Knowledge Graph World Models with Episodic Memory for LLM Agents

arXiv 2407.04363 ↗First posted 5 Jul 2024cs.AIcited by 100

On the map: World models → World models for language agents

also in 1 more
Abstract (arXiv)

Advancements in the capabilities of Large Language Models (LLMs) have created a promising foundation for developing autonomous agents. With the right tools, these agents could learn to solve tasks in new environments by accumulating and updating their knowledge. Current LLM-based agents process past experiences using a full history of observations, summarization, retrieval augmentation. However, these unstructured memory representations do not facilitate the reasoning and planning essential for complex decision-making. In our study, we introduce AriGraph, a novel method wherein the agent constructs and updates a memory graph that integrates semantic and episodic memories while exploring the environment. We demonstrate that our Ariadne LLM agent, consisting of the proposed memory architecture augmented with planning and decision-making, effectively handles complex tasks within interactive text game environments difficult even for human players. Results show that our approach markedly outperforms other established memory methods and strong RL baselines in a range of problems of varying complexity. Additionally, AriGraph demonstrates competitive performance compared to dedicated knowledge graph-based methods in static multi-hop question-answering.

Key facts. Cited by 100 papers in the map (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 50 of its 86 references that are in the map. First posted on arXiv 5 Jul 2024.

Builds on

50 of 86 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024A Survey on the Memory Mechanism of Large Language Model based Agents21 Apr
  2. 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr
  3. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learning8 Oct

Other references · 47

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  4. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  5. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  6. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  7. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
  8. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  9. 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 893
  10. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
  11. 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 339
  12. 2018TextWorld: A Learning Environment for Text-based Gamescited by 304
35 more
  1. 2024LongRoPE: Extending LLM Context Window Beyond 2 Million Tokenscited by 302
  2. 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 298
  3. 2023Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memorycited by 288
  4. 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 273
  5. 2019Stabilizing Transformers for Reinforcement Learningcited by 262
  6. 2020The NetHack Learning Environmentcited by 196
  7. 2023JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Modelscited by 170
  8. 2019Interactive Fiction Games: A Colossal Adventurecited by 165
  9. 2024A Human-Inspired Reading Agent with Gist Memory of Very Long Contextscited by 140
  10. 2024Exploring Large Language Model based Intelligent Agents: Definitions, Methods, and Prospectscited by 130
  11. 2023Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answeringcited by 119
  12. 2020Keep CALM and Explore: Language Models for Action Generation in Text-based Gamescited by 108
  13. 2023Scaling Transformer to 1M tokens and beyond with RMTcited by 97
  14. 2024KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graphcited by 90
  15. 2020Graph Constrained Reinforcement Learning for Natural Language Action Spacescited by 80
  16. 2023Evaluating Cognitive Maps and Planning in Large Language Models with CogEvalcited by 77
  17. 2024Generate-on-Graph: Treat LLM as both Agent and KG in Incomplete Knowledge Graph Question Answeringcited by 59
  18. 2020Learning Dynamic Belief Graphs to Generalize on Text-Based Gamescited by 49
  19. 2024GraphReader: Building Graph-based Agent to Enhance Long-Context Abilities of Large Language Modelscited by 42
  20. 2020How to Avoid Being Eaten by a Grue: Structured Exploration Strategies for Textual Worldscited by 38
  21. 2020Text-based RL Agents with Commonsense Knowledge: New Challenges, Environments and Baselinescited by 37
  22. 2020Interactive Fiction Game Playing as Multi-Paragraph Reading Comprehension with Reinforcement Learningcited by 27
  23. 2023LARP: Language-Agent Role Play for Open-World Gamescited by 24
  24. 2024HOLMES: Hyper-Relational Knowledge Graphs for Multi-hop Question Answering using LLMscited by 24
  25. 2024Playing NetHack with LLMs: Potential & Limitations as Zero-Shot Agentscited by 17
  26. 2024An Enhanced Prompt-Based LLM Reasoning Scheme via Knowledge Graph-Integrated Collaborationcited by 16
  27. 2023LLM-State: Open World State Representation for Long-horizon Task Planning with Large Language Modelcited by 15
  28. 2022Learning to Follow Instructions in Text-Based Gamescited by 12
  29. 2023Aspects of human memory and Large Language Modelscited by 12
  30. 2022Explain My Surprise: Learning Efficient Long-Term Memory by Predicting Uncertain Outcomescited by 11
  31. 2024MANGO: A Benchmark for Evaluating Mapping and Navigation Abilities of Large Language Modelscited by 9
  32. 2023Large Language Models as Source Planner for Personalized Knowledge-grounded Dialoguecited by 6
  33. 2023RecallM: An Adaptable Memory Mechanism with Temporal Understanding for Large Language Modelscited by 5
  34. 2024EXPLORER: Exploration-guided Reasoning for Textual Reinforcement Learningcited by 3
  35. 2023Constructing Temporal Dynamic Knowledge Graphs from Interactive Text-based Gamescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 34; 2026: 63.

100 papers.

Sort:

By area:

  1. 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 372
  2. 2025Memory in the Age of AI Agentscited by 285
  3. 2025MIRIX: Multi-Agent Memory System for LLM-Based Agentscited by 160
  4. 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 125
  5. 2025A Survey of Context Engineering for Large Language Modelscited by 120
  6. 2025How Memory Management Impacts LLM Agents: An Empirical Study of Experience-Following Behaviorcited by 95
  7. 2025Agent KB: Leveraging Cross-Domain Experience for Agentic Problem Solvingcited by 90
  8. 2024From Isolated Conversations to Hierarchical Schemas: Dynamic Tree Memory Representation for LLMscited by 77
  9. 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 68
  10. 2025LLM-based Agents Suffer from Hallucinations: A Survey of Taxonomy, Methods, and Directionscited by 49
  11. 2025Mem-α: Learning Memory Construction via Reinforcement Learningcited by 49
  12. 2025What Deserves Memory: Adaptive Memory Distillation for LLM Agentscited by 46
38 more
  1. 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agentscited by 40
  2. 2026PlugMem: A Task-Agnostic Plugin Memory Module for LLM Agentscited by 30
  3. 2025Graphs Meet AI Agents: Taxonomy, Progress, and Future Opportunitiescited by 23
  4. 2026AgentOCR: Reimagining Agent History via Optical Self-Compressioncited by 22
  5. 2026Graph-based Agent Memory: Taxonomy, Techniques, and Applicationscited by 22
  6. 2025Adaptation of Agentic AI: A Survey of Post-Training, Memory, and Skillscited by 19
  7. 2026GAM: Hierarchical Graph-based Agentic Memory for LLM Agentscited by 19
  8. 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanismscited by 19
  9. 2025Large language models for artificial general intelligence (AGI): A survey of foundational principles and approachescited by 18
  10. 2025The Future is Agentic: Definitions, Perspectives, and Open Challenges of Multi-Agent Recommender Systemscited by 14
  11. 2025ENGRAM: Effective, Lightweight Memory Orchestration for Conversational Agentscited by 14
  12. 2026EvoMemBench: Benchmarking Agent Memory from a Self-Evolving Perspectivecited by 14
  13. 2024Towards LifeSpan Cognitive Systemscited by 13
  14. 2025IMPersona: Evaluating Individual Level LM Impersonationcited by 11
  15. 2026SYNAPSE: Empowering LLM Agents with Episodic-Semantic Memory via Spreading Activationcited by 11
  16. 2026Toward Efficient Agents: Memory, Tool learning, and Planningcited by 11
  17. 2025Memory-augmented Query Reconstruction for LLM-based Knowledge Graph Reasoningcited by 10
  18. 2026E-mem: Multi-agent based Episodic Context Reconstruction for LLM Agent Memorycited by 10
  19. 2026Toward Personalized LLM-Powered Agents: Foundations, Evaluation, and Future Directionscited by 10
  20. 2026Memory is Reconstructed, Not Retrieved: Graph Memory for LLM Agentscited by 9
  21. 2025Code Summarization Beyond Function Levelcited by 8
  22. 2025Memory in Large Language Models: Mechanisms, Evaluation and Evolutioncited by 8
  23. 2025RGMem: Renormalization Group-inspired Memory Evolution for Language Agentscited by 7
  24. 2025ATOM: AdapTive and OptiMized dynamic temporal knowledge graph construction using LLMscited by 7
  25. 2026EMemBench: Interactive Benchmarking of Episodic Memory for VLM Agentscited by 7
  26. 2025Wikontic: Constructing Wikidata-Aligned, Ontology-Aware Knowledge Graphs with Large Language Modelscited by 6
  27. 2025Experience-Evolving Multi-Turn Tool-Use Agent with Hybrid Episodic-Procedural Memorycited by 6
  28. 2026Gated Differentiable Working Memory for Long-Context Language Modelingcited by 6
  29. 2026Aligning Agentic World Models via Knowledgeable Experience Learningcited by 5
  30. 2026Enhancing Web Agents with a Hierarchical Memory Treecited by 5
  31. 2026GSEM: Graph-based Self-Evolving Memory for Experience Augmented Clinical Reasoningcited by 5
  32. 2026Graph World Models: Concepts, Taxonomy, and Future Directionscited by 5
  33. 2026EMBER: Efficient Memory via Budgeted Evidence Retention for Long-Horizon Agentscited by 5
  34. 2026HyMem: Hybrid Memory Architecture with Dynamic Retrieval Schedulingcited by 4
  35. 2026HAGE: Harnessing Agentic Memory via RL-Driven Weighted Graph Evolutioncited by 4
  36. 2026AutoSci: A Memory-Centric Agentic System for the Full Scientific Research Lifecyclecited by 4
  37. 2026HyperSkill: Self-Evolving LLM Agents via Hypergraph-Structured Skill Memorycited by 4
  38. 2026Self-Evolving Agents as Dynamic Graph Transformation: A Survey and New Perspectivecited by 4

50 most cited of 100 All 100 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025From Experience to Strategy: Empowering LLM Agents with Trainable Graph Memory
  2. 2026Memory in the LLM Era: Modular Architectures and Strategies in a Unified Framework
  3. 2025A-MEM: Agentic Memory for LLM Agents
  4. 2026AdMem: Advanced Memory for Task-solving Agents
  5. 2025Efficient and Transferable Agentic Knowledge Graph RAG via Reinforcement Learning
  6. 2025LiCoMemory: Lightweight and Cognitive Agentic Memory for Efficient Long-Term Reasoning
  7. 2025ARIES: Autonomous Reasoning with LLMs on Interactive Thought Graph Environments
  8. 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions