mlsanityData to 7 Oct 2026

KnowAgent: Knowledge-Augmented Planning for LLM-Based Agents

arXiv 2403.03101 ↗First posted 5 Mar 2024cs.CL cs.AI cs.HCcited by 61

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Large Language Models (LLMs) have demonstrated great potential in complex reasoning tasks, yet they fall short when tackling more sophisticated challenges, especially when interacting with environments through generating executable actions. This inadequacy primarily stems from the lack of built-in action knowledge in language agents, which fails to effectively guide the planning trajectories during task solving and results in planning hallucination. To address this issue, we introduce KnowAgent, a novel approach designed to enhance the planning capabilities of LLMs by incorporating explicit action knowledge. Specifically, KnowAgent employs an action knowledge base and a knowledgeable self-learning strategy to constrain the action path during planning, enabling more reasonable trajectory synthesis, and thereby enhancing the planning performance of language agents. Experimental results on HotpotQA and ALFWorld based on various backbone models demonstrate that KnowAgent can achieve comparable or superior performance to existing baselines. Further analysis indicates the effectiveness of KnowAgent in terms of planning hallucinations mitigation. Code is available in https://github.com/zjunlp/KnowAgent.

Key facts. Cited by 61 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 52 of its 78 references that are in the map. First posted on arXiv 5 Mar 2024.

Builds on

52 of 78 references.

Closest ancestors · 19

Same direction, newest first

  1. 2024Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language Models as Agents18 Feb
  2. 2024AMOR: A Recipe for Building Adaptable Modular Knowledge Agents Through Process Feedback2 Feb
  3. 2024Formal-LLM: Integrating Formal Language and Natural Language for Controllable LLM-based Agents1 Feb
  4. 2024Small LLMs Are Weak Tool Learners: A Multi-LLM Agent14 Jan
  5. 2024Personal LLM Agents: Insights and Survey about the Capability, Efficiency and Security10 Jan
  6. 2024If LLM Is the Wizard, Then Code Is the Wand: A Survey on How Code Empowers Large Language Models to Serve as Intelligent Agents1 Jan
  7. 2023Igniting Language Intelligence: The Hitchhiker's Guide From Chain-of-Thought Reasoning to Language Agents20 Nov
  8. 2023AgentTuning: Enabling Generalized Agent Abilities for LLMs19 Oct
  9. 2023OpenAgents: An Open Platform for Language Agents in the Wild16 Oct
  10. 2023FireAct: Toward Language Agent Fine-tuning9 Oct
  11. 2023AutoAgents: A Framework for Automatic Agent Generation29 Sep
  12. 2023Agents: An Open-source Framework for Autonomous Language Agents14 Sep
7 more
  1. 2023The Rise and Potential of Large Language Model Based Agents: A Survey14 Sep
  2. 2023A Survey on Large Language Model based Autonomous Agents22 Aug
  3. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors21 Aug
  4. 2023BOLAA: Benchmarking and Orchestrating LLM-augmented Autonomous Agents11 Aug
  5. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
  6. 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agents5 Jun
  7. 2023AdaPlanner: Adaptive Planning from Feedback with Language Models26 May

Other references · 33

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  4. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  5. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  6. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  7. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  8. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  9. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  10. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  11. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  12. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
21 more
  1. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
  2. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,143
  3. 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 940
  4. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 911
  5. 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 311
  6. 2023FreshLLMs: Refreshing Large Language Models with Search Engine Augmentationcited by 308
  7. 2022Generate rather than Retrieve: Large Language Models are Strong Context Generatorscited by 296
  8. 2022Reasoning with Language Model Prompting: A Surveycited by 251
  9. 2023Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task Planningcited by 204
  10. 2024Agent AI: Surveying the Horizons of Multimodal Interactioncited by 167
  11. 2023LLM-Grounder: Open-Vocabulary 3D Visual Grounding with Large Language Model as an Agentcited by 134
  12. 2023Retroformer: Retrospective Large Language Agents with Policy Gradient Optimizationcited by 110
  13. 2024Self-Discover: Large Language Models Self-Compose Reasoning Structurescited by 108
  14. 2023Can Large Language Models Really Improve by Self-critiquing Their Own Plans?cited by 107
  15. 2024KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graphcited by 90
  16. 2023Making Language Models Better Tool Learners with Execution Feedbackcited by 69
  17. 2023Self-Evolved Diverse Data Sampling for Efficient Instruction Tuningcited by 52
  18. 2022Rainier: Reinforced Knowledge Introspector for Commonsense Question Answeringcited by 43
  19. 2023Trends in Integration of Knowledge and Large Language Models: A Survey and Taxonomy of Methods, Benchmarks, and Applicationscited by 28
  20. 2023Integrating Action Knowledge and LLMs for Task Planning and Situation Handling in Open Worldscited by 26
  21. 2023ProAgent: From Robotic Process Automation to Agentic Process Automationcited by 26

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 13; 2025: 40; 2026: 8.

61 papers.

Sort:

By area:

  1. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 194
  2. 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 170
  3. 2025Multi-agent Architecture Search via Agentic Supernetcited by 164
  4. 2024Large Language Model-Brained GUI Agents: A Surveycited by 160
  5. 2025From LLM Reasoning to Autonomous AI Agents: A Comprehensive Reviewcited by 146
  6. 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 125
  7. 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systemscited by 112
  8. 2024A Survey on Large Language Model-Based Game Agentscited by 106
  9. 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?cited by 105
  10. 2025Agent KB: Leveraging Cross-Domain Experience for Agentic Problem Solvingcited by 90
  11. 2024A Survey on Self-Evolution of Large Language Modelscited by 86
  12. 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 74
38 more
  1. 2024Agent Planning with World Knowledge Modelcited by 66
  2. 2025A Survey on (M)LLM-Based GUI Agentscited by 61
  3. 2025EvoFlow: Evolving Diverse Agentic Workflows On The Flycited by 49
  4. 2025LLM-based Agents Suffer from Hallucinations: A Survey of Taxonomy, Methods, and Directionscited by 49
  5. 2024Graph-constrained Reasoning: Faithful Reasoning on Knowledge Graphs with Large Language Modelscited by 47
  6. 2025Large Language Models for Planning: A Comprehensive and Systematic Surveycited by 38
  7. 2024Benchmarking Agentic Workflow Generationcited by 36
  8. 2024A Survey on Medical Large Language Models: Technology, Application, Trustworthiness, and Future Directionscited by 34
  9. 2025GenEnv: Difficulty-Aligned Co-Evolution Between LLM Agents and Environment Simulatorscited by 34
  10. 2024SELP: Generating Safe and Efficient Task Plans for Robot Agents with Large Language Modelscited by 21
  11. 2025Thought-Augmented Planning for LLM-Powered Interactive Recommender Agentcited by 17
  12. 2025PlanGEN: A Multi-Agent Framework for Generating Planning and Reasoning Trajectories for Complex Problem Solvingcited by 15
  13. 2025SEEA-R1: Tree-Structured Reinforcement Fine-Tuning for Self-Evolving Embodied Agentscited by 15
  14. 2024Defining and Detecting the Defects of the Large Language Model-based Autonomous Agentscited by 14
  15. 2025AutoLabs: Cognitive Multi-Agent Systems with Self-Correction for Autonomous Chemical Experimentationcited by 13
  16. 2025LLMs Working in Harmony: A Survey on the Technological Aspects of Building Effective LLM-Based Multi Agent Systemscited by 10
  17. 2025Hierarchical Planning for Complex Tasks with Knowledge Graph-RAG and Symbolic Verificationcited by 9
  18. 2025Orchestrating Agents and Data for Enterprise: A Blueprint Architecture for Compound AIcited by 9
  19. 2025Unleashing Embodied Task Planning Ability in LLMs via Reinforcement Learningcited by 9
  20. 2025Agentic Knowledgeable Self-awarenesscited by 8
  21. 2025DWIM: Towards Tool-aware Visual Reasoning via Discrepancy-aware Workflow Generation & Instruct-Masking Tuningcited by 7
  22. 2025CangLing-KnowFlow: A Unified Knowledge-and-Flow-fused Agent for Comprehensive Remote Sensing Applicationscited by 7
  23. 2024AgentRE: An Agent-Based Framework for Navigating Complex Information Landscapes in Relation Extractioncited by 6
  24. 2025EvoMem: Improving Multi-Agent Planning with Dual-Evolving Memorycited by 6
  25. 2025Reasoning by Exploration: A Unified Approach to Retrieval and Generation over Graphscited by 5
  26. 2026Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systemscited by 5
  27. 2025Putting on the Thinking Hats: A Survey on Chain of Thought Fine-tuning from the Perspective of Human Reasoning Mechanismcited by 4
  28. 2025OWMM-Agent: Open World Mobile Manipulation With Multi-modal Agentic Data Synthesiscited by 3
  29. 2025LLM Enabled Multi-Agent System for 6G Networks: Framework and Method of Dual-Loop Edge-Terminal Collaborationcited by 3
  30. 2026Hippocampus: An Efficient and Scalable Memory Module for Agentic AIcited by 3
  31. 2026Self-evolving LLM agents with in-distribution Optimizationcited by 3
  32. 2025From Reasoning to Generalization: Knowledge-Augmented LLMs for ARC Benchmarkcited by 2
  33. 2025CausalPlan: Empowering Efficient LLM Multi-Agent Collaboration Through Causality-Driven Planningcited by 2
  34. 2025Guided Reasoning in LLM-Driven Penetration Testing Using Structured Attack Treescited by 2
  35. 2025Addressing Situated Teaching Needs: A Multi-Agent Framework for Automated Slide Adaptationcited by 2
  36. 2026MagicAgent: Towards Generalized Agent Planningcited by 2
  37. 2024Instructional Text Across Disciplines: A Survey of Representations, Downstream Tasks, and Open Challenges Toward Capable AI Agentscited by 1
  38. 2024Research on the Proximity Relationships of Psychosomatic Disease Knowledge Graph Modules Extracted by Large Language Modelscited by 1

50 most cited of 61 All 61 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024Understanding the planning of LLM agents: A survey
  2. 2024ConceptAgent: LLM-Driven Precondition Grounding and Tree Search for Robust Task Planning and Execution
  3. 2024AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generation
  4. 2025From Language to Action: A Review of Large Language Models as Autonomous Agents and Tool Users
  5. 2025CodeAgents: A Token-Efficient Framework for Codified Multi-Agent Reasoning in LLMs
  6. 2025Procedural Knowledge Improves Agentic LLM Workflows
  7. 2026The Path Ahead for Agentic AI: Challenges and Opportunities
  8. 2025Enhancing LLM-Based Agents via Global Planning and Hierarchical Execution