ODA: Observation-Driven Agent for integrating LLMs and Knowledge Graphs
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
The integration of Large Language Models (LLMs) and knowledge graphs (KGs) has achieved remarkable success in various natural language processing tasks. However, existing methodologies that integrate LLMs and KGs often navigate the task-solving process solely based on the LLM's analysis of the question, overlooking the rich cognitive potential inherent in the vast knowledge encapsulated in KGs. To address this, we introduce Observation-Driven Agent (ODA), a novel AI agent framework tailored for tasks involving KGs. ODA incorporates KG reasoning abilities via global observation, which enhances reasoning capabilities through a cyclical paradigm of observation, action, and reflection. Confronting the exponential explosion of knowledge during observation, we innovatively design a recursive observation mechanism. Subsequently, we integrate the observed knowledge into the action and reflection modules. Through extensive experiments, ODA demonstrates state-of-the-art performance on several datasets, notably achieving accuracy improvements of 12.87% and 8.9%.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 22 of its 34 references that are in the map. First posted on arXiv 11 Apr 2024.
Builds on
22 of 34 references.
References · 22
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 898
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
- 2020KILT: a Benchmark for Knowledge Intensive Language Taskscited by 573
- 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 343
- 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 328
- 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graphcited by 238
- 2023AutoAgents: A Framework for Automatic Agent Generationcited by 216
10 more
- 2023Chain-of-Knowledge: Grounding Large Language Models via Dynamic Knowledge Adapting over Heterogeneous Sourcescited by 122
- 2023Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answeringcited by 119
- 2021CREAK: A Dataset for Commonsense Reasoning over Entity Knowledgecited by 88
- 2023Boosting Language Models Reasoning with Chain-of-Knowledge Promptingcited by 77
- 2023Making Large Language Models Perform Better in Knowledge Graph Completioncited by 48
- 2022QALD-9-plus: A Multilingual Dataset for Question Answering over DBpedia and Wikidata Translated by Native Speakerscited by 39
- 2023HyKGE: A Hypothesis Knowledge Graph Enhanced Framework for Accurate and Reliable Medical LLMs Responsescited by 25
- 2023KnowledgeNavigator: Leveraging Large Language Models for Enhanced Reasoning over Knowledge Graphcited by 22
- 2023keqing: knowledge-based question answering is a nature chain-of-thought mentor of LLMcited by 16
- 2024ConstraintChecker: A Plugin for Large Language Models to Reason on Commonsense Knowledge Basescited by 6
Built on by
Citing papers per year: 2024: 1; 2025: 4; 2026: 3.
8 papers.
- 2025A Survey of Context Engineering for Large Language Modelscited by 126
- 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generationcited by 80
- 2026Bridging Large-Model Reasoning and Real-Time Control via Agentic Fast-Slow Planningcited by 4
- 2025Large Language Models for Knowledge Graph Embedding: A Surveycited by 3
- 2025Adaptive and Resource-efficient Agentic AI Systems for Mobile and Embedded Devices: A Surveycited by 2
- 2026Explore-on-Graph: Incentivizing Autonomous Exploration of Large Language Models on Knowledge Graphs with Path-refined Reward Modelingcited by 2
- 2025SEAL: Self-Evolving Agentic Learning for Conversational Question Answering over Knowledge Graphscited by 1
- 2026LLMs+Graphs: Toward Graph-Native, Synergistic AI Systemscited by 0
- 2026LLMs+Graphs: Toward Graph-Native, Synergistic AI Systems10 Jun 2026
- 2026Bridging Large-Model Reasoning and Real-Time Control via Agentic Fast-Slow Planning2 Apr 2026
- 2026Explore-on-Graph: Incentivizing Autonomous Exploration of Large Language Models on Knowledge Graphs with Path-refined Reward Modeling25 Feb 2026
- 2025SEAL: Self-Evolving Agentic Learning for Conversational Question Answering over Knowledge Graphs4 Dec 2025
- 2025Adaptive and Resource-efficient Agentic AI Systems for Mobile and Embedded Devices: A Survey30 Sep 2025
- 2025A Survey of Context Engineering for Large Language Models17 Jul 2025
- 2025Large Language Models for Knowledge Graph Embedding: A Survey14 Jan 2025
- 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generation28 Oct 2024
Similar, not cited
Close in wording, no citation either way
- 2024KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graph
- 2025R2-KG: General-Purpose Dual-Agent Framework for Reliable Reasoning on Knowledge Graphs
- 2023Exploiting Language Models as a Source of Knowledge for Cognitive Agents
- 2026Toward Effective and Reliable LLM Agents via Dynamic Ontology
- 2025Unifying Language Agent Algorithms with Graph-based Orchestration Engine for Reproducible Agent Research
- 2024KG-RAG: Bridging the Gap Between Knowledge and Creativity
- 2026GraphScout: Empowering Large Language Models with Intrinsic Exploration Ability for Agentic Graph Reasoning
- 2025Tree of Agents: Improving Long-Context Capabilities of Large Language Models through Multi-Perspective Reasoning