mlsanityData to 14 Oct 2026

ODA: Observation-Driven Agent for integrating LLMs and Knowledge Graphs

arXiv 2404.07677 ↗First posted 11 Apr 2024cs.CL cs.AIcited by 8

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

The integration of Large Language Models (LLMs) and knowledge graphs (KGs) has achieved remarkable success in various natural language processing tasks. However, existing methodologies that integrate LLMs and KGs often navigate the task-solving process solely based on the LLM's analysis of the question, overlooking the rich cognitive potential inherent in the vast knowledge encapsulated in KGs. To address this, we introduce Observation-Driven Agent (ODA), a novel AI agent framework tailored for tasks involving KGs. ODA incorporates KG reasoning abilities via global observation, which enhances reasoning capabilities through a cyclical paradigm of observation, action, and reflection. Confronting the exponential explosion of knowledge during observation, we innovatively design a recursive observation mechanism. Subsequently, we integrate the observed knowledge into the action and reflection modules. Through extensive experiments, ODA demonstrates state-of-the-art performance on several datasets, notably achieving accuracy improvements of 12.87% and 8.9%.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 22 of its 34 references that are in the map. First posted on arXiv 11 Apr 2024.

Builds on

22 of 34 references.

References · 22

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  5. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
  6. 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 898
  7. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
  8. 2020KILT: a Benchmark for Knowledge Intensive Language Taskscited by 573
  9. 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 343
  10. 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 328
  11. 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graphcited by 238
  12. 2023AutoAgents: A Framework for Automatic Agent Generationcited by 216
10 more
  1. 2023Chain-of-Knowledge: Grounding Large Language Models via Dynamic Knowledge Adapting over Heterogeneous Sourcescited by 122
  2. 2023Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answeringcited by 119
  3. 2021CREAK: A Dataset for Commonsense Reasoning over Entity Knowledgecited by 88
  4. 2023Boosting Language Models Reasoning with Chain-of-Knowledge Promptingcited by 77
  5. 2023Making Large Language Models Perform Better in Knowledge Graph Completioncited by 48
  6. 2022QALD-9-plus: A Multilingual Dataset for Question Answering over DBpedia and Wikidata Translated by Native Speakerscited by 39
  7. 2023HyKGE: A Hypothesis Knowledge Graph Enhanced Framework for Accurate and Reliable Medical LLMs Responsescited by 25
  8. 2023KnowledgeNavigator: Leveraging Large Language Models for Enhanced Reasoning over Knowledge Graphcited by 22
  9. 2023keqing: knowledge-based question answering is a nature chain-of-thought mentor of LLMcited by 16
  10. 2024ConstraintChecker: A Plugin for Large Language Models to Reason on Commonsense Knowledge Basescited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 4; 2026: 3.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graph
  2. 2025R2-KG: General-Purpose Dual-Agent Framework for Reliable Reasoning on Knowledge Graphs
  3. 2023Exploiting Language Models as a Source of Knowledge for Cognitive Agents
  4. 2026Toward Effective and Reliable LLM Agents via Dynamic Ontology
  5. 2025Unifying Language Agent Algorithms with Graph-based Orchestration Engine for Reproducible Agent Research
  6. 2024KG-RAG: Bridging the Gap Between Knowledge and Creativity
  7. 2026GraphScout: Empowering Large Language Models with Intrinsic Exploration Ability for Agentic Graph Reasoning
  8. 2025Tree of Agents: Improving Long-Context Capabilities of Large Language Models through Multi-Perspective Reasoning