mlsanityData to 7 Oct 2026

KARMA: Leveraging Multi-Agent LLMs for Automated Knowledge Graph Enrichment

arXiv 2502.06472 ↗First posted 10 Feb 2025cs.CL cs.AI cs.CEcited by 26

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

Maintaining comprehensive and up-to-date knowledge graphs (KGs) is critical for modern AI systems, but manual curation struggles to scale with the rapid growth of scientific literature. This paper presents KARMA, a novel framework employing multi-agent large language models (LLMs) to automate KG enrichment through structured analysis of unstructured text. Our approach employs nine collaborative agents, spanning entity discovery, relation extraction, schema alignment, and conflict resolution that iteratively parse documents, verify extracted knowledge, and integrate it into existing graph structures while adhering to domain-specific schema. Experiments on 1,200 PubMed articles from three different domains demonstrate the effectiveness of KARMA in knowledge graph enrichment, with the identification of up to 38,230 new entities while achieving 83.1% LLM-verified correctness and reducing conflict edges by 18.6% through multi-layer assessments.

Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 17 of its 33 references that are in the map. First posted on arXiv 10 Feb 2025.

Builds on

17 of 33 references.

References · 17

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  4. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
  5. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
  6. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
  7. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
  8. 2020Self-supervised Learning: Generative or Contrastivecited by 693
  9. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
  10. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  11. 2020Knowledge Graphscited by 619
  12. 2018AI safety via debatecited by 384
5 more
  1. 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agentscited by 329
  2. 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Taskscited by 221
  3. 2023LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunitiescited by 97
  4. 2020Growth rates of modern science: A latent piecewise growth curve approach to model publication numbers from established and new literature databasescited by 75
  5. 2025Biomedical Knowledge Graph: A Survey of Domains, Tasks, and Real-World Applicationscited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 9; 2026: 17.

26 papers.

Sort:

By area:

  1. 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 125
  2. 2025LLM-empowered knowledge graph construction: A surveycited by 20
  3. 2025The Future is Agentic: Definitions, Perspectives, and Open Challenges of Multi-Agent Recommender Systemscited by 14
  4. 2025D-SMART: Enhancing LLM Dialogue Consistency via Dynamic Structured Memory And Reasoning Treecited by 7
  5. 2025RAKG:Document-level Retrieval Augmented Knowledge Graph Constructioncited by 4
  6. 2025Constructing coherent spatial memory in LLM agents through graph rectificationcited by 2
  7. 2026HVR-Met: A Hypothesis-Verification-Replanning Agentic System for Extreme Weather Diagnosiscited by 2
  8. 2025GRAPH-GRPO-LEX: Contract Graph Modeling and Reinforcement Learning with Group Relative Policy Optimizationcited by 1
  9. 2026Better Later Than Sooner: Neuro-Symbolic Knowledge Graph Construction via Ontology-grounded Post-extraction Correctioncited by 1
  10. 2026EvolvingWorld: An Open-Schema Framework for Co-Evolving Role-Play Agents and World Model in Interactive Literary Worldcited by 1
  11. 2025medicX-KG: A Knowledge Graph for Pharmacists' Drug Information Needscited by 0
  12. 2025EMERGE: A Benchmark for Updating Knowledge Graphs with Emerging Textual Knowledgecited by 0
14 more
  1. 2026Intent-Driven Smart Manufacturing Integrating Knowledge Graphs and Large Language Modelscited by 0
  2. 2026LITTA: Late-Interaction and Test-Time Alignment for Visually-Grounded Multimodal Retrievalcited by 0
  3. 2026Beyond Predefined Schemas: TRACE-KG for Context-Enriched Knowledge Graph Generationcited by 0
  4. 2026BioResearcher: Scenario-Guided Multi-Agent for Translational Medicinecited by 0
  5. 2026Knowledge-to-Verification: Exploring RLVR for LLMs in Knowledge-Intensive Domainscited by 0
  6. 2026Stage-Audit: Auditable Source-Frontier Discovery for Cross-Wiki Tablescited by 0
  7. 2026ChronoMedKG: A Temporally-Grounded Biomedical Knowledge Graph and Benchmark for Clinical Reasoningcited by 0
  8. 2026AdaSTORM: Scaling LLM Reasoning on Dynamic Graphs via Adaptive Spatio-Temporal Multi-Agent Collaborationcited by 0
  9. 2026Trust-Aware Multi-Agent Traceability: Confidence-Calibrated Knowledge Graphs for Consistent Software Artifact Managementcited by 0
  10. 2026From Static Bibliometrics to Dynamic Knowledge Graphs: An LLM-Powered Framework for Modernizing Science, Technology, and Innovation (STI) Analyticscited by 0
  11. 2026VLD-RAG: Agentic Vision-Language Retrieval-Augmented Generation for Long, Visually-Rich Multi-Page Documentscited by 0
  12. 2026TRACE: Agentic Catalog Enrichment with Multi-source Evidence Groundingcited by 0
  13. 2026LLMs Interpret, Embeddings Organize, Graphs Emerge: Agent-Driven Compilation of Scientific Knowledgecited by 0
  14. 2026Automated Tree Knowledge Graph Construction using Ontology Expansion and Retrieval from Vietnamese History Textbookscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Beyond Isolation: Multi-Agent Synergy for Improving Knowledge Graph Construction
  2. 2025AgREE: Agentic Reasoning for Knowledge Graph Completion on Emerging Entities
  3. 2026Agents-K1: Towards Agent-native Knowledge Orchestration
  4. 2024KG-RAG: Bridging the Gap Between Knowledge and Creativity
  5. 2026Probing the Knowledge Boundary: An Interactive Agentic Framework for Deep Knowledge Extraction
  6. 2026RAGA: Reading-And-Graph-building-Agent for Autonomous Knowledge Graph Construction and Retrieval-Augmented Generation
  7. 2023Enhancing Knowledge Graph Construction Using Large Language Models
  8. 2026GraphScout: Empowering Large Language Models with Intrinsic Exploration Ability for Agentic Graph Reasoning