mlsanityData to 14 Oct 2026

AutoKG: Efficient Automated Knowledge Graph Generation for Language Models

arXiv 2311.14740 ↗First posted 22 Nov 2023cs.CLcited by 17

Not on the map. Why?

Abstract (arXiv)

Traditional methods of linking large language models (LLMs) to knowledge bases via the semantic similarity search often fall short of capturing complex relational dynamics. To address these limitations, we introduce AutoKG, a lightweight and efficient approach for automated knowledge graph (KG) construction. For a given knowledge base consisting of text blocks, AutoKG first extracts keywords using a LLM and then evaluates the relationship weight between each pair of keywords using graph Laplace learning. We employ a hybrid search scheme combining vector similarity and graph-based associations to enrich LLM responses. Preliminary experiments demonstrate that AutoKG offers a more comprehensive and interconnected knowledge retrieval mechanism compared to the semantic similarity search, thereby enhancing the capabilities of LLMs in generating more insightful and relevant outputs.

Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 28 of its 51 references that are in the map. First posted on arXiv 22 Nov 2023.

Builds on

28 of 51 references.

References · 28

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  6. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  7. 2021Learning to Prompt for Vision-Language Modelscited by 2,281
  8. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
  9. 2019Language Models as Knowledge Bases?cited by 1,936
  10. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
  11. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 894
  12. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
16 more
  1. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  2. 2019Neural Text Generation with Unlikelihood Trainingcited by 503
  3. 2023Augmented Language Models: a Surveycited by 403
  4. 2022Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Modelscited by 220
  5. 2020Sparse, Dense, and Attentional Representations for Text Retrievalcited by 214
  6. 2022Fine-tuned Language Models are Continual Learnerscited by 156
  7. 2022Deep Bidirectional Language-Knowledge Graph Pretrainingcited by 156
  8. 2023Knowledge Graph Prompting for Multi-Document Question Answeringcited by 152
  9. 2022Rethinking with Retrieval: Faithful Large Language Model Inferencecited by 145
  10. 2020Domain-specific Knowledge Graphs: A surveycited by 68
  11. 2023Graph Neural Prompting with Large Language Modelscited by 64
  12. 2023A Comprehensive Survey on Automatic Knowledge Graph Constructioncited by 63
  13. 2021One Question Answering Model for Many Languages with Cross-lingual Dense Passage Retrievalcited by 46
  14. 2019Improving Question Answering over Incomplete KBs with Knowledge-Aware Readercited by 37
  15. 2022WikiWhy: Answering and Explaining Cause-and-Effect Questionscited by 21
  16. 2023Normalizing Flow-based Neural Process for Few-Shot Knowledge Graph Completioncited by 19

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 4; 2025: 9; 2026: 4.

17 papers.

Sort:

By area:

  1. 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 281
  2. 2025A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Modelscited by 88
  3. 2024Scaling Knowledge Graph Construction through Synthetic Data Generation and Distillationcited by 6
  4. 2025KEA Explain: Explanations of Hallucinations using Graph Kernel Analysiscited by 3
  5. 2025Structuring the Unstructured: A Systematic Review of Text-to-Structure Generation for Agentic AI with a Universal Evaluation Frameworkcited by 2
  6. 2026Guideline2Graph: Profile-Aware Multimodal Parsing for Executable Clinical Decision Graphscited by 2
  7. 2024Towards Versatile Graph Learning Approach: from the Perspective of Large Language Modelscited by 1
  8. 2025Agentic-KGR: Co-evolutionary Knowledge Graph Construction through Multi-Agent Reinforcement Learningcited by 1
  9. 2026DIAL-KG: Schema-Free Incremental Knowledge Graph Construction via Dynamic Schema Induction and Evolution-Intent Assessmentcited by 1
  10. 2024Narrative Analysis of True Crime Podcasts With Knowledge Graph-Augmented Large Language Modelscited by 0
  11. 2025SCRIBES: Web-Scale Script-Based Semi-Structured Data Extraction with Reinforcement Learningcited by 0
  12. 2025Graph-Guided Concept Selection for Efficient Retrieval-Augmented Generationcited by 0
5 more
  1. 2025OpenGloss: A Synthetic Encyclopedic Dictionary and Semantic Knowledge Graphcited by 0
  2. 2025VisKnow: Constructing Visual Knowledge Base for Object Understandingcited by 0
  3. 2025EmeraldMind: A Knowledge Graph-Augmented Framework for Greenwashing Detectioncited by 0
  4. 2026GraphDx: A Cost-Aware Knowledge-Enhanced Multi-Agent Framework for Sequential Diagnosiscited by 0
  5. 2026EGT-KG: Evidence-Grounded Typed KG Retrieval for Practical Scientific QA with Small Language Modelscited by 0