Knowledge Graph Generation From Text
Not on the map. Why?
Abstract (arXiv)
In this work we propose a novel end-to-end multi-stage Knowledge Graph (KG) generation system from textual inputs, separating the overall process into two stages. The graph nodes are generated first using pretrained language model, followed by a simple edge construction head, enabling efficient KG extraction from the text. For each stage we consider several architectural choices that can be used depending on the available training resources. We evaluated the model on a recent WebNLG 2020 Challenge dataset, matching the state-of-the-art performance on text-to-RDF generation task, as well as on New York Times (NYT) and a large-scale TekGen datasets, showing strong overall performance, outperforming the existing baselines. We believe that the proposed system can serve as a viable KG construction alternative to the existing linearization or sampling-based graph generation approaches. Our code can be found at https://github.com/IBM/Grapher
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 19 of its 34 references that are in the map. First posted on arXiv 18 Nov 2022.
Builds on
19 of 34 references.
References · 19
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2019Language Models as Knowledge Bases?cited by 1,936
- 2019How Can We Know What Language Models Know?cited by 959
- 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 719
- 2018GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Modelscited by 413
- 2019KG-BERT: BERT for Knowledge Graph Completioncited by 324
- 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
7 more
- 2022Unified Structure Generation for Universal Information Extractioncited by 221
- 2020Investigating Pretrained Language Models for Graph-to-Text Generationcited by 117
- 2020Language Models are Open Knowledge Graphscited by 95
- 2019Commonsense Knowledge Base Completion with Structural and Semantic Contextcited by 61
- 2020CycleGT: Unsupervised Graph-to-Text and Text-to-Graph Generation via Cycle Trainingcited by 38
- 2021ReGen: Reinforcement Learning for Text and Knowledge Base Generation using Pretrained Language Modelscited by 16
- 2020DualTKB: A Dual Learning Bridge between Text and Knowledge Basecited by 9
Built on by
Citing papers per year: 2023: 4; 2024: 6; 2025: 4; 2026: 1.
15 papers.
Sort:
By area:
- 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTcited by 224
- 2024Extract, Define, Canonicalize: An LLM-based Framework for Knowledge Graph Constructioncited by 70
- 2024Set-Aligning Framework for Auto-Regressive Event Temporal Graph Generationcited by 8
- 2024Any2Graph: Deep End-To-End Supervised Graph Prediction With An Optimal Transport Losscited by 7
- 2025Automatic Prompt Optimization for Knowledge Graph Construction: Insights from an Empirical Studycited by 6
- 2024Cascading Large Language Models for Salient Event Graph Generationcited by 3
- 2025Evaluating Multi-Hop Reasoning in Large Language Models: A Chemistry-Centric Case Studycited by 3
- 2024AIDE: Attribute-Guided MultI-Hop Data Expansion for Data Scarcity in Task-Specific Fine-tuningcited by 2
- 2024MedG-KRP: Medical Graph Knowledge Representation Probingcited by 2
- 2023Massively Multilingual Language Models for Cross Lingual Fact Extraction from Low Resource Indian Languagescited by 1
- 2023Form follows Function: Text-to-Text Conditional Graph Generation based on Functional Requirementscited by 1
- 2023RECAP-KG: Mining Knowledge Graphs from Raw GP Notes for Remote COVID-19 Assessment in Primary Carecited by 0
- 2026Fine-Grained Graph Generation through Latent Mixture Scheduling4 May 2026
- 2025Systematic Evaluation of Knowledge Graph Repair with Large Language Models30 Jul 2025
- 2025Automatic Prompt Optimization for Knowledge Graph Construction: Insights from an Empirical Study24 Jun 2025
- 2025Evaluating Multi-Hop Reasoning in Large Language Models: A Chemistry-Centric Case Study23 Apr 2025
- 2025Evaluating and Improving Graph to Text Generation with Large Language Models24 Jan 2025
- 2024MedG-KRP: Medical Graph Knowledge Representation Probing14 Dec 2024
- 2024AIDE: Attribute-Guided MultI-Hop Data Expansion for Data Scarcity in Task-Specific Fine-tuning9 Dec 2024
- 2024Cascading Large Language Models for Salient Event Graph Generation26 Jun 2024
- 2024Extract, Define, Canonicalize: An LLM-based Framework for Knowledge Graph Construction5 Apr 2024
- 2024Set-Aligning Framework for Auto-Regressive Event Temporal Graph Generation1 Apr 2024
- 2024Any2Graph: Deep End-To-End Supervised Graph Prediction With An Optimal Transport Loss19 Feb 2024
- 2023Form follows Function: Text-to-Text Conditional Graph Generation based on Functional Requirements1 Nov 2023
3 more
- 2023RECAP-KG: Mining Knowledge Graphs from Raw GP Notes for Remote COVID-19 Assessment in Primary Care17 Jun 2023
- 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT7 Mar 2023
- 2023Massively Multilingual Language Models for Cross Lingual Fact Extraction from Low Resource Indian Languages9 Feb 2023
- 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTcited by 224
- 2024Extract, Define, Canonicalize: An LLM-based Framework for Knowledge Graph Constructioncited by 70
- 2024Set-Aligning Framework for Auto-Regressive Event Temporal Graph Generationcited by 8
- 2024Any2Graph: Deep End-To-End Supervised Graph Prediction With An Optimal Transport Losscited by 7
- 2025Automatic Prompt Optimization for Knowledge Graph Construction: Insights from an Empirical Studycited by 6
- 2024Cascading Large Language Models for Salient Event Graph Generationcited by 3
- 2024AIDE: Attribute-Guided MultI-Hop Data Expansion for Data Scarcity in Task-Specific Fine-tuningcited by 2
- 2024MedG-KRP: Medical Graph Knowledge Representation Probingcited by 2
- 2023Massively Multilingual Language Models for Cross Lingual Fact Extraction from Low Resource Indian Languagescited by 1
- 2023Form follows Function: Text-to-Text Conditional Graph Generation based on Functional Requirementscited by 1
- 2023RECAP-KG: Mining Knowledge Graphs from Raw GP Notes for Remote COVID-19 Assessment in Primary Carecited by 0
- 2025Evaluating and Improving Graph to Text Generation with Large Language Modelscited by 0
12 most cited of 14 All 14 (JSON)
- 2026Fine-Grained Graph Generation through Latent Mixture Scheduling4 May 2026
- 2025Systematic Evaluation of Knowledge Graph Repair with Large Language Models30 Jul 2025
- 2025Automatic Prompt Optimization for Knowledge Graph Construction: Insights from an Empirical Study24 Jun 2025
- 2025Evaluating and Improving Graph to Text Generation with Large Language Models24 Jan 2025
- 2024MedG-KRP: Medical Graph Knowledge Representation Probing14 Dec 2024
- 2024AIDE: Attribute-Guided MultI-Hop Data Expansion for Data Scarcity in Task-Specific Fine-tuning9 Dec 2024
- 2024Cascading Large Language Models for Salient Event Graph Generation26 Jun 2024
- 2024Extract, Define, Canonicalize: An LLM-based Framework for Knowledge Graph Construction5 Apr 2024
- 2024Set-Aligning Framework for Auto-Regressive Event Temporal Graph Generation1 Apr 2024
- 2024Any2Graph: Deep End-To-End Supervised Graph Prediction With An Optimal Transport Loss19 Feb 2024
- 2023Form follows Function: Text-to-Text Conditional Graph Generation based on Functional Requirements1 Nov 2023
- 2023RECAP-KG: Mining Knowledge Graphs from Raw GP Notes for Remote COVID-19 Assessment in Primary Care17 Jun 2023
12 newest of 14 All 14 (JSON)