mlsanityData to 14 Oct 2026

Knowledge Graph Generation From Text

arXiv 2211.10511 ↗First posted 18 Nov 2022cs.CL cs.LGcited by 15

Not on the map. Why?

Abstract (arXiv)

In this work we propose a novel end-to-end multi-stage Knowledge Graph (KG) generation system from textual inputs, separating the overall process into two stages. The graph nodes are generated first using pretrained language model, followed by a simple edge construction head, enabling efficient KG extraction from the text. For each stage we consider several architectural choices that can be used depending on the available training resources. We evaluated the model on a recent WebNLG 2020 Challenge dataset, matching the state-of-the-art performance on text-to-RDF generation task, as well as on New York Times (NYT) and a large-scale TekGen datasets, showing strong overall performance, outperforming the existing baselines. We believe that the proposed system can serve as a viable KG construction alternative to the existing linearization or sampling-based graph generation approaches. Our code can be found at https://github.com/IBM/Grapher

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 19 of its 34 references that are in the map. First posted on arXiv 18 Nov 2022.

Builds on

19 of 34 references.

References · 19

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2020End-to-End Object Detection with Transformerscited by 7,414
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  6. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  7. 2019Language Models as Knowledge Bases?cited by 1,936
  8. 2019How Can We Know What Language Models Know?cited by 959
  9. 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 719
  10. 2018GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Modelscited by 413
  11. 2019KG-BERT: BERT for Knowledge Graph Completioncited by 324
  12. 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
7 more
  1. 2022Unified Structure Generation for Universal Information Extractioncited by 221
  2. 2020Investigating Pretrained Language Models for Graph-to-Text Generationcited by 117
  3. 2020Language Models are Open Knowledge Graphscited by 95
  4. 2019Commonsense Knowledge Base Completion with Structural and Semantic Contextcited by 61
  5. 2020CycleGT: Unsupervised Graph-to-Text and Text-to-Graph Generation via Cycle Trainingcited by 38
  6. 2021ReGen: Reinforcement Learning for Text and Knowledge Base Generation using Pretrained Language Modelscited by 16
  7. 2020DualTKB: A Dual Learning Bridge between Text and Knowledge Basecited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 4; 2024: 6; 2025: 4; 2026: 1.

15 papers.

Sort:

By area: