Ontology-Free General-Domain Knowledge Graph-to-Text Generation Dataset Synthesis using Large Language Model
Not on the map. Why?
Abstract (arXiv)
Knowledge Graph-to-Text (G2T) generation involves verbalizing structured knowledge graphs into natural language text. Recent advancements in Pretrained Language Models (PLMs) have improved G2T performance, but their effectiveness depends on datasets with precise graph-text alignment. However, the scarcity of high-quality, general-domain G2T generation datasets restricts progress in the general-domain G2T generation research. To address this issue, we introduce Wikipedia Ontology-Free Graph-text dataset (WikiOFGraph), a new large-scale G2T dataset generated using a novel method that leverages Large Language Model (LLM) and Data-QuestEval. Our new dataset, which contains 5.85M general-domain graph-text pairs, offers high graph-text consistency without relying on external ontologies. Experimental results demonstrate that PLM fine-tuned on WikiOFGraph outperforms those trained on other datasets across various evaluation metrics. Our method proves to be a scalable and effective solution for generating high-quality G2T data, significantly advancing the field of G2T generation.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 36 of its 60 references that are in the map. First posted on arXiv 11 Sep 2024.
Builds on
36 of 60 references.
References · 36
- 2017Attention Is All You Needcited by 59,932
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2019The Curious Case of Neural Text Degenerationcited by 2,881
- 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,196
- 2024On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Surveycited by 240
- 2017Challenges in Data-to-Document Generationcited by 226
- 2017Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluationcited by 206
- 2020DART: Open-Domain Structured Data Record to Text Generationcited by 144
24 more
- 2019Text Generation from Knowledge Graphs with Graph Transformerscited by 122
- 2020Investigating Pretrained Language Models for Graph-to-Text Generationcited by 117
- 2018Data-to-Text Generation with Content Selection and Planningcited by 106
- 2020Text-to-Text Pre-Training for Data-to-Text Taskscited by 104
- 2023Exploiting Asymmetry for Synthetic Training Data Generation: SynthIE and the Case of Information Extractioncited by 89
- 2018Graph-to-Sequence Learning using Gated Graph Neural Networkscited by 61
- 2018Learning Neural Templates for Text Generationcited by 61
- 2023PiVe: Prompting with Iterative Verification Improving Graph-based Generative Capability of LLMscited by 44
- 2024Data Augmentation using Large Language Models: Data Perspectives, Learning Paradigms and Challengescited by 30
- 2021Data-QuestEval: A Referenceless Metric for Data-to-Text Semantic Evaluationcited by 21
- 2021WikiGraphs: A Wikipedia Text - Knowledge Graph Paired Datasetcited by 20
- 2021Improving Compositional Generalization with Self-Training for Data-to-Text Generationcited by 19
- 2022Neural Pipeline for Zero-Shot Data-to-Text Generationcited by 19
- 2019Learning to Select, Track, and Generate for Data-to-Textcited by 14
- 2022ASDOT: Any-Shot Data-to-Text Generation with Pretrained Language Modelscited by 14
- 2024Unifying Structured Data as Graph for Data-to-Text Pre-Trainingcited by 13
- 2020Data-to-Text Generation with Iterative Text Editingcited by 11
- 2021Search and Learn: Improving Semantic Coverage for Data-to-Text Generationcited by 8
- 2022What Makes Data-to-Text Generation Hard for Pretrained Language Models?cited by 8
- 2022Self-supervised Graph Masking Pre-training for Graph-to-Text Generationcited by 8
- 2024ABEX: Data Augmentation for Low-Resource NLU via Expanding Abstract Descriptionscited by 8
- 2022Mind the Labels: Describing Relations in Knowledge Graphs With Pretrained Modelscited by 6
- 2023Construction of Paired Knowledge Graph-Text Datasets Informed by Cyclic Evaluationcited by 6
- 2023ASPIRO: Any-shot Structured Parsing-error-Induced ReprOmpting for Consistent Data-to-Text Generationcited by 2
Built on by
Citing papers per year: 2025: 2.
2 papers.