Syntax Controlled Knowledge Graph-to-Text Generation with Order and Semantic Consistency
Not on the map. Why?
Abstract (arXiv)
The knowledge graph (KG) stores a large amount of structural knowledge, while it is not easy for direct human understanding. Knowledge graph-to-text (KG-to-text) generation aims to generate easy-to-understand sentences from the KG, and at the same time, maintains semantic consistency between generated sentences and the KG. Existing KG-to-text generation methods phrase this task as a sequence-to-sequence generation task with linearized KG as input and consider the consistency issue of the generated texts and KG through a simple selection between decoded sentence word and KG node word at each time step. However, the linearized KG order is commonly obtained through a heuristic search without data-driven optimization. In this paper, we optimize the knowledge description order prediction under the order supervision extracted from the caption and further enhance the consistency of the generated sentences and KG through syntactic and semantic regularization. We incorporate the Part-of-Speech (POS) syntactic tags to constrain the positions to copy words from the KG and employ a semantic context scoring function to evaluate the semantic fitness for each word in its local context when decoding each word in the generated sentence. Extensive experiments are conducted on two datasets, WebNLG and DART, and achieve state-of-the-art performances.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 40 references that are in the map. First posted on arXiv 2 Jul 2022.
Builds on
24 of 40 references.
References · 24
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
- 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,196
- 2018Self-Attention with Relative Position Representationscited by 1,112
- 2019MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distancecited by 415
- 2019Knowledge Enhanced Contextual Word Representationscited by 294
- 2020DART: Open-Domain Structured Data Record to Text Generationcited by 144
- 2019Text Generation from Knowledge Graphs with Graph Transformerscited by 122
12 more
- 2020Investigating Pretrained Language Models for Graph-to-Text Generationcited by 117
- 2021Learning Intents behind Interactions with Knowledge Graph for Recommendationcited by 94
- 2018Show, Control and Tell: A Framework for Generating Controllable and Grounded Captionscited by 65
- 2021JointGT: Graph-Text Joint Representation Learning for Text Generation from Knowledge Graphscited by 58
- 2019Few-Shot NLG with Pre-Trained Language Modelcited by 52
- 2019Neural data-to-text generation: A comparison between pipeline and end-to-end architecturescited by 51
- 2021Structural Adapters in Pretrained Language Models for AMR-to-text Generationcited by 48
- 2020Modeling Global and Local Node Contexts for Text Generation from Knowledge Graphscited by 30
- 2021Few-shot Knowledge Graph-to-Text Generation with Pretrained Language Modelscited by 29
- 2018Deep Graph Convolutional Encoders for Structured Data to Text Generationcited by 27
- 2020Promoting Graph Awareness in Linearized Graph-to-Text Generationcited by 14
- 2021The Role of Syntactic Planning in Compositional Image Captioningcited by 12
Built on by
Citing papers per year: 2025: 1.
1 paper.