Compositional Generalization for Data-to-Text Generation
Not on the map. Why?
Abstract (arXiv)
Data-to-text generation involves transforming structured data, often represented as predicate-argument tuples, into coherent textual descriptions. Despite recent advances, systems still struggle when confronted with unseen combinations of predicates, producing unfaithful descriptions (e.g. hallucinations or omissions). We refer to this issue as compositional generalisation, and it encouraged us to create a benchmark for assessing the performance of different approaches on this specific problem. Furthermore, we propose a novel model that addresses compositional generalization by clustering predicates into groups. Our model generates text in a sentence-by-sentence manner, relying on one cluster of predicates at a time. This approach significantly outperforms T5~baselines across all evaluation metrics.Notably, it achieved a 31% improvement over T5 in terms of a metric focused on maintaining faithfulness to the input.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 29 of its 42 references that are in the map. First posted on arXiv 5 Dec 2023.
Builds on
29 of 42 references.
References · 29
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,031
- 2016Deep Reinforcement Learning for Dialogue Generationcited by 286
- 2020ToTTo: A Controlled Table-To-Text Generation Datasetcited by 267
- 2017The E2E Dataset: New Challenges For End-to-End Generationcited by 252
- 2017Challenges in Data-to-Document Generationcited by 226
- 2019Good-Enough Compositional Data Augmentationcited by 158
- 2019Revisiting Self-Training for Neural Sequence Generationcited by 154
- 2015Semantically Conditioned LSTM-based Natural Language Generation for Spoken Dialogue Systemscited by 134
- 2019Handling Divergent Reference Texts when Evaluating Table-to-Text Generationcited by 119
- 2020Investigating Pretrained Language Models for Graph-to-Text Generationcited by 117
- 2020Text-to-Text Pre-Training for Data-to-Text Taskscited by 104
17 more
- 2017Structured Attention Networkscited by 95
- 2020Few-shot Natural Language Generation for Task-Oriented Dialogcited by 89
- 2019Evaluating the State-of-the-Art of End-to-End Natural Language Generation: The E2E NLG Challengecited by 86
- 2019Step-by-Step: Separating Planning from Realization in Neural Data-to-Text Generationcited by 75
- 2019Semantic Noise Matters for Neural Natural Language Generationcited by 64
- 2021Plan-then-Generate: Controlled Data-to-Text Generation via Planningcited by 52
- 2020Evaluating Semantic Accuracy of Data-to-Text Generation with Natural Language Inferencecited by 43
- 2018Latent Alignment and Variational Attentioncited by 36
- 2023Using Large Language Models for Zero-Shot Natural Language Generation from Knowledge Graphscited by 24
- 2021Improving Compositional Generalization with Self-Training for Data-to-Text Generationcited by 19
- 2016Multi-domain Neural Network Language Generation for Spoken Dialogue Systemscited by 18
- 2021AUGNLG: Few-shot Natural Language Generation using Self-trained Data Augmentationcited by 17
- 2023Evaluating Generative Models for Graph-to-Text Generationcited by 16
- 2018Can Neural Generators for Dialogue Learn Sentence Planning and Discourse Structuring?cited by 12
- 2015Reinforcement Learning Neural Turing Machines - Revisedcited by 11
- 2023ChatGPT as Data Augmentation for Compositional Generalization: A Case Study in Open Intent Detectioncited by 9
- 2022Curriculum-Based Self-Training Makes Better Few-Shot Learners for Data-to-Text Generationcited by 2
Built on by
Citing papers per year: 2024: 1.
1 paper.