Few-Shot Table-to-Text Generation with Prompt Planning and Knowledge Memorization
Not on the map. Why?
Abstract (arXiv)
Pre-trained language models (PLM) have achieved remarkable advancement in table-to-text generation tasks. However, the lack of labeled domain-specific knowledge and the topology gap between tabular data and text make it difficult for PLMs to yield faithful text. Low-resource generation likewise faces unique challenges in this domain. Inspired by how humans descript tabular data with prior knowledge, we suggest a new framework: PromptMize, which targets table-to-text generation under few-shot settings. The design of our framework consists of two aspects: a prompt planner and a knowledge adapter. The prompt planner aims to generate a prompt signal that provides instance guidance for PLMs to bridge the topology gap between tabular data and text. Moreover, the knowledge adapter memorizes domain-specific knowledge from the unlabelled corpus to supply essential information during generation. Extensive experiments and analyses are investigated on three open domain few-shot NLG datasets: human, song, and book. Compared with previous state-of-the-art approaches, our model achieves remarkable performance in generating quality as judged by human and automatic evaluations.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 33 of its 46 references that are in the map. First posted on arXiv 9 Feb 2023.
Builds on
33 of 46 references.
References · 33
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 552
- 2020AdapterHub: A Framework for Adapting Transformerscited by 441
- 2020K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapterscited by 318
- 2020ToTTo: A Controlled Table-To-Text Generation Datasetcited by 267
- 2017The E2E Dataset: New Challenges For End-to-End Generationcited by 252
- 2017Challenges in Data-to-Document Generationcited by 226
21 more
- 2017Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluationcited by 206
- 2020Open Question Answering over Tables and Textcited by 163
- 2017A Knowledge-Grounded Neural Conversation Modelcited by 136
- 2019Handling Divergent Reference Texts when Evaluating Table-to-Text Generationcited by 119
- 2017Learning Symmetric Collaborative Dialogue Agents with Dynamic Knowledge Graph Embeddingscited by 59
- 2017Table-to-text Generation by Structure-aware Seq2seq Learningcited by 54
- 2019Few-Shot NLG with Pre-Trained Language Modelcited by 52
- 2021Plan-then-Generate: Controlled Data-to-Text Generation via Planningcited by 52
- 2018Response Generation by Context-aware Prototype Editingcited by 40
- 2019Meta-Learning for Low-resource Natural Language Generation in Task-oriented Dialogue Systemscited by 25
- 2021Few-Shot Table-to-Text Generation with Prototype Memorycited by 21
- 2019Key Fact as Pivot: A Two-Stage Model for Low Resource Table-to-Text Generationcited by 20
- 2018Zero-Shot Question Generation from Knowledge Graphs for Unseen Predicates and Entity Typescited by 17
- 2021AUGNLG: Few-shot Natural Language Generation using Self-trained Data Augmentationcited by 17
- 2019Learning to Select, Track, and Generate for Data-to-Textcited by 14
- 2021Knowledge-Aware Meta-learning for Low-Resource Text Classificationcited by 10
- 2022Injecting Domain Knowledge in Language Models for Task-Oriented Dialogue Systemscited by 6
- 2022Attend, Memorize and Generate: Towards Faithful Table-to-Text Generation in Few Shotscited by 5
- 2018Dual Latent Variable Model for Low-Resource Natural Language Generation in Dialogue Systemscited by 4
- 2018Variational Cross-domain Natural Language Generation for Spoken Dialogue Systemscited by 3
- 2022Few-Shot Table-to-Text Generation with Prefix-Controlled Generatorcited by 3
Built on by
Citing papers per year: 2023: 2.
2 papers.