Plan-then-Generate: Controlled Data-to-Text Generation via Planning
Not on the map. Why?
Abstract (arXiv)
Recent developments in neural networks have led to the advance in data-to-text generation. However, the lack of ability of neural models to control the structure of generated output can be limiting in certain real-world applications. In this study, we propose a novel Plan-then-Generate (PlanGen) framework to improve the controllability of neural data-to-text models. Extensive experiments and analyses are conducted on two benchmark datasets, ToTTo and WebNLG. The results show that our model is able to control both the intra-sentence and inter-sentence structure of the generated output. Furthermore, empirical comparisons against previous state-of-the-art methods show that our model improves the generation quality as well as the output diversity as judged by human and automatic evaluations.
Key facts. Cited by 52 papers in the map (data through 14 Oct 2026). Builds on 31 of its 55 references that are in the map. First posted on arXiv 31 Aug 2021.
Builds on
31 of 55 references.
References · 31
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2019The Curious Case of Neural Text Degenerationcited by 2,916
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,292
- 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,203
- 2018Hierarchical Neural Story Generationcited by 1,193
- 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 491
- 2020ToTTo: A Controlled Table-To-Text Generation Datasetcited by 268
- 2017The E2E Dataset: New Challenges For End-to-End Generationcited by 253
19 more
- 2017Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluationcited by 206
- 2019Leveraging Pre-trained Checkpoints for Sequence Generation Taskscited by 182
- 2020Open Question Answering over Tables and Textcited by 163
- 2019Handling Divergent Reference Texts when Evaluating Table-to-Text Generationcited by 119
- 2020Investigating Pretrained Language Models for Graph-to-Text Generationcited by 117
- 2018Data-to-Text Generation with Content Selection and Planningcited by 106
- 2020Text-to-Text Pre-Training for Data-to-Text Taskscited by 104
- 2019Step-by-Step: Separating Planning from Realization in Neural Data-to-Text Generationcited by 75
- 2018Learning Neural Templates for Text Generationcited by 61
- 2017Table-to-text Generation by Structure-aware Seq2seq Learningcited by 54
- 2019Few-Shot NLG with Pre-Trained Language Modelcited by 52
- 2019Neural data-to-text generation: A comparison between pipeline and end-to-end architecturescited by 51
- 2019Data-to-text Generation with Entity Modelingcited by 45
- 2021Non-Autoregressive Text Generation with Pre-trained Language Modelscited by 36
- 2021Few-Shot Table-to-Text Generation with Prototype Memorycited by 21
- 2018End-to-End Content and Plan Selection for Data-to-Text Generationcited by 20
- 2019Key Fact as Pivot: A Two-Stage Model for Low Resource Table-to-Text Generationcited by 20
- 2020Variational Template Machine for Data-to-Text Generationcited by 19
- 2016Multi-domain Neural Network Language Generation for Spoken Dialogue Systemscited by 18
Built on by
Citing papers per year: 2021: 3; 2022: 18; 2023: 19; 2024: 9; 2025: 2; 2026: 1.
52 papers.
Sort:
By area:
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
- 2022A Contrastive Framework for Neural Text Generationcited by 225
- 2022Factuality Enhanced Language Models for Open-Ended Text Generationcited by 202
- 2022Chart-to-Text: A Large-Scale Benchmark for Chart Summarizationcited by 169
- 2021Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue Systemcited by 139
- 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Modelscited by 129
- 2022Language Models Can See: Plugging Visual Controls in Text Generationcited by 90
- 2022Automatic Generation of Socratic Subquestions for Teaching Math Word Problemscited by 43
- 2023ORGAN: Observation-Guided Radiology Report Generation via Tree Reasoningcited by 42
- 2021TaCL: Improving BERT Pre-training with Token-aware Contrastive Learningcited by 32
- 2022Robust (Controlled) Table-to-Text Generation with Structure-Aware Equivariance Learningcited by 32
38 more
- 2021Control Prefixes for Parameter-Efficient Text Generationcited by 24
- 2022Neural Pipeline for Zero-Shot Data-to-Text Generationcited by 19
- 2022GAP: A Graph-aware Language Model Framework for Knowledge Graph-to-Text Generationcited by 16
- 2022MVP: Multi-task Supervised Pre-training for Natural Language Generationcited by 16
- 2023Summaries as Captions: Generating Figure Captions for Scientific Documents with Automated Text Summarizationcited by 14
- 2023Dialogue Planning via Brownian Bridge Stochastic Process for Goal-directed Proactive Dialoguecited by 14
- 2024Unifying Structured Data as Graph for Data-to-Text Pre-Trainingcited by 13
- 2023Stylized Data-to-Text Generation: A Case Study in the E-Commerce Domaincited by 11
- 2023LoFT: Enhancing Faithfulness and Diversity for Table-to-Text Generation via Logic Form Controlcited by 8
- 2022MURMUR: Modular Multi-Step Reasoning for Semi-Structured Data-to-Text Generationcited by 7
- 2023Toward Unified Controllable Text Generation via Regular Expression Instructioncited by 7
- 2022Optimization Techniques for Unsupervised Complex Table Reasoning via Self-Training Frameworkcited by 6
- 2023Improving User Controlled Table-To-Text Generation Robustnesscited by 6
- 2023PixT3: Pixel-based Table-To-Text Generationcited by 6
- 2024A Comparative Analysis of Conversational Large Language Models in Knowledge-Based Text Generationcited by 6
- 2024Target-constrained Bidirectional Planning for Generation of Target-oriented Proactive Dialoguecited by 6
- 2022Plug-and-Play Recipe Generation with Content Planningcited by 5
- 2023Advancing Precise Outline-Conditioned Text Generation with Task Duality and Explicit Outline Controlcited by 5
- 2023Generating Faithful Text From a Knowledge Graph with Noisy Reference Textcited by 4
- 2022Few-Shot Table-to-Text Generation with Prefix-Controlled Generatorcited by 3
- 2023ReTAG: Reasoning Aware Table to Analytic Text Generationcited by 3
- 2024Improving Factual Accuracy of Neural Table-to-Text Output by Addressing Input Problems in ToTTocited by 3
- 2022Lexical Complexity Controlled Sentence Generationcited by 2
- 2023Few-Shot Table-to-Text Generation with Prompt Planning and Knowledge Memorizationcited by 2
- 2023Plan-then-Seam: Towards Efficient Table-to-Text Generationcited by 2
- 2023Adapting Knowledge for Few-shot Table-to-Text Generationcited by 2
- 2023Controlling keywords and their positions in text generationcited by 2
- 2023You Can Generate It Again: Data-to-Text Generation with Verification and Correction Promptingcited by 2
- 2023Optimizing Factual Accuracy in Text Generation through Dynamic Knowledge Selectioncited by 2
- 2023Automatic Logical Forms improve fidelity in Table-to-Text generationcited by 2
- 2024Satyrn: A Platform for Analytics Augmented Generationcited by 2
- 2023Compositional Generalization for Data-to-Text Generationcited by 1
- 2024Impact of Model Size on Fine-tuned LLM Performance in Data-to-Text Generation: A State-of-the-Art Investigationcited by 1
- 2025Alternatives To Next Token Prediction In Text Generation -- A Surveycited by 1
- 2022High Recall Data-to-text Generation with Progressive Editcited by 0
- 2024Inroads to a Structured Data Natural Language Bijection and the role of LLM annotationcited by 0
- 2024Self-training from Self-memory in Data-to-text Generationcited by 0
- 2024Table-to-Text Generation with Pretrained Diffusion Modelscited by 0
50 most cited of 52 All 52 (JSON)
- 2026Conversational Control with Ontologies for Large Language Models: A Lightweight Framework for Constrained Generation6 Apr 2026
- 2025Alternatives To Next Token Prediction In Text Generation -- A Survey29 Sep 2025
- 2025Evo-DKD: Dual-Knowledge Decoding for Autonomous Ontology Evolution in Large Language Models29 Jul 2025
- 2024Table-to-Text Generation with Pretrained Diffusion Models10 Sep 2024
- 2024Impact of Model Size on Fine-tuned LLM Performance in Data-to-Text Generation: A State-of-the-Art Investigation19 Jul 2024
- 2024Satyrn: A Platform for Analytics Augmented Generation17 Jun 2024
- 2024Improving Factual Accuracy of Neural Table-to-Text Output by Addressing Input Problems in ToTTo5 Apr 2024
- 2024Target-constrained Bidirectional Planning for Generation of Target-oriented Proactive Dialogue10 Mar 2024
- 2024A Comparative Analysis of Conversational Large Language Models in Knowledge-Based Text Generation2 Feb 2024
- 2024Self-training from Self-memory in Data-to-text Generation19 Jan 2024
- 2024Inroads to a Structured Data Natural Language Bijection and the role of LLM annotation14 Jan 2024
- 2024Unifying Structured Data as Graph for Data-to-Text Pre-Training2 Jan 2024
38 more
- 2023Compositional Generalization for Data-to-Text Generation5 Dec 2023
- 2023PixT3: Pixel-based Table-To-Text Generation16 Nov 2023
- 2023Automatic Logical Forms improve fidelity in Table-to-Text generation26 Oct 2023
- 2023Toward Unified Controllable Text Generation via Regular Expression Instruction19 Sep 2023
- 2023Optimizing Factual Accuracy in Text Generation through Dynamic Knowledge Selection30 Aug 2023
- 2023Generating Faithful Text From a Knowledge Graph with Noisy Reference Text12 Aug 2023
- 2023You Can Generate It Again: Data-to-Text Generation with Verification and Correction Prompting28 Jun 2023
- 2023ORGAN: Observation-Guided Radiology Report Generation via Tree Reasoning10 Jun 2023
- 2023Advancing Precise Outline-Conditioned Text Generation with Task Duality and Explicit Outline Control23 May 2023
- 2023ReTAG: Reasoning Aware Table to Analytic Text Generation19 May 2023
- 2023Dialogue Planning via Brownian Bridge Stochastic Process for Goal-directed Proactive Dialogue9 May 2023
- 2023Stylized Data-to-Text Generation: A Case Study in the E-Commerce Domain5 May 2023
- 2023Controlling keywords and their positions in text generation19 Apr 2023
- 2023Adapting Knowledge for Few-shot Table-to-Text Generation24 Feb 2023
- 2023Summaries as Captions: Generating Figure Captions for Scientific Documents with Automated Text Summarization23 Feb 2023
- 2023Improving User Controlled Table-To-Text Generation Robustness20 Feb 2023
- 2023Plan-then-Seam: Towards Efficient Table-to-Text Generation10 Feb 2023
- 2023Few-Shot Table-to-Text Generation with Prompt Planning and Knowledge Memorization9 Feb 2023
- 2023LoFT: Enhancing Faithfulness and Diversity for Table-to-Text Generation via Logic Form Control6 Feb 2023
- 2022Optimization Techniques for Unsupervised Complex Table Reasoning via Self-Training Framework20 Dec 2022
- 2022MURMUR: Modular Multi-Step Reasoning for Semi-Structured Data-to-Text Generation16 Dec 2022
- 2022Plug-and-Play Recipe Generation with Content Planning9 Dec 2022
- 2022Lexical Complexity Controlled Sentence Generation26 Nov 2022
- 2022Automatic Generation of Socratic Subquestions for Teaching Math Word Problems23 Nov 2022
- 2022Few-Shot Table-to-Text Generation with Prefix-Controlled Generator23 Aug 2022
- 2022High Recall Data-to-text Generation with Progressive Edit9 Aug 2022
- 2022MVP: Multi-task Supervised Pre-training for Natural Language Generation24 Jun 2022
- 2022Factuality Enhanced Language Models for Open-Ended Text Generation9 Jun 2022
- 2022Robust (Controlled) Table-to-Text Generation with Structure-Aware Equivariance Learning8 May 2022
- 2022Language Models Can See: Plugging Visual Controls in Text Generation5 May 2022
- 2022GAP: A Graph-aware Language Model Framework for Knowledge Graph-to-Text Generation13 Apr 2022
- 2022Neural Pipeline for Zero-Shot Data-to-Text Generation30 Mar 2022
- 2022Chart-to-Text: A Large-Scale Benchmark for Chart Summarization12 Mar 2022
- 2022A Contrastive Framework for Neural Text Generation13 Feb 2022
- 2022Survey of Hallucination in Natural Language Generation8 Feb 2022
- 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Models16 Jan 2022
- 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Models14 Jan 2022
- 2021TaCL: Improving BERT Pre-training with Token-aware Contrastive Learning7 Nov 2021
50 newest of 52 All 52 (JSON)
- 2024Table-to-Text Generation with Pretrained Diffusion Models10 Sep 2024
- 2024Satyrn: A Platform for Analytics Augmented Generationcited by 2
- 2024Satyrn: A Platform for Analytics Augmented Generation17 Jun 2024
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
- 2022A Contrastive Framework for Neural Text Generationcited by 225
- 2022Factuality Enhanced Language Models for Open-Ended Text Generationcited by 202
- 2022Chart-to-Text: A Large-Scale Benchmark for Chart Summarizationcited by 169
- 2021Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue Systemcited by 139
- 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Modelscited by 129
- 2022Language Models Can See: Plugging Visual Controls in Text Generationcited by 90
- 2022Automatic Generation of Socratic Subquestions for Teaching Math Word Problemscited by 43
- 2023ORGAN: Observation-Guided Radiology Report Generation via Tree Reasoningcited by 42
- 2021TaCL: Improving BERT Pre-training with Token-aware Contrastive Learningcited by 32
- 2022Robust (Controlled) Table-to-Text Generation with Structure-Aware Equivariance Learningcited by 32
12 most cited of 49 All 49 (JSON)
- 2026Conversational Control with Ontologies for Large Language Models: A Lightweight Framework for Constrained Generation6 Apr 2026
- 2025Alternatives To Next Token Prediction In Text Generation -- A Survey29 Sep 2025
- 2025Evo-DKD: Dual-Knowledge Decoding for Autonomous Ontology Evolution in Large Language Models29 Jul 2025
- 2024Impact of Model Size on Fine-tuned LLM Performance in Data-to-Text Generation: A State-of-the-Art Investigation19 Jul 2024
- 2024Improving Factual Accuracy of Neural Table-to-Text Output by Addressing Input Problems in ToTTo5 Apr 2024
- 2024Target-constrained Bidirectional Planning for Generation of Target-oriented Proactive Dialogue10 Mar 2024
- 2024A Comparative Analysis of Conversational Large Language Models in Knowledge-Based Text Generation2 Feb 2024
- 2024Self-training from Self-memory in Data-to-text Generation19 Jan 2024
- 2024Inroads to a Structured Data Natural Language Bijection and the role of LLM annotation14 Jan 2024
- 2024Unifying Structured Data as Graph for Data-to-Text Pre-Training2 Jan 2024
- 2023Compositional Generalization for Data-to-Text Generation5 Dec 2023
- 2023PixT3: Pixel-based Table-To-Text Generation16 Nov 2023
12 newest of 49 All 49 (JSON)