A Systematic Review of Data-to-Text NLG
Not on the map. Why?
Abstract (arXiv)
This systematic review undertakes a comprehensive analysis of current research on data-to-text generation, identifying gaps, challenges, and future directions within the field. Relevant literature in this field on datasets, evaluation metrics, application areas, multilingualism, language models, and hallucination mitigation methods is reviewed. Various methods for producing high-quality text are explored, addressing the challenge of hallucinations in data-to-text generation. These methods include re-ranking, traditional and neural pipeline architecture, planning architectures, data cleaning, controlled generation, and modification of models and training techniques. Their effectiveness and limitations are assessed, highlighting the need for universally applicable strategies to mitigate hallucinations. The review also examines the usage, popularity, and impact of datasets, alongside evaluation metrics, with an emphasis on both automatic and human assessment. Additionally, the evolution of data-to-text models, particularly the widespread adoption of transformer models, is discussed. Despite advancements in text quality, the review emphasizes the importance of research in low-resourced languages and the engineering of datasets in these languages to promote inclusivity. Finally, several application domains of data-to-text are highlighted, emphasizing their relevance in such domains. Overall, this review serves as a guiding framework for fostering innovation and advancing data-to-text generation.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 85 of its 150 references that are in the map. First posted on arXiv 13 Feb 2024.
Builds on
85 of 150 references.
References · 85
- 2017Attention Is All You Needcited by 59,932
- 2023GPT-4 Technical Reportcited by 18,132
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
- 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
- 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,196
38 more
- 2019Cross-lingual Language Model Pretrainingcited by 1,088
- 2016SPICE: Semantic Propositional Image Caption Evaluationcited by 820
- 2021ClipCap: CLIP Prefix for Image Captioningcited by 557
- 2019MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distancecited by 415
- 2020ToTTo: A Controlled Table-To-Text Generation Datasetcited by 267
- 2017The E2E Dataset: New Challenges For End-to-End Generationcited by 252
- 2023A Comprehensive Capability Analysis of GPT-3 and GPT-3.5 Series Modelscited by 244
- 2017Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluationcited by 206
- 2020A Survey of Evaluation Metrics Used for NLG Systemscited by 164
- 2021NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristicscited by 153
- 2020DART: Open-Domain Structured Data Record to Text Generationcited by 144
- 2019Handling Divergent Reference Texts when Evaluating Table-to-Text Generationcited by 119
- 2020Investigating Pretrained Language Models for Graph-to-Text Generationcited by 117
- 2018Data-to-Text Generation with Content Selection and Planningcited by 106
- 2020Text-to-Text Pre-Training for Data-to-Text Taskscited by 104
- 2020Logical Natural Language Generation from Open-Domain Tablescited by 90
- 2020Controlled Hallucinations: Learning to Generate Faithfully from Noisy Datacited by 83
- 2020Chart-to-Text: Generating Natural Language Descriptions for Charts by Adapting the Transformer Modelcited by 77
- 2019Step-by-Step: Separating Planning from Realization in Neural Data-to-Text Generationcited by 75
- 2019Long and Diverse Text Generation with Planning-based Hierarchical Variational Modelcited by 62
- 2018Learning Neural Templates for Text Generationcited by 61
- 2021JointGT: Graph-Text Joint Representation Learning for Text Generation from Knowledge Graphscited by 58
- 2017Neural AMR: Sequence-to-Sequence Models for Parsing and Generationcited by 56
- 2018A Graph-to-Sequence Model for AMR-to-Text Generationcited by 56
- 2022Graph Pre-training for AMR Parsing and Generationcited by 55
- 2019Neural data-to-text generation: A comparison between pipeline and end-to-end architecturescited by 51
- 2020Towards Faithful Neural Table-to-Text Generation with Content-Matching Constraintscited by 48
- 2021Structural Adapters in Pretrained Language Models for AMR-to-text Generationcited by 48
- 2019Data-to-text Generation with Entity Modelingcited by 45
- 2020Logic2Text: High-Fidelity Natural Language Generation from Logical Formscited by 45
- 2021Controlling Hallucinations at Word Level in Data-to-Text Generationcited by 41
- 2020GPT-too: A language-model-first approach for AMR-to-text generationcited by 38
- 2019Semantic Neural Machine Translation using AMRcited by 37
- 2020Have Your Text and Use It Too! End-to-End Neural Data-to-Text Generation with Semantic Fidelitycited by 35
- 2021Data-to-text Generation with Macro Planningcited by 34
- 2018SQL-to-Text Generation with Graph-to-Sequence Modelcited by 31
- 2019ViGGO: A Video Game Corpus for Data-To-Text Generation in Open-Domain Conversationcited by 31
- 2020Modeling Global and Local Node Contexts for Text Generation from Knowledge Graphscited by 30
50 most cited of 85 All 85 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 2; 2026: 1.
4 papers.
- 2025Tabular Data Understanding with LLMs: A Survey of Recent Advances and Challengescited by 10
- 2024MGSA: Multi-Granularity Graph Structure Attention for Knowledge Graph-to-Text Generationcited by 1
- 2025Representing data in words: A context engineering approachcited by 1
- 2026One Feedback System Does Not Fit All: Localising Data-to-Text Driver Coaching for the United Kingdom and Nigeriacited by 0
- 2026One Feedback System Does Not Fit All: Localising Data-to-Text Driver Coaching for the United Kingdom and Nigeria13 Sep 2026
- 2025Tabular Data Understanding with LLMs: A Survey of Recent Advances and Challenges31 Jul 2025
- 2025Representing data in words: A context engineering approach27 Jan 2025
- 2024MGSA: Multi-Granularity Graph Structure Attention for Knowledge Graph-to-Text Generation16 Sep 2024