mlsanityData to 7 Oct 2026

A Systematic Review of Data-to-Text NLG

arXiv 2402.08496 ↗First posted 13 Feb 2024cs.CL cs.AI cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

This systematic review undertakes a comprehensive analysis of current research on data-to-text generation, identifying gaps, challenges, and future directions within the field. Relevant literature in this field on datasets, evaluation metrics, application areas, multilingualism, language models, and hallucination mitigation methods is reviewed. Various methods for producing high-quality text are explored, addressing the challenge of hallucinations in data-to-text generation. These methods include re-ranking, traditional and neural pipeline architecture, planning architectures, data cleaning, controlled generation, and modification of models and training techniques. Their effectiveness and limitations are assessed, highlighting the need for universally applicable strategies to mitigate hallucinations. The review also examines the usage, popularity, and impact of datasets, alongside evaluation metrics, with an emphasis on both automatic and human assessment. Additionally, the evolution of data-to-text models, particularly the widespread adoption of transformer models, is discussed. Despite advancements in text quality, the review emphasizes the importance of research in low-resourced languages and the engineering of datasets in these languages to promote inclusivity. Finally, several application domains of data-to-text are highlighted, emphasizing their relevance in such domains. Overall, this review serves as a guiding framework for fostering innovation and advancing data-to-text generation.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 85 of its 150 references that are in the map. First posted on arXiv 13 Feb 2024.

Builds on

85 of 150 references.

References · 85

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  6. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  7. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  8. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  9. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  10. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
  11. 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
  12. 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,196
38 more
  1. 2019Cross-lingual Language Model Pretrainingcited by 1,088
  2. 2016SPICE: Semantic Propositional Image Caption Evaluationcited by 820
  3. 2021ClipCap: CLIP Prefix for Image Captioningcited by 557
  4. 2019MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distancecited by 415
  5. 2020ToTTo: A Controlled Table-To-Text Generation Datasetcited by 267
  6. 2017The E2E Dataset: New Challenges For End-to-End Generationcited by 252
  7. 2023A Comprehensive Capability Analysis of GPT-3 and GPT-3.5 Series Modelscited by 244
  8. 2017Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluationcited by 206
  9. 2020A Survey of Evaluation Metrics Used for NLG Systemscited by 164
  10. 2021NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristicscited by 153
  11. 2020DART: Open-Domain Structured Data Record to Text Generationcited by 144
  12. 2019Handling Divergent Reference Texts when Evaluating Table-to-Text Generationcited by 119
  13. 2020Investigating Pretrained Language Models for Graph-to-Text Generationcited by 117
  14. 2018Data-to-Text Generation with Content Selection and Planningcited by 106
  15. 2020Text-to-Text Pre-Training for Data-to-Text Taskscited by 104
  16. 2020Logical Natural Language Generation from Open-Domain Tablescited by 90
  17. 2020Controlled Hallucinations: Learning to Generate Faithfully from Noisy Datacited by 83
  18. 2020Chart-to-Text: Generating Natural Language Descriptions for Charts by Adapting the Transformer Modelcited by 77
  19. 2019Step-by-Step: Separating Planning from Realization in Neural Data-to-Text Generationcited by 75
  20. 2019Long and Diverse Text Generation with Planning-based Hierarchical Variational Modelcited by 62
  21. 2018Learning Neural Templates for Text Generationcited by 61
  22. 2021JointGT: Graph-Text Joint Representation Learning for Text Generation from Knowledge Graphscited by 58
  23. 2017Neural AMR: Sequence-to-Sequence Models for Parsing and Generationcited by 56
  24. 2018A Graph-to-Sequence Model for AMR-to-Text Generationcited by 56
  25. 2022Graph Pre-training for AMR Parsing and Generationcited by 55
  26. 2019Neural data-to-text generation: A comparison between pipeline and end-to-end architecturescited by 51
  27. 2020Towards Faithful Neural Table-to-Text Generation with Content-Matching Constraintscited by 48
  28. 2021Structural Adapters in Pretrained Language Models for AMR-to-text Generationcited by 48
  29. 2019Data-to-text Generation with Entity Modelingcited by 45
  30. 2020Logic2Text: High-Fidelity Natural Language Generation from Logical Formscited by 45
  31. 2021Controlling Hallucinations at Word Level in Data-to-Text Generationcited by 41
  32. 2020GPT-too: A language-model-first approach for AMR-to-text generationcited by 38
  33. 2019Semantic Neural Machine Translation using AMRcited by 37
  34. 2020Have Your Text and Use It Too! End-to-End Neural Data-to-Text Generation with Semantic Fidelitycited by 35
  35. 2021Data-to-text Generation with Macro Planningcited by 34
  36. 2018SQL-to-Text Generation with Graph-to-Sequence Modelcited by 31
  37. 2019ViGGO: A Video Game Corpus for Data-To-Text Generation in Open-Domain Conversationcited by 31
  38. 2020Modeling Global and Local Node Contexts for Text Generation from Knowledge Graphscited by 30

50 most cited of 85 All 85 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 1.

4 papers.