mlsanityData to 7 Oct 2026

A Comprehensive Survey of Natural Language Generation Advances from the Perspective of Digital Deception

arXiv 2208.05757 ↗First posted 11 Aug 2022cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

In recent years there has been substantial growth in the capabilities of systems designed to generate text that mimics the fluency and coherence of human language. From this, there has been considerable research aimed at examining the potential uses of these natural language generators (NLG) towards a wide number of tasks. The increasing capabilities of powerful text generators to mimic human writing convincingly raises the potential for deception and other forms of dangerous misuse. As these systems improve, and it becomes ever harder to distinguish between human-written and machine-generated text, malicious actors could leverage these powerful NLG systems to a wide variety of ends, including the creation of fake news and misinformation, the generation of fake online product reviews, or via chatbots as means of convincing users to divulge private information. In this paper, we provide an overview of the NLG field via the identification and examination of 119 survey-like papers focused on NLG research. From these identified papers, we outline a proposed high-level taxonomy of the central concepts that constitute NLG, including the methods used to develop generalised NLG systems, the means by which these systems are evaluated, and the popular NLG tasks and subtasks that exist. In turn, we provide an overview and discussion of each of these items with respect to current research and offer an examination of the potential roles of NLG in deception and detection systems to counteract these threats. Moreover, we discuss the broader challenges of NLG, including the risks of bias that are often exhibited by existing text generation systems. This work offers a broad overview of the field of NLG with respect to its potential for misuse, aiming to provide a high-level understanding of this rapidly developing area of research.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 114 of its 231 references that are in the map. First posted on arXiv 11 Aug 2022.

Builds on

114 of 231 references.

References · 114

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  6. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  7. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  8. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  9. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  10. 2020Extracting Training Data from Large Language Modelscited by 2,144
  11. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
  12. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
38 more
  1. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
  2. 2018Datasheets for Datasetscited by 1,371
  3. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
  4. 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,235
  5. 2019Cross-lingual Language Model Pretrainingcited by 1,088
  6. 2018Model Cards for Model Reportingcited by 1,068
  7. 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,041
  8. 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 793
  9. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
  10. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  11. 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
  12. 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 754
  13. 2019Universal Adversarial Triggers for Attacking and Analyzing NLPcited by 709
  14. 2018CoQA: A Conversational Question Answering Challengecited by 674
  15. 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 668
  16. 2019Green AIcited by 620
  17. 2017Adversarial Examples for Evaluating Reading Comprehension Systemscited by 568
  18. 2019The Woman Worked as a Babysitter: On Biases in Language Generationcited by 540
  19. 2016Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filteringcited by 517
  20. 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 490
  21. 2021A Survey of Data Augmentation Approaches for NLPcited by 408
  22. 2018QuAC : Question Answering in Contextcited by 379
  23. 2018Snips Voice Platform: an embedded Spoken Language Understanding system for private-by-design voice interfacescited by 376
  24. 2016SeqGAN: Sequence Generative Adversarial Nets with Policy Gradientcited by 375
  25. 2019MASS: Masked Sequence to Sequence Pre-training for Language Generationcited by 345
  26. 2015Skip-Thought Vectorscited by 321
  27. 2020Evaluation of Text Generation: A Surveycited by 275
  28. 2017Style Transfer from Non-Parallel Text by Cross-Alignmentcited by 246
  29. 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
  30. 2017SearchQA: A New Q&A Dataset Augmented with Context from a Search Enginecited by 221
  31. 2018A Comprehensive Survey of Deep Learning for Image Captioningcited by 213
  32. 2018Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfercited by 209
  33. 2019Persuasion for Good: Towards a Personalized Persuasive Dialogue System for Social Goodcited by 207
  34. 2021Societal Biases in Language Generation: Progress and Challengescited by 201
  35. 2018An efficient framework for learning sentence representationscited by 197
  36. 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
  37. 2019Build it Break it Fix it for Dialogue Safety: Robustness from Adversarial Human Attackcited by 176
  38. 2019Not Enough Data? Deep Learning to the Rescue!cited by 174

50 most cited of 114 All 114 (JSON)

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.