mlsanityData to 7 Oct 2026

Generating Sentences by Editing Prototypes

arXiv 1709.08878 ↗First posted 26 Sep 2017cs.CL cs.AI cs.LGcited by 88

Not on the map. Why?

Abstract (arXiv)

We propose a new generative model of sentences that first samples a prototype sentence from the training corpus and then edits it into a new sentence. Compared to traditional models that generate from scratch either left-to-right or by first sampling a latent sentence vector, our prototype-then-edit model improves perplexity on language modeling and generates higher quality outputs according to human evaluation. Furthermore, the model gives rise to a latent edit vector that captures interpretable semantics such as sentence similarity and sentence-level analogies.

Key facts. Cited by 88 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Sep 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2020: 2; 2021: 36; 2022: 13; 2023: 25; 2024: 6; 2025: 4; 2026: 2.

88 papers.

Sort:

By area:

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  3. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  4. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
  5. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
  6. 2022COLD Decoding: Energy-based Constrained Text Generation with Langevin Dynamicscited by 159
  7. 2021Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learningcited by 112
  8. 2023Foundation Models and Fair Usecited by 112
  9. 2021A Survey on Data Augmentation for Text Classificationcited by 111
  10. 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLPcited by 101
  11. 2021Efficient Nearest Neighbor Language Modelscited by 93
  12. 2021Adaptive Semiparametric Language Modelscited by 83
38 more
  1. 2024Aligning LLM Agents by Learning Latent Preference from User Editscited by 66
  2. 2021Neural Machine Translation with Monolingual Translation Memorycited by 61
  3. 2022Neuro-Symbolic Language Modeling with Automaton-augmented Retrievalcited by 60
  4. 2023kNN Prompting: Beyond-Context Learning with Calibration-Free Nearest Neighbor Inferencecited by 47
  5. 2022CoditT5: Pretraining for Source Code and Natural Language Editingcited by 45
  6. 2022DiffusER: Discrete Diffusion via Edit-based Reconstructioncited by 41
  7. 2022Commonsense Knowledge Reasoning and Generation with Pre-trained Language Models: A Surveycited by 38
  8. 2021What's in a Summary? Laying the Groundwork for Advances in Hospital-Course Summarizationcited by 35
  9. 2021Controllable Semantic Parsing via Retrieval Augmentationcited by 35
  10. 2021StylePTB: A Compositional Benchmark for Fine-grained Controllable Text Style Transfercited by 34
  11. 2023Why do Nearest Neighbor Language Models Work?cited by 29
  12. 2023PoET: A generative model of protein families as sequences-of-sequencescited by 29
  13. 2024Weaver: Foundation Models for Creative Writingcited by 25
  14. 2021AlphaD3M: Machine Learning Pipeline Synthesiscited by 24
  15. 2021Beyond In-Place Corruption: Insertion and Deletion In Denoising Probabilistic Modelscited by 23
  16. 2021Few-Shot Table-to-Text Generation with Prototype Memorycited by 21
  17. 2022ProtoTEx: Explaining Model Decisions with Prototype Tensorscited by 21
  18. 2025Reward-Guided Iterative Refinement in Diffusion Models at Test-Time with Applications to Protein and DNA Designcited by 21
  19. 2021Few-shot Controllable Style Transfer for Low-Resource Multilingual Settingscited by 20
  20. 2022Controllable Data Generation by Deep Learning: A Reviewcited by 20
  21. 2022Why is constrained neural language generation particularly challenging?cited by 19
  22. 2023EditSum: A Retrieve-and-Edit Framework for Source Code Summarizationcited by 18
  23. 2021Learning Structural Edits via Incremental Tree Transformationscited by 16
  24. 2023vONTSS: vMF based semi-supervised neural topic modeling with optimal transportcited by 16
  25. 2021SHARE: a System for Hierarchical Assistive Recipe Editingcited by 15
  26. 2023A Call for Standardization and Validation of Text Style Transfer Evaluationcited by 13
  27. 2021Political Depolarization of News Articles Using Attribute-aware Word Embeddingscited by 9
  28. 2021Exemplars-guided Empathetic Response Generation Controlled by the Elements of Human Communicationcited by 9
  29. 2021Capturing Structural Locality in Non-parametric Language Modelscited by 8
  30. 2021Comparative Explanations of Recommendationscited by 8
  31. 2022Generating Full Length Wikipedia Biographies: The Impact of Gender Bias on the Retrieval-Based Generation of Women Biographiescited by 7
  32. 2022So Different Yet So Alike! Constrained Unsupervised Text Style Transfercited by 7
  33. 2023Extrapolative Controlled Sequence Generation via Iterative Refinementcited by 7
  34. 2023Surface-Based Retrieval Reduces Perplexity of Retrieval-Augmented Language Modelscited by 7
  35. 2023Fine-grained Text Style Transfer with Diffusion-Based Language Modelscited by 7
  36. 2021Controlling Text Edition by Changing Answers of Specific Questionscited by 6
  37. 2022Nano: Nested Human-in-the-Loop Reward Learning for Few-shot Language Model Controlcited by 6
  38. 2023Beyond Vanilla Variational Autoencoders: Detecting Posterior Collapse in Conditional and Hierarchical Variational Autoencoderscited by 6

50 most cited of 88 All 88 (JSON)