mlsanityData to 14 Oct 2026

DRAG: Director-Generator Language Modelling Framework for Non-Parallel Author Stylized Rewriting

arXiv 2101.11836 ↗First posted 28 Jan 2021cs.CL cs.AI cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

Author stylized rewriting is the task of rewriting an input text in a particular author's style. Recent works in this area have leveraged Transformer-based language models in a denoising autoencoder setup to generate author stylized text without relying on a parallel corpus of data. However, these approaches are limited by the lack of explicit control of target attributes and being entirely data-driven. In this paper, we propose a Director-Generator framework to rewrite content in the target author's style, specifically focusing on certain target attributes. We show that our proposed framework works well even with a limited-sized target author corpus. Our experiments on corpora consisting of relatively small-sized text authored by three distinct authors show significant improvements upon existing works to rewrite input texts in target author's style. Our quantitative and qualitative analyses further show that our model has better meaning retention and results in more fluent generations.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 30 of its 49 references that are in the map. First posted on arXiv 28 Jan 2021.

Builds on

30 of 49 references.

References · 30

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2017Proximal Policy Optimization Algorithmscited by 15,215
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  6. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
  7. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  8. 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
  9. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  10. 2019Cross-lingual Language Model Pretrainingcited by 1,090
  11. 2015Sequence Level Training with Recurrent Neural Networkscited by 576
  12. 2016Self-critical Sequence Training for Image Captioningcited by 547
18 more
  1. 2019How to Fine-Tune BERT for Text Classification?cited by 411
  2. 2019Linguistic Knowledge and Transferability of Contextual Representationscited by 383
  3. 2017Toward Controlled Generation of Textcited by 272
  4. 2019Stabilizing Transformers for Reinforcement Learningcited by 270
  5. 2017Style Transfer from Non-Parallel Text by Cross-Alignmentcited by 248
  6. 2018Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfercited by 211
  7. 2018Delete, Retrieve, Generate: A Simple Approach to Sentiment and Style Transfercited by 191
  8. 2017Controlling Linguistic Style Aspects in Neural Language Generationcited by 149
  9. 2017Style Transfer in Text: Exploration and Evaluationcited by 146
  10. 2018Polite Dialogue Generation Without Parallel Datacited by 59
  11. 2017Shakespearizing Modern Language Using Copy-Enriched Sequence-to-Sequence Modelscited by 57
  12. 2015SentiCap: Generating Image Descriptions with Sentimentscited by 48
  13. 2019Adapting Language Models for Non-Parallel Author-Stylized Rewritingcited by 23
  14. 2018Multiple-Attribute Text Style Transfercited by 20
  15. 2013Complexity of Word Collocation Networks: A Preliminary Structural Analysiscited by 17
  16. 2018Unsupervised Controllable Text Formalizationcited by 9
  17. 2019A Lexical, Syntactic, and Semantic Perspective for Understanding Style in Textcited by 9
  18. 2020Incorporating Stylistic Lexical Preferences in Generative Language Modelscited by 2

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 0; 2023: 1; 2024: 2; 2025: 1.

5 papers.