Transforming Delete, Retrieve, Generate Approach for Controlled Text Style Transfer
Not on the map. Why?
Abstract (arXiv)
Text style transfer is the task of transferring the style of text having certain stylistic attributes, while preserving non-stylistic or content information. In this work we introduce the Generative Style Transformer (GST) - a new approach to rewriting sentences to a target style in the absence of parallel style corpora. GST leverages the power of both, large unsupervised pre-trained language models as well as the Transformer. GST is a part of a larger `Delete Retrieve Generate' framework, in which we also propose a novel method of deleting style attributes from the source sentence by exploiting the inner workings of the Transformer. Our models outperform state-of-art systems across 5 datasets on sentiment, gender and political slant transfer. We also propose the use of the GLEU metric as an automatic metric of evaluation of style transfer, which we found to compare better with human ratings than the predominantly used BLEU score.
Key facts. Cited by 81 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 25; 2022: 20; 2023: 19; 2024: 12; 2025: 2; 2026: 3.
81 papers.
Sort:
By area:
- 2021DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Expertscited by 434
- 2022Quark: Controllable Text Generation with Reinforced Unlearningcited by 236
- 2021Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfercited by 147
- 2021A Recipe For Arbitrary Text Style Transfer with Large Language Modelscited by 107
- 2021COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 Pandemiccited by 100
- 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 98
- 2021The Perils of Using Mechanical Turk to Evaluate Open-Ended Text Generationcited by 96
- 2023Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Modelcited by 79
- 2022Machine Generated Text: A Comprehensive Survey of Threat Models and Detection Methodscited by 75
- 2024Detecting Multimedia Generated by Large AI Models: A Surveycited by 73
- 2021Controlled Text Generation as Continuous Optimization with Multiple Constraintscited by 70
- 2023Detecting and Grounding Multi-Modal Media Manipulation and Beyondcited by 55
38 more
- 2021Text Detoxification using Large Pre-trained Neural Modelscited by 52
- 2022Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Arbitrary Textual Style Transfer with Small Language Modelscited by 49
- 2022Critic-Guided Decoding for Controlled Text Generationcited by 45
- 2023You Only Prompt Once: On the Capabilities of Prompt Learning on Large Language Models to Tackle Toxic Contentcited by 37
- 2021StylePTB: A Compositional Benchmark for Fine-grained Controllable Text Style Transfercited by 34
- 2022Inducing Positive Perspectives with Text Reframingcited by 31
- 2021Exploring the Efficacy of Automatically Generated Counterfactuals for Sentiment Analysiscited by 30
- 2022Composable Text Controls in Latent Space with ODEscited by 28
- 2022Text Style Transfer for Bias Mitigation using Masked Language Modelingcited by 27
- 2021Detect and Perturb: Neutral Rewriting of Biased and Sensitive Text via Gradient-based Decodingcited by 23
- 2024A Survey on Natural Language Counterfactual Generationcited by 21
- 2022Controllable Data Generation by Deep Learning: A Reviewcited by 20
- 2022Why is constrained neural language generation particularly challenging?cited by 19
- 2021A Review of Text Style Transfer using Deep Learningcited by 18
- 2024Parameter-Efficient Detoxification with Contrastive Decodingcited by 18
- 2021Text Counterfactuals via Latent Optimization and Shapley-Guided Searchcited by 16
- 2023Think Twice: A Human-like Two-stage Conversational Agent for Emotional Response Generationcited by 14
- 2023STEER: Unified Style Transfer with Expert Reinforcementcited by 14
- 2023A Call for Standardization and Validation of Text Style Transfer Evaluationcited by 13
- 2021Transductive Learning for Unsupervised Text Style Transfercited by 12
- 2022Human Judgement as a Compass to Navigate Automatic Metrics for Formality Transfercited by 11
- 2022Non-Parallel Text Style Transfer with Self-Parallel Supervisioncited by 11
- 2021ENTRUST: Argument Reframing with Language Models and Entailmentcited by 10
- 2021Transferable Persona-Grounded Dialogues via Grounded Minimal Editscited by 10
- 2022Low-Resource Authorship Style Transfer: Can Non-Famous Authors Be Imitated?cited by 9
- 2023Learning to Generate Text in Arbitrary Writing Stylescited by 9
- 2021Similar Scenes arouse Similar Emotions: Parallel Data Augmentation for Stylized Image Captioningcited by 7
- 2021Idiomatic Expression Paraphrasing without Strong Supervisioncited by 7
- 2022Efficient Reinforcement Learning for Unsupervised Controlled Text Generationcited by 7
- 2023Fine-grained Text Style Transfer with Diffusion-Based Language Modelscited by 7
- 2023Advancements in Scientific Controllable Text Generation Methodscited by 7
- 2024Unsupervised Text Style Transfer via LLMs and Attention Masking with Multi-way Interactionscited by 7
- 2022Nano: Nested Human-in-the-Loop Reward Learning for Few-shot Language Model Controlcited by 6
- 2022T-STAR: Truthful Style Transfer using AMR Graph as Intermediate Representationcited by 6
- 2023Don't Take This Out of Context! On the Need for Contextual Models and Evaluations for Stylistic Rewritingcited by 6
- 2023Prefix-Tuning Based Unsupervised Text Style Transfercited by 6
- 2021From Solving a Problem Boldly to Cutting the Gordian Knot: Idiomatic Text Generationcited by 5
- 2021From Theories on Styles to their Transfer in Text: Bridging the Gap with a Hierarchical Surveycited by 5
50 most cited of 81 All 81 (JSON)
- 2026Authorship Impersonation via LLM Prompting does not Evade Authorship Verification Methods31 Mar 2026
- 2026All That Glisters Is Not Gold: A Benchmark for Reference-Free Counterfactual Financial Misinformation Detection7 Jan 2026
- 2026Unsupervised Text Style Transfer for Controllable Intensity3 Jan 2026
- 2025Excision Score: Evaluating Edits with Surgical Precision24 Oct 2025
- 2025Seeing Through Deception: Uncovering Misleading Creator Intent in Multimodal News with Vision-Language Models21 May 2025
- 2024Positive Text Reframing under Multi-strategy Optimization25 Jul 2024
- 2024SETTP: Style Extraction and Tunable Inference via Dual-level Transferable Prompt Learning22 Jul 2024
- 2024Text Style Transfer: An Introductory Overview20 Jul 2024
- 2024On the Low-Rank Parametrization of Reward Models for Controlled Language Generation5 Jul 2024
- 2024A Survey on Natural Language Counterfactual Generation4 Jul 2024
- 2024A Pattern Language for Machine Learning Tasks2 Jul 2024
- 2024Fake News Detection and Manipulation Reasoning via Large Vision-Language Models2 Jul 2024
38 more
- 2024CEV-LM: Controlled Edit Vector Language Model for Shaping Natural Language Generations22 Feb 2024
- 2024Unsupervised Text Style Transfer via LLMs and Attention Masking with Multi-way Interactions21 Feb 2024
- 2024LiFi: Lightweight Controlled Text Generation with Fine-Grained Control Codes10 Feb 2024
- 2024Detecting Multimedia Generated by Large AI Models: A Survey22 Jan 2024
- 2024Parameter-Efficient Detoxification with Contrastive Decoding13 Jan 2024
- 2023Learning to Generate Text in Arbitrary Writing Styles28 Dec 2023
- 2023STEER: Unified Style Transfer with Expert Reinforcement13 Nov 2023
- 2023StyleBART: Decorate Pretrained Model with Style Adapters for Unsupervised Stylistic Headline Generation26 Oct 2023
- 2023Prefix-Tuning Based Unsupervised Text Style Transfer23 Oct 2023
- 2023Text Fact Transfer23 Oct 2023
- 2023Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model14 Oct 2023
- 2023Reward Dropout Improves Control: Bi-objective Perspective on Reinforced LM6 Oct 2023
- 2023Detecting and Grounding Multi-Modal Media Manipulation and Beyond25 Sep 2023
- 2023Specializing Small Language Models towards Complex Style Transfer via Latent Attribute Pre-Training19 Sep 2023
- 2023ICLEF: In-Context Learning with Expert Feedback for Explainable Style Transfer15 Sep 2023
- 2023Unsupervised Text Style Transfer with Deep Generative Models31 Aug 2023
- 2023You Only Prompt Once: On the Capabilities of Prompt Learning on Large Language Models to Tackle Toxic Content10 Aug 2023
- 2023Advancements in Scientific Controllable Text Generation Methods8 Jul 2023
- 2023A Call for Standardization and Validation of Text Style Transfer Evaluation1 Jun 2023
- 2023Fine-grained Text Style Transfer with Diffusion-Based Language Models31 May 2023
- 2023Don't Take This Out of Context! On the Need for Contextual Models and Evaluations for Stylistic Rewriting24 May 2023
- 2023Detecting and Grounding Multi-Modal Media Manipulation5 Apr 2023
- 2023Generative Sentiment Transfer via Adaptive Masking23 Feb 2023
- 2023Think Twice: A Human-like Two-stage Conversational Agent for Emotional Response Generation12 Jan 2023
- 2022Critic-Guided Decoding for Controlled Text Generation21 Dec 2022
- 2022SimpleStyle: An Adaptable Style Transfer Approach20 Dec 2022
- 2022StyleFlow: Disentangle Latent Representations via Normalizing Flow for Unsupervised Text Style Transfer19 Dec 2022
- 2022Low-Resource Authorship Style Transfer: Can Non-Famous Authors Be Imitated?18 Dec 2022
- 2022T-STAR: Truthful Style Transfer using AMR Graph as Intermediate Representation3 Dec 2022
- 2022Replacing Language Model for Style Transfer14 Nov 2022
- 2022Nano: Nested Human-in-the-Loop Reward Learning for Few-shot Language Model Control10 Nov 2022
- 2022Machine Generated Text: A Comprehensive Survey of Threat Models and Detection Methods13 Oct 2022
- 2022On Text Style Transfer via Style Masked Language Models12 Oct 2022
- 2022Composable Text Controls in Latent Space with ODEs1 Aug 2022
- 2022Controllable Data Generation by Deep Learning: A Review19 Jul 2022
- 2022Why is constrained neural language generation particularly challenging?11 Jun 2022
- 2022Quark: Controllable Text Generation with Reinforced Unlearning26 May 2022
- 2022Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Arbitrary Textual Style Transfer with Small Language Models23 May 2022
50 newest of 81 All 81 (JSON)
- 2023Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Modelcited by 79
- 2022Nano: Nested Human-in-the-Loop Reward Learning for Few-shot Language Model Controlcited by 6
- 2023ICLEF: In-Context Learning with Expert Feedback for Explainable Style Transfercited by 5
- 2024On the Low-Rank Parametrization of Reward Models for Controlled Language Generationcited by 3
- 2024On the Low-Rank Parametrization of Reward Models for Controlled Language Generation5 Jul 2024
- 2023Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model14 Oct 2023
- 2023ICLEF: In-Context Learning with Expert Feedback for Explainable Style Transfer15 Sep 2023
- 2022Nano: Nested Human-in-the-Loop Reward Learning for Few-shot Language Model Control10 Nov 2022
- 2021DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Expertscited by 434
- 2021A Recipe For Arbitrary Text Style Transfer with Large Language Modelscited by 107
- 2021COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 Pandemiccited by 100
- 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 98
- 2021The Perils of Using Mechanical Turk to Evaluate Open-Ended Text Generationcited by 96
- 2022Machine Generated Text: A Comprehensive Survey of Threat Models and Detection Methodscited by 75
- 2021Controlled Text Generation as Continuous Optimization with Multiple Constraintscited by 70
- 2023Detecting and Grounding Multi-Modal Media Manipulation and Beyondcited by 55
- 2021Text Detoxification using Large Pre-trained Neural Modelscited by 52
- 2022Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Arbitrary Textual Style Transfer with Small Language Modelscited by 49
- 2022Critic-Guided Decoding for Controlled Text Generationcited by 45
- 2023You Only Prompt Once: On the Capabilities of Prompt Learning on Large Language Models to Tackle Toxic Contentcited by 37
12 most cited of 72 All 72 (JSON)
- 2026Authorship Impersonation via LLM Prompting does not Evade Authorship Verification Methods31 Mar 2026
- 2026All That Glisters Is Not Gold: A Benchmark for Reference-Free Counterfactual Financial Misinformation Detection7 Jan 2026
- 2026Unsupervised Text Style Transfer for Controllable Intensity3 Jan 2026
- 2025Excision Score: Evaluating Edits with Surgical Precision24 Oct 2025
- 2024Positive Text Reframing under Multi-strategy Optimization25 Jul 2024
- 2024SETTP: Style Extraction and Tunable Inference via Dual-level Transferable Prompt Learning22 Jul 2024
- 2024Text Style Transfer: An Introductory Overview20 Jul 2024
- 2024A Survey on Natural Language Counterfactual Generation4 Jul 2024
- 2024A Pattern Language for Machine Learning Tasks2 Jul 2024
- 2024Fake News Detection and Manipulation Reasoning via Large Vision-Language Models2 Jul 2024
- 2024CEV-LM: Controlled Edit Vector Language Model for Shaping Natural Language Generations22 Feb 2024
- 2024Unsupervised Text Style Transfer via LLMs and Attention Masking with Multi-way Interactions21 Feb 2024
12 newest of 72 All 72 (JSON)