Unpaired Sentiment-to-Sentiment Translation: A Cycled Reinforcement Learning Approach
Not on the map. Why?
Abstract (arXiv)
The goal of sentiment-to-sentiment "translation" is to change the underlying sentiment of a sentence while keeping its content. The main challenge is the lack of parallel data. To solve this problem, we propose a cycled reinforcement learning method that enables training on unpaired data by collaboration between a neutralization module and an emotionalization module. We evaluate our approach on two review datasets, Yelp and Amazon. Experimental results show that our approach significantly outperforms the state-of-the-art systems. Especially, the proposed method substantially improves the content preservation performance. The BLEU score is improved from 1.64 to 22.46 and from 0.56 to 14.06 on the two datasets, respectively.
Key facts. Cited by 55 papers in the map (data through 13 Oct 2026). First posted on arXiv 14 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 13; 2023: 15; 2024: 8; 2025: 1; 2026: 1.
55 papers.
Sort:
By area:
- 2021Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfercited by 158
- 2021A Recipe For Arbitrary Text Style Transfer with Large Language Modelscited by 107
- 2023Controlled Text Generation with Natural Language Instructionscited by 87
- 2021XFORMAL: A Benchmark for Multilingual Formality Style Transfercited by 51
- 2022Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Arbitrary Textual Style Transfer with Small Language Modelscited by 49
- 2021Civil Rephrases Of Toxic Texts With Self-Supervised Transformerscited by 32
- 2021Parallel Refinements for Lexically Constrained Text Generation with BARTcited by 24
- 2021Enhancing Content Preservation in Text Style Transfer Using Reverse Attention and Conditional Layer Normalizationcited by 20
- 2024StyleRemix: Interpretable Authorship Obfuscation via Distillation and Perturbation of Style Elementscited by 18
- 2022Text Revision by On-the-Fly Representation Optimizationcited by 17
- 2022Proactively Reducing the Hate Intensity of Online Posts via Hate Speech Normalizationcited by 17
- 2023Think Twice: A Human-like Two-stage Conversational Agent for Emotional Response Generationcited by 14
38 more
- 2023A Call for Standardization and Validation of Text Style Transfer Evaluationcited by 14
- 2023STEER: Unified Style Transfer with Expert Reinforcementcited by 14
- 2021A Survey of Natural Language Generationcited by 13
- 2021Transductive Learning for Unsupervised Text Style Transfercited by 12
- 2022Human Judgement as a Compass to Navigate Automatic Metrics for Formality Transfercited by 12
- 2021Generic resources are what you need: Style transfer tasks without task-specific parallel training datacited by 10
- 2023Diversify Question Generation with Retrieval-Augmented Style Transfercited by 10
- 2021Political Depolarization of News Articles Using Attribute-aware Word Embeddingscited by 9
- 2022On The Robustness of Offensive Language Classifierscited by 8
- 2022StoryTrans: Non-Parallel Story Author-Style Transfer with Discourse Representations and Content Enhancingcited by 8
- 2022Efficient Reinforcement Learning for Unsupervised Controlled Text Generationcited by 7
- 2024Unsupervised Text Style Transfer via LLMs and Attention Masking with Multi-way Interactionscited by 7
- 2024LLM-based Rewriting of Inappropriate Argumentation using Reinforcement Learning from Machine Feedbackcited by 7
- 2022T-STAR: Truthful Style Transfer using AMR Graph as Intermediate Representationcited by 6
- 2023Don't Take This Out of Context! On the Need for Contextual Models and Evaluations for Stylistic Rewritingcited by 6
- 2021From Solving a Problem Boldly to Cutting the Gordian Knot: Idiomatic Text Generationcited by 5
- 2021From Theories on Styles to their Transfer in Text: Bridging the Gap with a Hierarchical Surveycited by 5
- 2023Translating away Translationese without Parallel Datacited by 5
- 2024LMStyle Benchmark: Evaluating Text Style Transfer for Chatbotscited by 5
- 2024Text Style Transfer: An Introductory Overviewcited by 5
- 2022StyleFlow: Disentangle Latent Representations via Normalizing Flow for Unsupervised Text Style Transfercited by 4
- 2021GTAE: Graph-Transformer based Auto-Encoders for Linguistic-Constrained Text Style Transfercited by 3
- 2023Active Learning for Natural Language Generationcited by 3
- 2024Continuous Language Model Interpolation for Dynamic and Controllable Text Generationcited by 3
- 2021Stylistic Retrieval-based Dialogue System with Unparallel Training Datacited by 2
- 2023Specializing Small Language Models towards Complex Style Transfer via Latent Attribute Pre-Trainingcited by 2
- 2021SE-DAE: Style-Enhanced Denoising Auto-Encoder for Unsupervised Text Style Transfercited by 1
- 2021Bag-of-Vectors Autoencoders for Unsupervised Conditional Text Generationcited by 1
- 2022Russian Texts Detoxification with Levenshtein Editingcited by 1
- 2023"When Words Fail, Emojis Prevail": Generating Sarcastic Utterances with Emoji Using Valence Reversal and Semantic Incongruitycited by 1
- 2024Analyzing Sentiment Polarity Reduction in News Presentation through Contextual Perturbation and Large Language Modelscited by 1
- 2021Topical Language Generation using Transformerscited by 0
- 2022Learning from Bootstrapping and Stepwise Reinforcement Reward: A Semi-Supervised Framework for Text Style Transfercited by 0
- 2022On Text Style Transfer via Style Masked Language Modelscited by 0
- 2022SimpleStyle: An Adaptable Style Transfer Approachcited by 0
- 2023Generative Sentiment Transfer via Adaptive Maskingcited by 0
- 2023MSSRNet: Manipulating Sequential Style Representation for Unsupervised Text Style Transfercited by 0
- 2023Tweet Sentiment Extraction using Viterbi Algorithm with Transfer Learningcited by 0
50 most cited of 55 All 55 (JSON)
- 2026Teaching LLMs Human-Like Editing of Inappropriate Argumentation via Reinforcement Learning14 Apr 2026
- 2025Hierarchical Multi-Label Generation with Probabilistic Level-Constraint30 Apr 2025
- 2024StyleRemix: Interpretable Authorship Obfuscation via Distillation and Perturbation of Style Elements28 Aug 2024
- 2024SETTP: Style Extraction and Tunable Inference via Dual-level Transferable Prompt Learning22 Jul 2024
- 2024Text Style Transfer: An Introductory Overview20 Jul 2024
- 2024LLM-based Rewriting of Inappropriate Argumentation using Reinforcement Learning from Machine Feedback5 Jun 2024
- 2024Continuous Language Model Interpolation for Dynamic and Controllable Text Generation10 Apr 2024
- 2024LMStyle Benchmark: Evaluating Text Style Transfer for Chatbots13 Mar 2024
- 2024Unsupervised Text Style Transfer via LLMs and Attention Masking with Multi-way Interactions21 Feb 2024
- 2024Analyzing Sentiment Polarity Reduction in News Presentation through Contextual Perturbation and Large Language Models3 Feb 2024
- 2023STEER: Unified Style Transfer with Expert Reinforcement13 Nov 2023
- 2023Translating away Translationese without Parallel Data28 Oct 2023
38 more
- 2023Diversify Question Generation with Retrieval-Augmented Style Transfer23 Oct 2023
- 2023Reward Dropout Improves Control: Bi-objective Perspective on Reinforced LM6 Oct 2023
- 2023Specializing Small Language Models towards Complex Style Transfer via Latent Attribute Pre-Training19 Sep 2023
- 2023Unsupervised Text Style Transfer with Deep Generative Models31 Aug 2023
- 2023Tweet Sentiment Extraction using Viterbi Algorithm with Transfer Learning11 Aug 2023
- 2023MSSRNet: Manipulating Sequential Style Representation for Unsupervised Text Style Transfer12 Jun 2023
- 2023A Call for Standardization and Validation of Text Style Transfer Evaluation1 Jun 2023
- 2023Active Learning for Natural Language Generation24 May 2023
- 2023Don't Take This Out of Context! On the Need for Contextual Models and Evaluations for Stylistic Rewriting24 May 2023
- 2023"When Words Fail, Emojis Prevail": Generating Sarcastic Utterances with Emoji Using Valence Reversal and Semantic Incongruity6 May 2023
- 2023Controlled Text Generation with Natural Language Instructions27 Apr 2023
- 2023Generative Sentiment Transfer via Adaptive Masking23 Feb 2023
- 2023Think Twice: A Human-like Two-stage Conversational Agent for Emotional Response Generation12 Jan 2023
- 2022SimpleStyle: An Adaptable Style Transfer Approach20 Dec 2022
- 2022StyleFlow: Disentangle Latent Representations via Normalizing Flow for Unsupervised Text Style Transfer19 Dec 2022
- 2022T-STAR: Truthful Style Transfer using AMR Graph as Intermediate Representation3 Dec 2022
- 2022On Text Style Transfer via Style Masked Language Models12 Oct 2022
- 2022StoryTrans: Non-Parallel Story Author-Style Transfer with Discourse Representations and Content Enhancing29 Aug 2022
- 2022Proactively Reducing the Hate Intensity of Online Posts via Hate Speech Normalization8 Jun 2022
- 2022Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Arbitrary Textual Style Transfer with Small Language Models23 May 2022
- 2022Learning from Bootstrapping and Stepwise Reinforcement Reward: A Semi-Supervised Framework for Text Style Transfer19 May 2022
- 2022Russian Texts Detoxification with Levenshtein Editing28 Apr 2022
- 2022Efficient Reinforcement Learning for Unsupervised Controlled Text Generation16 Apr 2022
- 2022Human Judgement as a Compass to Navigate Automatic Metrics for Formality Transfer15 Apr 2022
- 2022Text Revision by On-the-Fly Representation Optimization15 Apr 2022
- 2022On The Robustness of Offensive Language Classifiers21 Mar 2022
- 2021A Survey of Natural Language Generation22 Dec 2021
- 2021From Theories on Styles to their Transfer in Text: Bridging the Gap with a Hierarchical Survey29 Oct 2021
- 2021Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfer14 Oct 2021
- 2021Bag-of-Vectors Autoencoders for Unsupervised Conditional Text Generation13 Oct 2021
- 2021Parallel Refinements for Lexically Constrained Text Generation with BART26 Sep 2021
- 2021Transductive Learning for Unsupervised Text Style Transfer16 Sep 2021
- 2021Stylistic Retrieval-based Dialogue System with Unparallel Training Data12 Sep 2021
- 2021Generic resources are what you need: Style transfer tasks without task-specific parallel training data9 Sep 2021
- 2021A Recipe For Arbitrary Text Style Transfer with Large Language Models8 Sep 2021
- 2021Enhancing Content Preservation in Text Style Transfer Using Reverse Attention and Conditional Layer Normalization1 Aug 2021
- 2021SE-DAE: Style-Enhanced Denoising Auto-Encoder for Unsupervised Text Style Transfer27 Apr 2021
- 2021From Solving a Problem Boldly to Cutting the Gordian Knot: Idiomatic Text Generation13 Apr 2021
50 newest of 55 All 55 (JSON)
- 2021A Recipe For Arbitrary Text Style Transfer with Large Language Modelscited by 107
- 2023Controlled Text Generation with Natural Language Instructionscited by 87
- 2021XFORMAL: A Benchmark for Multilingual Formality Style Transfercited by 51
- 2022Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Arbitrary Textual Style Transfer with Small Language Modelscited by 49
- 2021Civil Rephrases Of Toxic Texts With Self-Supervised Transformerscited by 32
- 2021Parallel Refinements for Lexically Constrained Text Generation with BARTcited by 24
- 2021Enhancing Content Preservation in Text Style Transfer Using Reverse Attention and Conditional Layer Normalizationcited by 20
- 2024StyleRemix: Interpretable Authorship Obfuscation via Distillation and Perturbation of Style Elementscited by 18
- 2022Text Revision by On-the-Fly Representation Optimizationcited by 17
- 2022Proactively Reducing the Hate Intensity of Online Posts via Hate Speech Normalizationcited by 17
- 2023Think Twice: A Human-like Two-stage Conversational Agent for Emotional Response Generationcited by 14
- 2023A Call for Standardization and Validation of Text Style Transfer Evaluationcited by 14
12 most cited of 53 All 53 (JSON)
- 2026Teaching LLMs Human-Like Editing of Inappropriate Argumentation via Reinforcement Learning14 Apr 2026
- 2025Hierarchical Multi-Label Generation with Probabilistic Level-Constraint30 Apr 2025
- 2024StyleRemix: Interpretable Authorship Obfuscation via Distillation and Perturbation of Style Elements28 Aug 2024
- 2024SETTP: Style Extraction and Tunable Inference via Dual-level Transferable Prompt Learning22 Jul 2024
- 2024Text Style Transfer: An Introductory Overview20 Jul 2024
- 2024LLM-based Rewriting of Inappropriate Argumentation using Reinforcement Learning from Machine Feedback5 Jun 2024
- 2024Continuous Language Model Interpolation for Dynamic and Controllable Text Generation10 Apr 2024
- 2024LMStyle Benchmark: Evaluating Text Style Transfer for Chatbots13 Mar 2024
- 2024Unsupervised Text Style Transfer via LLMs and Attention Masking with Multi-way Interactions21 Feb 2024
- 2024Analyzing Sentiment Polarity Reduction in News Presentation through Contextual Perturbation and Large Language Models3 Feb 2024
- 2023STEER: Unified Style Transfer with Expert Reinforcement13 Nov 2023
- 2023Translating away Translationese without Parallel Data28 Oct 2023
12 newest of 53 All 53 (JSON)