Disentangled Representation Learning for Non-Parallel Text Style Transfer
Not on the map. Why?
Abstract (arXiv)
This paper tackles the problem of disentangling the latent variables of style and content in language models. We propose a simple yet effective approach, which incorporates auxiliary multi-task and adversarial objectives, for label prediction and bag-of-words prediction, respectively. We show, both qualitatively and quantitatively, that the style and content are indeed disentangled in the latent space. This disentangled latent representation learning method is applied to style transfer on non-parallel corpora. We achieve substantially better results in terms of transfer accuracy, content preservation and language fluency, in comparison to previous state-of-the-art approaches.
Key facts. Cited by 127 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 39; 2022: 30; 2023: 29; 2024: 16; 2025: 9; 2026: 4.
127 papers.
Sort:
By area:
- 2021FUDGE: Controlled Text Generation With Future Discriminatorscited by 374
- 2023Text Embeddings Reveal (Almost) As Much As Textcited by 189
- 2021Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfercited by 147
- 2022Disentangled Representation Learningcited by 111
- 2021Continual Learning for Text Classification with Information Disentanglement Based Regularizationcited by 86
- 2021Text Detoxification using Large Pre-trained Neural Modelscited by 52
- 2021LEWIS: Levenshtein Editing for Unsupervised Text Style Transfercited by 40
- 2021MuseMorphose: Full-Song and Fine-Grained Piano Music Style Transfer with One Transformer VAEcited by 39
- 2021A Novel Estimator of Mutual Information for Learning to Disentangle Textual Representationscited by 37
- 2021StylePTB: A Compositional Benchmark for Fine-grained Controllable Text Style Transfercited by 34
- 2021Civil Rephrases Of Toxic Texts With Self-Supervised Transformerscited by 32
- 2022Unified Detoxifying and Debiasing in Language Generation via Inference-time Adaptive Optimizationcited by 32
38 more
- 2021Disentangled Sequence to Sequence Learning for Compositional Generalizationcited by 30
- 2023Learning Interpretable Style Embeddings via Prompting LLMscited by 29
- 2021Thank you BART! Rewarding Pre-Trained Models Improves Formality Style Transfercited by 28
- 2021DisenHAN: Disentangled Heterogeneous Graph Attention Network for Recommendationcited by 28
- 2021Detect and Perturb: Neutral Rewriting of Biased and Sensitive Text via Gradient-based Decodingcited by 23
- 2021Disentangling Semantics and Syntax in Sentence Embeddings with Pre-trained Language Modelscited by 22
- 2021Convex Aggregation for Opinion Summarizationcited by 21
- 2022DyTed: Disentangled Representation Learning for Discrete-time Dynamic Graphcited by 21
- 2022Fuse It More Deeply! A Variational Transformer with Layer-Wise Latent Variable Inference for Text Generationcited by 20
- 2022Controllable Data Generation by Deep Learning: A Reviewcited by 20
- 2022VCNet: A self-explaining model for realistic counterfactual generationcited by 20
- 2021DisenKGAT: Knowledge Graph Embedding with Disentangled Graph Attention Networkcited by 19
- 2021Disentangling Generative Factors in Natural Language with Discrete Variational Autoencoderscited by 19
- 2022Why is constrained neural language generation particularly challenging?cited by 19
- 2021A Review of Text Style Transfer using Deep Learningcited by 18
- 2022How to keep text private? A systematic review of deep learning methods for privacy-preserving natural language processingcited by 16
- 2023Prompt-Based Editing for Text Style Transfercited by 16
- 2024Are AI-Generated Text Detectors Robust to Adversarial Perturbations?cited by 16
- 2021Disentangling Representations of Text by Masking Transformerscited by 15
- 2022Unsupervised Structure-Texture Separation Network for Oracle Character Recognitioncited by 15
- 2023Exploring Methods for Cross-lingual Text Style Transfer: The Case of Text Detoxificationcited by 15
- 2021Methods for Detoxification of Texts for the Russian Languagecited by 13
- 2022Learning Disentangled Representations of Negation and Uncertaintycited by 13
- 2023A Call for Standardization and Validation of Text Style Transfer Evaluationcited by 13
- 2024Counterfactual Generation with Identifiability Guaranteescited by 13
- 2021Transductive Learning for Unsupervised Text Style Transfercited by 12
- 2022Learning Disentangled Representations for Natural Language Definitionscited by 12
- 2023Multidimensional Evaluation for Text Style Transfer Using ChatGPTcited by 12
- 2022Human Judgement as a Compass to Navigate Automatic Metrics for Formality Transfercited by 11
- 2022Non-Parallel Text Style Transfer with Self-Parallel Supervisioncited by 11
- 2023Stylized Data-to-Text Generation: A Case Study in the E-Commerce Domaincited by 11
- 2021Generic resources are what you need: Style transfer tasks without task-specific parallel training datacited by 10
- 2023Simple Disentanglement of Style and Content in Visual Representationscited by 10
- 2021Political Depolarization of News Articles Using Attribute-aware Word Embeddingscited by 9
- 2022StoryTrans: Non-Parallel Story Author-Style Transfer with Discourse Representations and Content Enhancingcited by 8
- 2021NAST: A Non-Autoregressive Generator with Word Alignment for Unsupervised Text Style Transfercited by 7
- 2022Efficient Reinforcement Learning for Unsupervised Controlled Text Generationcited by 7
- 2022Towards Robust and Semantically Organised Latent Representations for Unsupervised Text Style Transfercited by 7
50 most cited of 127 All 127 (JSON)
- 2026Values as Style: Disentangling Values from Semantics with One-Way Mixing for Low-Damage LLM Steering30 Sep 2026
- 2026QuanText: Protecting Dataset-Level Secrets in Textual Data Sharing16 Sep 2026
- 2026Content-Style Identification via Differential Independence18 May 2026
- 2026UpSkill: Mutual Information Skill Learning for Structured Response Diversity in LLMs25 Feb 2026
- 2025Characterizing Mamba's Selective Memory using Auto-Encoders17 Dec 2025
- 2025iBERT: Interpretable Embeddings via Sense Decomposition10 Oct 2025
- 2025Controllable Stylistic Text Generation with Train-Time Attribute-Regularized Diffusion7 Oct 2025
- 2025Bridging Compositional and Distributional Semantics: A Survey on Latent Semantic Geometry via AutoEncoder25 Jun 2025
- 2025BiMa: Towards Biases Mitigation for Text-Video Retrieval via Scene Element Guidance4 Jun 2025
- 2025What's in a prompt? Language models encode literary style in prompt embeddings19 May 2025
- 2025ELSA: A Style Aligned Dataset for Emotionally Intelligent Language Generation11 Apr 2025
- 2025LucidAtlas: Learning Uncertainty-Aware, Covariate-Disentangled, Individualized Atlas Representations12 Feb 2025
38 more
- 2025Challenging Assumptions in Learning Generic Text Style Embeddings27 Jan 2025
- 2024Disentangling Preference Representation and Text Generation for Efficient Individual Preference Alignment30 Dec 2024
- 2024Distilling Monolingual and Crosslingual Word-in-Context Representations13 Sep 2024
- 2024FiSTECH: Financial Style Transfer to Enhance Creativity without Hallucinations in LLMs9 Aug 2024
- 2024A Survey of Text Style Transfer: Applications and Ethical Implications23 Jul 2024
- 2024Text Style Transfer: An Introductory Overview20 Jul 2024
- 2024Disentangling Representations through Multi-task Learning15 Jul 2024
- 2024Causal Discovery Inspired Unsupervised Domain Adaptation for Emotion-Cause Pair Extraction18 Jun 2024
- 2024Style Transfer with Multi-iteration Preference Optimization17 Jun 2024
- 2024SC2: Towards Enhancing Content Preservation and Style Consistency in Long Text Style Transfer7 Jun 2024
- 2024Are AI-Generated Text Detectors Robust to Adversarial Perturbations?3 Jun 2024
- 2024Multi-Aspect Controllable Text Generation with Disentangled Counterfactual Augmentation30 May 2024
- 2024Disentangling Instructive Information from Ranked Multiple Candidates for Multi-Document Scientific Summarization16 Apr 2024
- 2024Enhanced Coherence-Aware Network with Hierarchical Disentanglement for Aspect-Category Sentiment Analysis15 Mar 2024
- 2024Counterfactual Generation with Identifiability Guarantees23 Feb 2024
- 2024Unsupervised Text Style Transfer via LLMs and Attention Masking with Multi-way Interactions21 Feb 2024
- 2024Improving Semantic Control in Discrete Latent Spaces with Transformer Quantized Variational Autoencoders1 Feb 2024
- 2023TACIT: A Target-Agnostic Feature Disentanglement Framework for Cross-Domain Text Classification25 Dec 2023
- 2023LlaMaVAE: Guiding Large Language Model Generation via Continuous Latent Sentence Spaces20 Dec 2023
- 2023Disentangling continuous and discrete linguistic signals in transformer-based sentence embeddings18 Dec 2023
- 2023Text Attribute Control via Closed-Loop Disentanglement1 Dec 2023
- 2023BERT Goes Off-Topic: Investigating the Domain Transfer Challenge using Genre Classification27 Nov 2023
- 2023Exploring Methods for Cross-lingual Text Style Transfer: The Case of Text Detoxification23 Nov 2023
- 2023Predicting Scientific Impact Through Diffusion, Conformity, and Contribution Disentanglement15 Nov 2023
- 2023Graph-Induced Syntactic-Semantic Spaces in Transformer-Based Variational AutoEncoders14 Nov 2023
- 2023A Novel Information-Theoretic Objective to Disentangle Representations for Fair Classification21 Oct 2023
- 2023Text Embeddings Reveal (Almost) As Much As Text10 Oct 2023
- 2023Few-Shot Domain Adaptation for Charge Prediction on Unprofessional Descriptions29 Sep 2023
- 2023Unsupervised Text Style Transfer with Deep Generative Models31 Aug 2023
- 2023Towards Controllable Natural Language Inference through Lexical Inference Types7 Aug 2023
- 2023Conditionally Invariant Representation Learning for Disentangling Cellular Heterogeneity2 Jul 2023
- 2023MSSRNet: Manipulating Sequential Style Representation for Unsupervised Text Style Transfer12 Jun 2023
- 2023A Call for Standardization and Validation of Text Style Transfer Evaluation1 Jun 2023
- 2023Counterfactuals of Counterfactuals: a back-translation-inspired approach to analyse counterfactual editors26 May 2023
- 2023Disentangled Variational Autoencoder for Emotion Recognition in Conversations23 May 2023
- 2023Learning Interpretable Style Embeddings via Prompting LLMs22 May 2023
- 2023Adapter-TST: A Parameter Efficient Method for Multiple-Attribute Text Style Transfer10 May 2023
- 2023Cone: Unsupervised Contrastive Opinion Extraction8 May 2023
50 newest of 127 All 127 (JSON)
- 2025Characterizing Mamba's Selective Memory using Auto-Encoders17 Dec 2025
- 2024Disentangling Representations through Multi-task Learning15 Jul 2024
- 2021FUDGE: Controlled Text Generation With Future Discriminatorscited by 374
- 2023Text Embeddings Reveal (Almost) As Much As Textcited by 189
- 2022Disentangled Representation Learningcited by 111
- 2021Continual Learning for Text Classification with Information Disentanglement Based Regularizationcited by 86
- 2021Text Detoxification using Large Pre-trained Neural Modelscited by 52
- 2021LEWIS: Levenshtein Editing for Unsupervised Text Style Transfercited by 40
- 2021MuseMorphose: Full-Song and Fine-Grained Piano Music Style Transfer with One Transformer VAEcited by 39
- 2021A Novel Estimator of Mutual Information for Learning to Disentangle Textual Representationscited by 37
- 2021StylePTB: A Compositional Benchmark for Fine-grained Controllable Text Style Transfercited by 34
- 2021Civil Rephrases Of Toxic Texts With Self-Supervised Transformerscited by 32
- 2022Unified Detoxifying and Debiasing in Language Generation via Inference-time Adaptive Optimizationcited by 32
- 2021Disentangled Sequence to Sequence Learning for Compositional Generalizationcited by 30
12 most cited of 119 All 119 (JSON)
- 2026Values as Style: Disentangling Values from Semantics with One-Way Mixing for Low-Damage LLM Steering30 Sep 2026
- 2026QuanText: Protecting Dataset-Level Secrets in Textual Data Sharing16 Sep 2026
- 2026Content-Style Identification via Differential Independence18 May 2026
- 2025iBERT: Interpretable Embeddings via Sense Decomposition10 Oct 2025
- 2025Bridging Compositional and Distributional Semantics: A Survey on Latent Semantic Geometry via AutoEncoder25 Jun 2025
- 2025What's in a prompt? Language models encode literary style in prompt embeddings19 May 2025
- 2025ELSA: A Style Aligned Dataset for Emotionally Intelligent Language Generation11 Apr 2025
- 2025LucidAtlas: Learning Uncertainty-Aware, Covariate-Disentangled, Individualized Atlas Representations12 Feb 2025
- 2025Challenging Assumptions in Learning Generic Text Style Embeddings27 Jan 2025
- 2024Distilling Monolingual and Crosslingual Word-in-Context Representations13 Sep 2024
- 2024FiSTECH: Financial Style Transfer to Enhance Creativity without Hallucinations in LLMs9 Aug 2024
- 2024A Survey of Text Style Transfer: Applications and Ethical Implications23 Jul 2024
12 newest of 119 All 119 (JSON)