Content preserving text generation with attribute controls
Not on the map. Why?
Abstract (arXiv)
In this work, we address the problem of modifying textual attributes of sentences. Given an input sentence and a set of attribute labels, we attempt to generate sentences that are compatible with the conditioning information. To ensure that the model generates content compatible sentences, we introduce a reconstruction loss which interpolates between auto-encoding and back-translation loss components. We propose an adversarial loss to enforce generated samples to be attribute compatible and realistic. Through quantitative, qualitative and human evaluations we demonstrate that our model is capable of generating fluent sentences that better reflect the conditioning information compared to prior methods. We further demonstrate that the model is capable of simultaneously controlling multiple attributes.
Key facts. Cited by 47 papers in the map (data through 14 Oct 2026). First posted on arXiv 3 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 10; 2023: 11; 2024: 4; 2025: 4.
47 papers.
Sort:
By area:
- 2023Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Biascited by 232
- 2021Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyondcited by 178
- 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Modelscited by 129
- 2021NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentationcited by 73
- 2021Controlled Text Generation as Continuous Optimization with Multiple Constraintscited by 70
- 2021XFORMAL: A Benchmark for Multilingual Formality Style Transfercited by 52
- 2021Generating Syntactically Controlled Paraphrases without Using Annotated Parallel Pairscited by 45
- 2024Gradient-Based Language Model Red Teamingcited by 34
- 2021Civil Rephrases Of Toxic Texts With Self-Supervised Transformerscited by 32
- 2022Inducing Positive Perspectives with Text Reframingcited by 31
- 2024Personalized Text Generation with Fine-Grained Linguistic Controlcited by 20
- 2021Sentence Bottleneck Autoencoders from Transformer Language Modelscited by 19
35 more
- 2022Why is constrained neural language generation particularly challenging?cited by 19
- 2021A Review of Text Style Transfer using Deep Learningcited by 18
- 2024Abstractive Text Summarization: State of the Art, Challenges, and Improvementscited by 17
- 2023A Call for Standardization and Validation of Text Style Transfer Evaluationcited by 14
- 2022Learning Disentangled Representations of Negation and Uncertaintycited by 13
- 2021Political Depolarization of News Articles Using Attribute-aware Word Embeddingscited by 9
- 2024Boosting Reward Model with Preference-Conditional Multi-Aspect Synthetic Data Generationcited by 9
- 2022So Different Yet So Alike! Constrained Unsupervised Text Style Transfercited by 7
- 2023Advancements in Scientific Controllable Text Generation Methodscited by 7
- 2023Toward Unified Controllable Text Generation via Regular Expression Instructioncited by 7
- 2021Progressive Open-Domain Response Generation with Multiple Controllable Attributescited by 6
- 2022T-STAR: Truthful Style Transfer using AMR Graph as Intermediate Representationcited by 6
- 2023Evaluating Open-Domain Dialogues in Latent Space with Next Sentence Prediction and Mutual Informationcited by 6
- 2021StyleKQC: A Style-Variant Paraphrase Corpus for Korean Questions and Commandscited by 5
- 2021From Theories on Styles to their Transfer in Text: Bridging the Gap with a Hierarchical Surveycited by 5
- 2022AugCSE: Contrastive Sentence Embedding with Diverse Augmentationscited by 5
- 2025Steering Large Language Models with Register Analysis for Arbitrary Style Transfercited by 5
- 2025Attributes as Textual Genes: Leveraging LLMs as Genetic Algorithm Simulators for Conditional Synthetic Data Generationcited by 5
- 2022StyleFlow: Disentangle Latent Representations via Normalizing Flow for Unsupervised Text Style Transfercited by 4
- 2021GTAE: Graph-Transformer based Auto-Encoders for Linguistic-Constrained Text Style Transfercited by 3
- 2021Syntax Matters! Syntax-Controlled in Text Style Transfercited by 3
- 2022A Review of Affective Generation Modelscited by 3
- 2023Is it Possible to Modify Text to a Target Readability Level? An Initial Investigation Using Zero-Shot Large Language Modelscited by 3
- 2023Adapter-TST: A Parameter Efficient Method for Multiple-Attribute Text Style Transfercited by 2
- 2023Text Attribute Control via Closed-Loop Disentanglementcited by 2
- 2025Steering Language Models in Multi-Token Generation: A Case Study on Tense and Aspectcited by 2
- 2021Transforming Multi-Conditioned Generation from Meaning Representationcited by 1
- 2021A Simple Geometric Method for Cross-Lingual Linguistic Transformations with Pre-trained Autoencoderscited by 1
- 2021SE-DAE: Style-Enhanced Denoising Auto-Encoder for Unsupervised Text Style Transfercited by 1
- 2022An Overview on Controllable Text Generation via Variational Auto-Encoderscited by 1
- 2023Towards Controllable Natural Language Inference through Lexical Inference Typescited by 1
- 2021Empirical Evaluation of Supervision Signals for Style Transfer Modelscited by 0
- 2023Exposing the Functionalities of Neurons for Gated Recurrent Unit Based Sequence-to-Sequence Modelcited by 0
- 2023Unsupervised Text Style Transfer with Deep Generative Modelscited by 0
- 2025Generation, Evaluation, and Explanation of Novelists' Styles with Single-Token Promptscited by 0
- 2025Generation, Evaluation, and Explanation of Novelists' Styles with Single-Token Prompts25 Nov 2025
- 2025Steering Language Models in Multi-Token Generation: A Case Study on Tense and Aspect15 Sep 2025
- 2025Attributes as Textual Genes: Leveraging LLMs as Genetic Algorithm Simulators for Conditional Synthetic Data Generation2 Sep 2025
- 2025Steering Large Language Models with Register Analysis for Arbitrary Style Transfer1 May 2025
- 2024Abstractive Text Summarization: State of the Art, Challenges, and Improvements4 Sep 2024
- 2024Boosting Reward Model with Preference-Conditional Multi-Aspect Synthetic Data Generation22 Jul 2024
- 2024Personalized Text Generation with Fine-Grained Linguistic Control7 Feb 2024
- 2024Gradient-Based Language Model Red Teaming30 Jan 2024
- 2023Text Attribute Control via Closed-Loop Disentanglement1 Dec 2023
- 2023Is it Possible to Modify Text to a Target Readability Level? An Initial Investigation Using Zero-Shot Large Language Models22 Sep 2023
- 2023Toward Unified Controllable Text Generation via Regular Expression Instruction19 Sep 2023
- 2023Unsupervised Text Style Transfer with Deep Generative Models31 Aug 2023
35 more
- 2023Towards Controllable Natural Language Inference through Lexical Inference Types7 Aug 2023
- 2023Advancements in Scientific Controllable Text Generation Methods8 Jul 2023
- 2023Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias28 Jun 2023
- 2023A Call for Standardization and Validation of Text Style Transfer Evaluation1 Jun 2023
- 2023Evaluating Open-Domain Dialogues in Latent Space with Next Sentence Prediction and Mutual Information26 May 2023
- 2023Adapter-TST: A Parameter Efficient Method for Multiple-Attribute Text Style Transfer10 May 2023
- 2023Exposing the Functionalities of Neurons for Gated Recurrent Unit Based Sequence-to-Sequence Model27 Mar 2023
- 2022StyleFlow: Disentangle Latent Representations via Normalizing Flow for Unsupervised Text Style Transfer19 Dec 2022
- 2022T-STAR: Truthful Style Transfer using AMR Graph as Intermediate Representation3 Dec 2022
- 2022An Overview on Controllable Text Generation via Variational Auto-Encoders15 Nov 2022
- 2022AugCSE: Contrastive Sentence Embedding with Diverse Augmentations20 Oct 2022
- 2022Why is constrained neural language generation particularly challenging?11 Jun 2022
- 2022So Different Yet So Alike! Constrained Unsupervised Text Style Transfer9 May 2022
- 2022Inducing Positive Perspectives with Text Reframing6 Apr 2022
- 2022Learning Disentangled Representations of Negation and Uncertainty1 Apr 2022
- 2022A Review of Affective Generation Models22 Feb 2022
- 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Models14 Jan 2022
- 2021NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentation6 Dec 2021
- 2021From Theories on Styles to their Transfer in Text: Bridging the Gap with a Hierarchical Survey29 Oct 2021
- 2021A Review of Text Style Transfer using Deep Learning30 Sep 2021
- 2021Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyond2 Sep 2021
- 2021Sentence Bottleneck Autoencoders from Transformer Language Models31 Aug 2021
- 2021Syntax Matters! Syntax-Controlled in Text Style Transfer12 Aug 2021
- 2021Controlled Text Generation as Continuous Optimization with Multiple Constraints4 Aug 2021
- 2021Progressive Open-Domain Response Generation with Multiple Controllable Attributes7 Jun 2021
- 2021SE-DAE: Style-Enhanced Denoising Auto-Encoder for Unsupervised Text Style Transfer27 Apr 2021
- 2021XFORMAL: A Benchmark for Multilingual Formality Style Transfer8 Apr 2021
- 2021A Simple Geometric Method for Cross-Lingual Linguistic Transformations with Pre-trained Autoencoders8 Apr 2021
- 2021StyleKQC: A Style-Variant Paraphrase Corpus for Korean Questions and Commands24 Mar 2021
- 2021Civil Rephrases Of Toxic Texts With Self-Supervised Transformers1 Feb 2021
- 2021GTAE: Graph-Transformer based Auto-Encoders for Linguistic-Constrained Text Style Transfer1 Feb 2021
- 2021Generating Syntactically Controlled Paraphrases without Using Annotated Parallel Pairs26 Jan 2021
- 2021Empirical Evaluation of Supervision Signals for Style Transfer Models15 Jan 2021
- 2021Transforming Multi-Conditioned Generation from Meaning Representation12 Jan 2021
- 2021Political Depolarization of News Articles Using Attribute-aware Word Embeddings5 Jan 2021
- 2024Gradient-Based Language Model Red Teamingcited by 34
- 2024Gradient-Based Language Model Red Teaming30 Jan 2024
- 2023Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Biascited by 232
- 2021Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyondcited by 178
- 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Modelscited by 129
- 2021NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentationcited by 73
- 2021Controlled Text Generation as Continuous Optimization with Multiple Constraintscited by 70
- 2021XFORMAL: A Benchmark for Multilingual Formality Style Transfercited by 52
- 2021Generating Syntactically Controlled Paraphrases without Using Annotated Parallel Pairscited by 45
- 2021Civil Rephrases Of Toxic Texts With Self-Supervised Transformerscited by 32
- 2022Inducing Positive Perspectives with Text Reframingcited by 31
- 2024Personalized Text Generation with Fine-Grained Linguistic Controlcited by 20
- 2021Sentence Bottleneck Autoencoders from Transformer Language Modelscited by 19
- 2022Why is constrained neural language generation particularly challenging?cited by 19
12 most cited of 44 All 44 (JSON)
- 2025Generation, Evaluation, and Explanation of Novelists' Styles with Single-Token Prompts25 Nov 2025
- 2025Steering Language Models in Multi-Token Generation: A Case Study on Tense and Aspect15 Sep 2025
- 2025Steering Large Language Models with Register Analysis for Arbitrary Style Transfer1 May 2025
- 2024Abstractive Text Summarization: State of the Art, Challenges, and Improvements4 Sep 2024
- 2024Personalized Text Generation with Fine-Grained Linguistic Control7 Feb 2024
- 2023Text Attribute Control via Closed-Loop Disentanglement1 Dec 2023
- 2023Is it Possible to Modify Text to a Target Readability Level? An Initial Investigation Using Zero-Shot Large Language Models22 Sep 2023
- 2023Toward Unified Controllable Text Generation via Regular Expression Instruction19 Sep 2023
- 2023Unsupervised Text Style Transfer with Deep Generative Models31 Aug 2023
- 2023Towards Controllable Natural Language Inference through Lexical Inference Types7 Aug 2023
- 2023Advancements in Scientific Controllable Text Generation Methods8 Jul 2023
- 2023Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias28 Jun 2023
12 newest of 44 All 44 (JSON)