Toward Controlled Generation of Text
Not on the map. Why?
Abstract (arXiv)
Generic generation and manipulation of text is challenging and has limited success compared to recent deep generative modeling in visual domain. This paper aims at generating plausible natural language sentences, whose attributes are dynamically controlled by learning disentangled latent representations with designated semantics. We propose a new neural generative model which combines variational auto-encoders and holistic attribute discriminators for effective imposition of semantic structures. With differentiable approximation to discrete text samples, explicit constraints on independent attribute controls, and efficient collaborative learning of generator and discriminators, our model learns highly interpretable representations from even only word annotations, and produces realistic sentences with desired attributes. Quantitative evaluation validates the accuracy of sentence and attribute generation.
Key facts. Cited by 272 papers in the map (data through 14 Oct 2026). First posted on arXiv 2 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 99; 2022: 74; 2023: 36; 2024: 27; 2025: 22; 2026: 14.
272 papers.
Sort:
By area:
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,546
- 2021FUDGE: Controlled Text Generation With Future Discriminatorscited by 376
- 2022RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learningcited by 366
- 2022Extracting Latent Steering Vectors from Pretrained Language Modelscited by 225
- 2022Generating Training Data with Language Models: Towards Zero-Shot Language Understandingcited by 199
- 2023Text Embeddings Reveal (Almost) As Much As Textcited by 192
- 2022COLD Decoding: Energy-based Constrained Text Generation with Langevin Dynamicscited by 161
- 2021Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfercited by 158
- 2021NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristicscited by 154
- 2021ZeroCap: Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmeticcited by 150
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Modelscited by 129
38 more
- 2022Disentangled Representation Learningcited by 112
- 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLPcited by 101
- 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validationcited by 93
- 2021Continual Learning for Text Classification with Information Disentanglement Based Regularizationcited by 86
- 2021Towards Facilitating Empathic Conversations in Online Mental Health Support: A Reinforcement Learning Approachcited by 75
- 2022Controllable Natural Language Generation with Contrastive Prefixescited by 75
- 2021Controlled Text Generation as Continuous Optimization with Multiple Constraintscited by 70
- 2023COLLIE: Systematic Construction of Constrained Text Generation Taskscited by 70
- 2021Tailor: Generating and Perturbing Text with Semantic Controlscited by 68
- 2023Building Emotional Support Chatbots in the Era of LLMscited by 62
- 2021T-Miner: A Generative Approach to Defend Against Trojan Attacks on DNN-based Text Classificationcited by 60
- 2021Compression, Transduction, and Creation: A Unified Framework for Evaluating Natural Language Generationcited by 60
- 2023PLANNER: Generating Diversified Paragraph via Latent Language Diffusion Modelcited by 58
- 2022LENS: A Learnable Evaluation Metric for Text Simplificationcited by 54
- 2021XFORMAL: A Benchmark for Multilingual Formality Style Transfercited by 52
- 2021Text Detoxification using Large Pre-trained Neural Modelscited by 52
- 2022Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Arbitrary Textual Style Transfer with Small Language Modelscited by 49
- 2021Generating Syntactically Controlled Paraphrases without Using Annotated Parallel Pairscited by 45
- 2022A Causal Lens for Controllable Text Generationcited by 45
- 2022Critic-Guided Decoding for Controlled Text Generationcited by 45
- 2021Transformer-based Conditional Variational Autoencoder for Controllable Story Generationcited by 44
- 2022Automatic Generation of Socratic Subquestions for Teaching Math Word Problemscited by 43
- 2021Controlling Hallucinations at Word Level in Data-to-Text Generationcited by 41
- 2024Large Language Models for Medicine: A Surveycited by 38
- 2021A Novel Estimator of Mutual Information for Learning to Disentangle Textual Representationscited by 37
- 2021Efficient (Soft) Q-Learning for Text Generation with Limited Good Datacited by 37
- 2021Controllable Neural Dialogue Summarization with Personal Named Entity Planningcited by 36
- 2022Tuning Language Models as Training Data Generators for Augmentation-Enhanced Few-Shot Learningcited by 36
- 2022Detoxifying Text with MaRCo: Controllable Revision with Experts and Anti-Expertscited by 36
- 2021Controllable Semantic Parsing via Retrieval Augmentationcited by 35
- 2022Intention-Conditioned Long-Term Human Egocentric Action Forecastingcited by 35
- 2021StylePTB: A Compositional Benchmark for Fine-grained Controllable Text Style Transfercited by 34
- 2022A Distributional Lens for Multi-Aspect Controllable Text Generationcited by 33
- 2021Civil Rephrases Of Toxic Texts With Self-Supervised Transformerscited by 32
- 2022Inducing Positive Perspectives with Text Reframingcited by 31
- 2021Explain Me the Painting: Multi-Topic Knowledgeable Art Description Generationcited by 30
- 2022PLANET: Dynamic Content Planning in Autoregressive Transformers for Long-form Text Generationcited by 30
- 2022CTRLEval: An Unsupervised Reference-Free Metric for Evaluating Controlled Text Generationcited by 29
50 most cited of 272 All 272 (JSON)
- 2026ConvoDrift: A Multi-Turn Conversational Dataset for Modeling Stylistic Tone Evolution2 Oct 2026
- 2026SENSESHIFT: Continuous Sentiment-Controlled Text Generation via Encoder-based Mask Infilling25 Aug 2026
- 2026LITERARYBIGFIVE: Author-Personalized Text Generation in a Unified Interpretable Space24 Aug 2026
- 2026Subjective Multi-Bias Detection with Large Language Models10 Aug 2026
- 2026TAPR: Enhancing LLM Performance with a Task-Aware Prompt Rewriter17 Jul 2026
- 2026COBART: Controlled, Optimized, Bidirectional and Auto-Regressive Transformer for Ad Headline Generation9 Jul 2026
- 2026Interpreting Style Representations via Style-Eliciting Prompts4 Jun 2026
- 2026Guidance Is Not a Hyperparameter: Learning Dynamic Control in Diffusion Language Models8 May 2026
- 2026Are Emotion and Rhetoric Neurons in LLM? Neuron Recognition and Adaptive Masking for Emotion-Rhetoric Prediction Steering19 Apr 2026
- 2026Conversational Control with Ontologies for Large Language Models: A Lightweight Framework for Constrained Generation6 Apr 2026
- 2026MOSLD-Bench: Multilingual Open-Set Learning and Discovery Benchmark for Text Categorization19 Jan 2026
- 2026Codified Foreshadowing-Payoff Text Generation11 Jan 2026
38 more
- 2026Time Travel Engine: A Shared Latent Chronological Manifold Enables Historical Navigation in Large Language Models10 Jan 2026
- 2026Text Detoxification in isiXhosa and Yor`ub'a: A Cross-Lingual Machine Learning Approach for Low-Resource African Languages9 Jan 2026
- 2025Generation, Evaluation, and Explanation of Novelists' Styles with Single-Token Prompts25 Nov 2025
- 2025Cross-Sensor Touch Generation10 Oct 2025
- 2025Large-Scale Constraint Generation -- Can LLMs Parse Hundreds of Constraints?28 Sep 2025
- 2025LatentGuard: Controllable Latent Steering for Robust Refusal of Attacks and Reliable Response Generation24 Sep 2025
- 2025Can LLMs Generate High-Quality Task-Specific Conversations?4 Aug 2025
- 2025Test-Time-Matching: Decouple Personality, Memory, and Linguistic Style in LLM-based Role-Playing Language Agent22 Jul 2025
- 2025NeuralOS: Towards Simulating Operating Systems via Neural Generative Models11 Jul 2025
- 2025Bridging Compositional and Distributional Semantics: A Survey on Latent Semantic Geometry via AutoEncoder25 Jun 2025
- 2025DiscoSum: Discourse-aware News Summarization7 Jun 2025
- 2025EasyEdit2: An Easy-to-use Steering Framework for Editing Large Language Models21 Apr 2025
- 2025On-device Sora: Enabling Training-Free Diffusion-based Text-to-Video Generation for Mobile Devices31 Mar 2025
- 2025Synthetic Data Augmentation for Cross-domain Implicit Discourse Relation Recognition26 Mar 2025
- 2025Palette of Language Models: A Solver for Controlled Text Generation14 Mar 2025
- 2025Mimicking How Humans Interpret Out-of-Context Sentences Through Controlled Toxicity Decoding11 Mar 2025
- 2025Dr Genre: Reinforcement Learning from Decoupled LLM Feedback for Generic Text Rewriting9 Mar 2025
- 2025Set-Theoretic Compositionality of Sentence Embeddings28 Feb 2025
- 2025Transfer Learning in Latent Contextual Bandits with Covariate Shift Through Causal Transportability27 Feb 2025
- 2025Text Classification Under Class Distribution Shift: A Survey18 Feb 2025
- 2025On-device Sora: Enabling Training-Free Diffusion-based Text-to-Video Generation for Mobile Devices5 Feb 2025
- 2025Synthetic Artifact Auditing: Tracing LLM-Generated Synthetic Data Usage in Downstream Applications2 Feb 2025
- 2025Scalable Multi-phase Word Embedding Using Conjunctive Propositional Clauses31 Jan 2025
- 2025Challenging Assumptions in Learning Generic Text Style Embeddings27 Jan 2025
- 2024Disentangling Preference Representation and Text Generation for Efficient Individual Preference Alignment30 Dec 2024
- 2024What You See Is What Matters: A Novel Visual and Physics-Based Metric for Evaluating Video Generation Quality20 Nov 2024
- 2024LingGen: Scalable Multi-Attribute Linguistic Control via Power-Law Masking31 Oct 2024
- 2024Exploring Empty Spaces: Human-in-the-Loop Data Augmentation1 Oct 2024
- 2024Preference-Guided Reflective Sampling for Aligning Language Models22 Aug 2024
- 2024Positive Text Reframing under Multi-strategy Optimization25 Jul 2024
- 2024A Survey of Text Style Transfer: Applications and Ethical Implications23 Jul 2024
- 2024Text Style Transfer: An Introductory Overview20 Jul 2024
- 2024A Survey of Controllable Learning: Methods and Applications in Information Retrieval4 Jul 2024
- 2024A Survey on Natural Language Counterfactual Generation4 Jul 2024
- 2024A Probability--Quality Trade-off in Aligned Language Models and its Relation to Sampling Adaptors14 Jun 2024
- 2024Evaluating the Smooth Control of Attribute Intensity in Text Generation with LLMs6 Jun 2024
- 2024Multilingual Text Style Transfer: Datasets & Models for Indian Languages31 May 2024
- 2024Large Language Models for Medicine: A Survey20 May 2024
50 newest of 272 All 272 (JSON)
- 2023PLANNER: Generating Diversified Paragraph via Latent Language Diffusion Modelcited by 58
- 2025On-device Sora: Enabling Training-Free Diffusion-based Text-to-Video Generation for Mobile Devicescited by 15
- 2024Unified Generation, Reconstruction, and Representation: Generalized Diffusion with Adaptive Latent Encoding-Decodingcited by 10
- 2023PoetryDiffusion: Towards Joint Semantic and Metrical Manipulation in Poetry Generationcited by 7
- 2025On-device Sora: Enabling Training-Free Diffusion-based Text-to-Video Generation for Mobile Devicescited by 0
- 2026Guidance Is Not a Hyperparameter: Learning Dynamic Control in Diffusion Language Modelscited by 0
- 2026Guidance Is Not a Hyperparameter: Learning Dynamic Control in Diffusion Language Models8 May 2026
- 2025On-device Sora: Enabling Training-Free Diffusion-based Text-to-Video Generation for Mobile Devices31 Mar 2025
- 2025On-device Sora: Enabling Training-Free Diffusion-based Text-to-Video Generation for Mobile Devices5 Feb 2025
- 2024Unified Generation, Reconstruction, and Representation: Generalized Diffusion with Adaptive Latent Encoding-Decoding29 Feb 2024
- 2023PoetryDiffusion: Towards Joint Semantic and Metrical Manipulation in Poetry Generation14 Jun 2023
- 2023PLANNER: Generating Diversified Paragraph via Latent Language Diffusion Model5 Jun 2023
- 2024Preference-Guided Reflective Sampling for Aligning Language Modelscited by 4
- 2024Disentangling Preference Representation and Text Generation for Efficient Individual Preference Alignmentcited by 4
- 2025Dr Genre: Reinforcement Learning from Decoupled LLM Feedback for Generic Text Rewritingcited by 3
- 2025LatentGuard: Controllable Latent Steering for Robust Refusal of Attacks and Reliable Response Generationcited by 2
- 2024A Probability--Quality Trade-off in Aligned Language Models and its Relation to Sampling Adaptorscited by 0
- 2025LatentGuard: Controllable Latent Steering for Robust Refusal of Attacks and Reliable Response Generation24 Sep 2025
- 2025Dr Genre: Reinforcement Learning from Decoupled LLM Feedback for Generic Text Rewriting9 Mar 2025
- 2024Disentangling Preference Representation and Text Generation for Efficient Individual Preference Alignment30 Dec 2024
- 2024Preference-Guided Reflective Sampling for Aligning Language Models22 Aug 2024
- 2024A Probability--Quality Trade-off in Aligned Language Models and its Relation to Sampling Adaptors14 Jun 2024
- 2021Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfercited by 158
- 2021T-Miner: A Generative Approach to Defend Against Trojan Attacks on DNN-based Text Classificationcited by 60
- 2023Adversarial Fine-Tuning of Language Models: An Iterative Optimisation Approach for the Generation and Detection of Problematic Contentcited by 7
- 2024Exploring Empty Spaces: Human-in-the-Loop Data Augmentationcited by 6
- 2024Exploring Empty Spaces: Human-in-the-Loop Data Augmentation1 Oct 2024
- 2023Adversarial Fine-Tuning of Language Models: An Iterative Optimisation Approach for the Generation and Detection of Problematic Content26 Aug 2023
- 2021Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfer14 Oct 2021
- 2021T-Miner: A Generative Approach to Defend Against Trojan Attacks on DNN-based Text Classification7 Mar 2021
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,546
- 2021FUDGE: Controlled Text Generation With Future Discriminatorscited by 376
- 2022RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learningcited by 366
- 2022Generating Training Data with Language Models: Towards Zero-Shot Language Understandingcited by 199
- 2023Text Embeddings Reveal (Almost) As Much As Textcited by 192
- 2022COLD Decoding: Energy-based Constrained Text Generation with Langevin Dynamicscited by 161
- 2021NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristicscited by 154
- 2021ZeroCap: Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmeticcited by 150
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Modelscited by 129
- 2022Disentangled Representation Learningcited by 112
- 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLPcited by 101
- 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validationcited by 93
12 most cited of 248 All 248 (JSON)
- 2026ConvoDrift: A Multi-Turn Conversational Dataset for Modeling Stylistic Tone Evolution2 Oct 2026
- 2026SENSESHIFT: Continuous Sentiment-Controlled Text Generation via Encoder-based Mask Infilling25 Aug 2026
- 2026LITERARYBIGFIVE: Author-Personalized Text Generation in a Unified Interpretable Space24 Aug 2026
- 2026Subjective Multi-Bias Detection with Large Language Models10 Aug 2026
- 2026TAPR: Enhancing LLM Performance with a Task-Aware Prompt Rewriter17 Jul 2026
- 2026COBART: Controlled, Optimized, Bidirectional and Auto-Regressive Transformer for Ad Headline Generation9 Jul 2026
- 2026Interpreting Style Representations via Style-Eliciting Prompts4 Jun 2026
- 2026Conversational Control with Ontologies for Large Language Models: A Lightweight Framework for Constrained Generation6 Apr 2026
- 2026MOSLD-Bench: Multilingual Open-Set Learning and Discovery Benchmark for Text Categorization19 Jan 2026
- 2026Codified Foreshadowing-Payoff Text Generation11 Jan 2026
- 2026Time Travel Engine: A Shared Latent Chronological Manifold Enables Historical Navigation in Large Language Models10 Jan 2026
- 2026Text Detoxification in isiXhosa and Yor`ub'a: A Cross-Lingual Machine Learning Approach for Low-Resource African Languages9 Jan 2026
12 newest of 248 All 248 (JSON)