Controllable Text Generation for Large Language Models: A Survey
Not on the map. Why?
Abstract (arXiv)
In Natural Language Processing (NLP), Large Language Models (LLMs) have demonstrated high text generation quality. However, in real-world applications, LLMs must meet increasingly complex requirements. Beyond avoiding misleading or inappropriate content, LLMs are also expected to cater to specific user needs, such as imitating particular writing styles or generating text with poetic richness. These varied demands have driven the development of Controllable Text Generation (CTG) techniques, which ensure that outputs adhere to predefined control conditions--such as safety, sentiment, thematic consistency, and linguistic style--while maintaining high standards of helpfulness, fluency, and diversity. This paper systematically reviews the latest advancements in CTG for LLMs, offering a comprehensive definition of its core concepts and clarifying the requirements for control conditions and text quality. We categorize CTG tasks into two primary types: content control and attribute control. The key methods are discussed, including model retraining, fine-tuning, reinforcement learning, prompt engineering, latent space manipulation, and decoding-time intervention. We analyze each method's characteristics, advantages, and limitations, providing nuanced insights for achieving generation control. Additionally, we review CTG evaluation methods, summarize its applications across domains, and address key challenges in current research, including reduced fluency and practicality. We also propose several appeals, such as placing greater emphasis on real-world applications in future research. This paper aims to offer valuable guidance to researchers and developers in the field. Our reference list and Chinese version are open-sourced at https://github.com/IAAR-Shanghai/CTGSurvey.
Key facts. Cited by 55 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Aug 2024.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2024: 4; 2025: 31; 2026: 20.
55 papers.
Sort:
By area:
- 2024Attention Heads of Large Language Models: A Surveycited by 65
- 2025PhysReason: A Comprehensive Benchmark towards Physics-Based Reasoningcited by 58
- 2024A Comprehensive Evaluation of Cognitive Biases in LLMscited by 32
- 2026From Recall to Forgetting: Benchmarking Long-Term Memory for Personalized Agentscited by 29
- 2025PARM: Multi-Objective Test-Time Alignment via Preference-Aware Autoregressive Reward Modelcited by 27
- 2025ThinkEdit: Interpretable Weight Editing to Mitigate Overly Short Thinking in Reasoning Modelscited by 17
- 2025Adversarial Paraphrasing: A Universal Attack for Humanizing AI-Generated Textcited by 16
- 2025Personalize Your LLM: Fake it then Align itcited by 15
- 2025Collab: Controlled Decoding using Mixture of Agents for LLM Alignmentcited by 13
- 2024Zero-Shot Strategies for Length-Controllable Summarizationcited by 10
- 2025Measuring and Guiding Monosemanticitycited by 10
- 2025Re-Imagining Multimodal Instruction Tuning: A Representation Viewcited by 9
38 more
- 2025TagRouter: Learning Route to LLMs through Tags for Open-Domain Text Generation Taskscited by 9
- 2025LLMs for Customized Marketing Content Generation and Evaluation at Scalecited by 9
- 2025Pragmatic Inference Chain (PIC) Improving LLMs' Reasoning of Authentic Implicit Toxic Languagecited by 8
- 2025Privacy-Aware Decoding: Mitigating Privacy Leakage of Large Language Models in Retrieval-Augmented Generationcited by 8
- 2026ICON: Indirect Prompt Injection Defense for Agents based on Inference-Time Correctioncited by 8
- 2025Preference Learning for AI Alignment: a Causal Perspectivecited by 6
- 2025Layer as Puzzle Pieces: Compressing Large Language Models through Layer Concatenationcited by 6
- 2026Protecting Language Models Against Unauthorized Distillation through Trace Rewritingcited by 6
- 2024Frame Representation Hypothesis: Multi-Token LLM Interpretability and Concept-Guided Text Generationcited by 5
- 2025MedReadCtrl: Personalizing medical text generation with readability-controlled instruction learningcited by 5
- 2026A Survey on Evaluating Quality and Trustworthiness in LLM-Generated Datacited by 5
- 2025Advancing Decoding Strategies: Enhancements in Locally Typical Sampling for LLMscited by 4
- 2025A Mixture of Linear Corrections Generates Secure Codecited by 4
- 2025Secure and Robust Watermarking for AI-generated Images: A Comprehensive Surveycited by 4
- 2025Vulnerability Mitigation for Safety-Aligned Language Models via Debiasingcited by 3
- 2025Fine-grained Video Dubbing Duration Alignment with Segment Supervised Preference Optimizationcited by 3
- 2025From Sub-Ability Diagnosis to Human-Aligned Generation: Bridging the Gap for Text Length Control via MARKERGENcited by 2
- 2025Evaluating Style-Personalized Text Generation: Challenges and Directionscited by 2
- 2025Robust Preference Alignment via Directional Neighborhood Consensuscited by 2
- 2025Incorporating Structure and Chord Constraints in Symbolic Transformer-based Melodic Harmonizationcited by 2
- 2026Composer Vector: Style-steering Symbolic Music Generation in a Latent Spacecited by 2
- 2025Can LLMs Simulate L2-English Dialogue? An Information-Theoretic Analysis of L1-Dependent Biasescited by 1
- 2025Steered Generation via Gradient Descent on Sparse Featurescited by 1
- 2025LaPA2: Length-Aware Prefix and Prompt Attention Augmentation for Long-Form Controllable Text Generationcited by 1
- 2025How Instruction-Tuning Imparts Length Control: A Cross-Lingual Mechanistic Analysiscited by 1
- 2025Preference Orchestrator: Prompt-Aware Multi-Objective Alignment for Large Language Modelscited by 1
- 2025Data Value in the Age of Scaling: Understanding LLM Scaling Dynamics Under Real-Synthetic Data Mixturescited by 1
- 2026StyleBench: Evaluating Speech Language Models on Conversational Speaking Style Controlcited by 1
- 2026BiST: A Gold Standard Bangla-English Bilingual Corpus for Sentence Structure and Tense Classification with Inter-Annotator Agreementcited by 1
- 2026Meta-Aligner: Bidirectional Preference-Policy Optimization for Multi-Objective LLMs Alignmentcited by 1
- 2026Position: AI Safety Requires Effective Controllabilitycited by 1
- 2026Do Sparse Autoencoders Learn Meaningful Concept Hierarchies?cited by 1
- 2026Aligning Language Models with Selective Predictioncited by 1
- 2025AutoSynth: Automated Workflow Optimization for High-Quality Synthetic Dataset Generation via Monte Carlo Tree Searchcited by 0
- 2026Codified Foreshadowing-Payoff Text Generationcited by 0
- 2026Escaping the BLEU Trap: A Signal-Grounded Framework with Decoupled Semantic Guidance for EEG-to-Text Decodingcited by 0
- 2026VRM: Teaching Reward Models to Understand Authentic Human Preferencescited by 0
- 2026Combating Data Laundering in LLM Trainingcited by 0
50 most cited of 55 All 55 (JSON)
- 2026SteerDuplex: Steerable Duplex Speech Dialogue Models11 Sep 2026
- 2026Beyond Tokens: A Survey on Decoding Methods for Large Language and Vision-Language Models14 Aug 2026
- 2026ARC: Fair Relative Advantage Comparison in Open-Ended Real-World Interaction13 Aug 2026
- 2026Aligning Language Models with Selective Prediction3 Jul 2026
- 2026Do Sparse Autoencoders Learn Meaningful Concept Hierarchies?22 Jun 2026
- 2026Answer Engineering: Local Trajectory Editing for Protocol-Constrained Decision Making in Large Language Models19 Jun 2026
- 2026Position: AI Safety Requires Effective Controllability26 May 2026
- 2026Meta-Aligner: Bidirectional Preference-Policy Optimization for Multi-Objective LLMs Alignment27 Apr 2026
- 2026From Recall to Forgetting: Benchmarking Long-Term Memory for Personalized Agents21 Apr 2026
- 2026BiST: A Gold Standard Bangla-English Bilingual Corpus for Sentence Structure and Tense Classification with Inter-Annotator Agreement6 Apr 2026
- 2026Conversational Control with Ontologies for Large Language Models: A Lightweight Framework for Constrained Generation6 Apr 2026
- 2026Composer Vector: Style-steering Symbolic Music Generation in a Latent Space3 Apr 2026
38 more
- 2026Combating Data Laundering in LLM Training2 Apr 2026
- 2026StyleBench: Evaluating Speech Language Models on Conversational Speaking Style Control8 Mar 2026
- 2026VRM: Teaching Reward Models to Understand Authentic Human Preferences5 Mar 2026
- 2026ICON: Indirect Prompt Injection Defense for Agents based on Inference-Time Correction24 Feb 2026
- 2026Protecting Language Models Against Unauthorized Distillation through Trace Rewriting16 Feb 2026
- 2026Escaping the BLEU Trap: A Signal-Grounded Framework with Decoupled Semantic Guidance for EEG-to-Text Decoding9 Feb 2026
- 2026A Survey on Evaluating Quality and Trustworthiness in LLM-Generated Data25 Jan 2026
- 2026Codified Foreshadowing-Payoff Text Generation11 Jan 2026
- 2025Incorporating Structure and Chord Constraints in Symbolic Transformer-based Melodic Harmonization8 Dec 2025
- 2025Data Value in the Age of Scaling: Understanding LLM Scaling Dynamics Under Real-Synthetic Data Mixtures17 Nov 2025
- 2025AutoSynth: Automated Workflow Optimization for High-Quality Synthetic Dataset Generation via Monte Carlo Tree Search12 Nov 2025
- 2025Preference Orchestrator: Prompt-Aware Multi-Objective Alignment for Large Language Models3 Nov 2025
- 2025Robust Preference Alignment via Directional Neighborhood Consensus23 Oct 2025
- 2025Layer as Puzzle Pieces: Compressing Large Language Models through Layer Concatenation17 Oct 2025
- 2025Secure and Robust Watermarking for AI-generated Images: A Comprehensive Survey30 Sep 2025
- 2025How Instruction-Tuning Imparts Length Control: A Cross-Lingual Mechanistic Analysis2 Sep 2025
- 2025Fine-grained Video Dubbing Duration Alignment with Segment Supervised Preference Optimization12 Aug 2025
- 2025Evaluating Style-Personalized Text Generation: Challenges and Directions8 Aug 2025
- 2025LaPA2: Length-Aware Prefix and Prompt Attention Augmentation for Long-Form Controllable Text Generation6 Aug 2025
- 2025Privacy-Aware Decoding: Mitigating Privacy Leakage of Large Language Models in Retrieval-Augmented Generation5 Aug 2025
- 2025A Mixture of Linear Corrections Generates Secure Code13 Jul 2025
- 2025MedReadCtrl: Personalizing medical text generation with readability-controlled instruction learning10 Jul 2025
- 2025Measuring and Guiding Monosemanticity24 Jun 2025
- 2025LLMs for Customized Marketing Content Generation and Evaluation at Scale22 Jun 2025
- 2025TagRouter: Learning Route to LLMs through Tags for Open-Domain Text Generation Tasks14 Jun 2025
- 2025Adversarial Paraphrasing: A Universal Attack for Humanizing AI-Generated Text8 Jun 2025
- 2025Preference Learning for AI Alignment: a Causal Perspective6 Jun 2025
- 2025Advancing Decoding Strategies: Enhancements in Locally Typical Sampling for LLMs3 Jun 2025
- 2025PARM: Multi-Objective Test-Time Alignment via Preference-Aware Autoregressive Reward Model6 May 2025
- 2025ThinkEdit: Interpretable Weight Editing to Mitigate Overly Short Thinking in Reasoning Models27 Mar 2025
- 2025Collab: Controlled Decoding using Mixture of Agents for LLM Alignment27 Mar 2025
- 2025Pragmatic Inference Chain (PIC) Improving LLMs' Reasoning of Authentic Implicit Toxic Language3 Mar 2025
- 2025Personalize Your LLM: Fake it then Align it2 Mar 2025
- 2025Re-Imagining Multimodal Instruction Tuning: A Representation View2 Mar 2025
- 2025Steered Generation via Gradient Descent on Sparse Features25 Feb 2025
- 2025Can LLMs Simulate L2-English Dialogue? An Information-Theoretic Analysis of L1-Dependent Biases20 Feb 2025
- 2025From Sub-Ability Diagnosis to Human-Aligned Generation: Bridging the Gap for Text Length Control via MARKERGEN19 Feb 2025
- 2025PhysReason: A Comprehensive Benchmark towards Physics-Based Reasoning17 Feb 2025
50 newest of 55 All 55 (JSON)
- 2025PARM: Multi-Objective Test-Time Alignment via Preference-Aware Autoregressive Reward Modelcited by 27
- 2025Personalize Your LLM: Fake it then Align itcited by 15
- 2025Preference Learning for AI Alignment: a Causal Perspectivecited by 6
- 2025Vulnerability Mitigation for Safety-Aligned Language Models via Debiasingcited by 3
- 2025Fine-grained Video Dubbing Duration Alignment with Segment Supervised Preference Optimizationcited by 3
- 2025Robust Preference Alignment via Directional Neighborhood Consensuscited by 2
- 2025Preference Orchestrator: Prompt-Aware Multi-Objective Alignment for Large Language Modelscited by 1
- 2026Meta-Aligner: Bidirectional Preference-Policy Optimization for Multi-Objective LLMs Alignmentcited by 1
- 2026Aligning Language Models with Selective Predictioncited by 1
- 2026VRM: Teaching Reward Models to Understand Authentic Human Preferencescited by 0
- 2026Aligning Language Models with Selective Prediction3 Jul 2026
- 2026Meta-Aligner: Bidirectional Preference-Policy Optimization for Multi-Objective LLMs Alignment27 Apr 2026
- 2026VRM: Teaching Reward Models to Understand Authentic Human Preferences5 Mar 2026
- 2025Preference Orchestrator: Prompt-Aware Multi-Objective Alignment for Large Language Models3 Nov 2025
- 2025Robust Preference Alignment via Directional Neighborhood Consensus23 Oct 2025
- 2025Fine-grained Video Dubbing Duration Alignment with Segment Supervised Preference Optimization12 Aug 2025
- 2025Preference Learning for AI Alignment: a Causal Perspective6 Jun 2025
- 2025PARM: Multi-Objective Test-Time Alignment via Preference-Aware Autoregressive Reward Model6 May 2025
- 2025Personalize Your LLM: Fake it then Align it2 Mar 2025
- 2025Vulnerability Mitigation for Safety-Aligned Language Models via Debiasing4 Feb 2025
- 2025PhysReason: A Comprehensive Benchmark towards Physics-Based Reasoningcited by 58
- 2025ThinkEdit: Interpretable Weight Editing to Mitigate Overly Short Thinking in Reasoning Modelscited by 17
- 2025Pragmatic Inference Chain (PIC) Improving LLMs' Reasoning of Authentic Implicit Toxic Languagecited by 8
- 2025ThinkEdit: Interpretable Weight Editing to Mitigate Overly Short Thinking in Reasoning Models27 Mar 2025
- 2025Pragmatic Inference Chain (PIC) Improving LLMs' Reasoning of Authentic Implicit Toxic Language3 Mar 2025
- 2025PhysReason: A Comprehensive Benchmark towards Physics-Based Reasoning17 Feb 2025
- 2026A Survey on Evaluating Quality and Trustworthiness in LLM-Generated Datacited by 5
- 2025Data Value in the Age of Scaling: Understanding LLM Scaling Dynamics Under Real-Synthetic Data Mixturescited by 1
- 2025AutoSynth: Automated Workflow Optimization for High-Quality Synthetic Dataset Generation via Monte Carlo Tree Searchcited by 0
- 2026A Survey on Evaluating Quality and Trustworthiness in LLM-Generated Data25 Jan 2026
- 2025Data Value in the Age of Scaling: Understanding LLM Scaling Dynamics Under Real-Synthetic Data Mixtures17 Nov 2025
- 2025AutoSynth: Automated Workflow Optimization for High-Quality Synthetic Dataset Generation via Monte Carlo Tree Search12 Nov 2025
- 2024Attention Heads of Large Language Models: A Surveycited by 65
- 2024A Comprehensive Evaluation of Cognitive Biases in LLMscited by 32
- 2025Adversarial Paraphrasing: A Universal Attack for Humanizing AI-Generated Textcited by 16
- 2024Zero-Shot Strategies for Length-Controllable Summarizationcited by 10
- 2025Measuring and Guiding Monosemanticitycited by 10
- 2025TagRouter: Learning Route to LLMs through Tags for Open-Domain Text Generation Taskscited by 9
- 2025LLMs for Customized Marketing Content Generation and Evaluation at Scalecited by 9
- 2025Layer as Puzzle Pieces: Compressing Large Language Models through Layer Concatenationcited by 6
- 2024Frame Representation Hypothesis: Multi-Token LLM Interpretability and Concept-Guided Text Generationcited by 5
- 2025MedReadCtrl: Personalizing medical text generation with readability-controlled instruction learningcited by 5
- 2025Advancing Decoding Strategies: Enhancements in Locally Typical Sampling for LLMscited by 4
- 2025A Mixture of Linear Corrections Generates Secure Codecited by 4
12 most cited of 31 All 31 (JSON)
- 2026SteerDuplex: Steerable Duplex Speech Dialogue Models11 Sep 2026
- 2026ARC: Fair Relative Advantage Comparison in Open-Ended Real-World Interaction13 Aug 2026
- 2026Do Sparse Autoencoders Learn Meaningful Concept Hierarchies?22 Jun 2026
- 2026Answer Engineering: Local Trajectory Editing for Protocol-Constrained Decision Making in Large Language Models19 Jun 2026
- 2026Position: AI Safety Requires Effective Controllability26 May 2026
- 2026BiST: A Gold Standard Bangla-English Bilingual Corpus for Sentence Structure and Tense Classification with Inter-Annotator Agreement6 Apr 2026
- 2026Conversational Control with Ontologies for Large Language Models: A Lightweight Framework for Constrained Generation6 Apr 2026
- 2026Composer Vector: Style-steering Symbolic Music Generation in a Latent Space3 Apr 2026
- 2026Combating Data Laundering in LLM Training2 Apr 2026
- 2026StyleBench: Evaluating Speech Language Models on Conversational Speaking Style Control8 Mar 2026
- 2026Escaping the BLEU Trap: A Signal-Grounded Framework with Decoupled Semantic Guidance for EEG-to-Text Decoding9 Feb 2026
- 2026Codified Foreshadowing-Payoff Text Generation11 Jan 2026
12 newest of 31 All 31 (JSON)