mlsanityData to 7 Oct 2026

Controllable Text Generation for Large Language Models: A Survey

arXiv 2408.12599 ↗First posted 22 Aug 2024cs.CLcited by 55

Not on the map. Why?

Abstract (arXiv)

In Natural Language Processing (NLP), Large Language Models (LLMs) have demonstrated high text generation quality. However, in real-world applications, LLMs must meet increasingly complex requirements. Beyond avoiding misleading or inappropriate content, LLMs are also expected to cater to specific user needs, such as imitating particular writing styles or generating text with poetic richness. These varied demands have driven the development of Controllable Text Generation (CTG) techniques, which ensure that outputs adhere to predefined control conditions--such as safety, sentiment, thematic consistency, and linguistic style--while maintaining high standards of helpfulness, fluency, and diversity. This paper systematically reviews the latest advancements in CTG for LLMs, offering a comprehensive definition of its core concepts and clarifying the requirements for control conditions and text quality. We categorize CTG tasks into two primary types: content control and attribute control. The key methods are discussed, including model retraining, fine-tuning, reinforcement learning, prompt engineering, latent space manipulation, and decoding-time intervention. We analyze each method's characteristics, advantages, and limitations, providing nuanced insights for achieving generation control. Additionally, we review CTG evaluation methods, summarize its applications across domains, and address key challenges in current research, including reduced fluency and practicality. We also propose several appeals, such as placing greater emphasis on real-world applications in future research. This paper aims to offer valuable guidance to researchers and developers in the field. Our reference list and Chinese version are open-sourced at https://github.com/IAAR-Shanghai/CTGSurvey.

Key facts. Cited by 55 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Aug 2024.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 31; 2026: 20.

55 papers.

Sort:

By area:

  1. 2024Attention Heads of Large Language Models: A Surveycited by 65
  2. 2025PhysReason: A Comprehensive Benchmark towards Physics-Based Reasoningcited by 58
  3. 2024A Comprehensive Evaluation of Cognitive Biases in LLMscited by 32
  4. 2026From Recall to Forgetting: Benchmarking Long-Term Memory for Personalized Agentscited by 29
  5. 2025PARM: Multi-Objective Test-Time Alignment via Preference-Aware Autoregressive Reward Modelcited by 27
  6. 2025ThinkEdit: Interpretable Weight Editing to Mitigate Overly Short Thinking in Reasoning Modelscited by 17
  7. 2025Adversarial Paraphrasing: A Universal Attack for Humanizing AI-Generated Textcited by 16
  8. 2025Personalize Your LLM: Fake it then Align itcited by 15
  9. 2025Collab: Controlled Decoding using Mixture of Agents for LLM Alignmentcited by 13
  10. 2024Zero-Shot Strategies for Length-Controllable Summarizationcited by 10
  11. 2025Measuring and Guiding Monosemanticitycited by 10
  12. 2025Re-Imagining Multimodal Instruction Tuning: A Representation Viewcited by 9
38 more
  1. 2025TagRouter: Learning Route to LLMs through Tags for Open-Domain Text Generation Taskscited by 9
  2. 2025LLMs for Customized Marketing Content Generation and Evaluation at Scalecited by 9
  3. 2025Pragmatic Inference Chain (PIC) Improving LLMs' Reasoning of Authentic Implicit Toxic Languagecited by 8
  4. 2025Privacy-Aware Decoding: Mitigating Privacy Leakage of Large Language Models in Retrieval-Augmented Generationcited by 8
  5. 2026ICON: Indirect Prompt Injection Defense for Agents based on Inference-Time Correctioncited by 8
  6. 2025Preference Learning for AI Alignment: a Causal Perspectivecited by 6
  7. 2025Layer as Puzzle Pieces: Compressing Large Language Models through Layer Concatenationcited by 6
  8. 2026Protecting Language Models Against Unauthorized Distillation through Trace Rewritingcited by 6
  9. 2024Frame Representation Hypothesis: Multi-Token LLM Interpretability and Concept-Guided Text Generationcited by 5
  10. 2025MedReadCtrl: Personalizing medical text generation with readability-controlled instruction learningcited by 5
  11. 2026A Survey on Evaluating Quality and Trustworthiness in LLM-Generated Datacited by 5
  12. 2025Advancing Decoding Strategies: Enhancements in Locally Typical Sampling for LLMscited by 4
  13. 2025A Mixture of Linear Corrections Generates Secure Codecited by 4
  14. 2025Secure and Robust Watermarking for AI-generated Images: A Comprehensive Surveycited by 4
  15. 2025Vulnerability Mitigation for Safety-Aligned Language Models via Debiasingcited by 3
  16. 2025Fine-grained Video Dubbing Duration Alignment with Segment Supervised Preference Optimizationcited by 3
  17. 2025From Sub-Ability Diagnosis to Human-Aligned Generation: Bridging the Gap for Text Length Control via MARKERGENcited by 2
  18. 2025Evaluating Style-Personalized Text Generation: Challenges and Directionscited by 2
  19. 2025Robust Preference Alignment via Directional Neighborhood Consensuscited by 2
  20. 2025Incorporating Structure and Chord Constraints in Symbolic Transformer-based Melodic Harmonizationcited by 2
  21. 2026Composer Vector: Style-steering Symbolic Music Generation in a Latent Spacecited by 2
  22. 2025Can LLMs Simulate L2-English Dialogue? An Information-Theoretic Analysis of L1-Dependent Biasescited by 1
  23. 2025Steered Generation via Gradient Descent on Sparse Featurescited by 1
  24. 2025LaPA2: Length-Aware Prefix and Prompt Attention Augmentation for Long-Form Controllable Text Generationcited by 1
  25. 2025How Instruction-Tuning Imparts Length Control: A Cross-Lingual Mechanistic Analysiscited by 1
  26. 2025Preference Orchestrator: Prompt-Aware Multi-Objective Alignment for Large Language Modelscited by 1
  27. 2025Data Value in the Age of Scaling: Understanding LLM Scaling Dynamics Under Real-Synthetic Data Mixturescited by 1
  28. 2026StyleBench: Evaluating Speech Language Models on Conversational Speaking Style Controlcited by 1
  29. 2026BiST: A Gold Standard Bangla-English Bilingual Corpus for Sentence Structure and Tense Classification with Inter-Annotator Agreementcited by 1
  30. 2026Meta-Aligner: Bidirectional Preference-Policy Optimization for Multi-Objective LLMs Alignmentcited by 1
  31. 2026Position: AI Safety Requires Effective Controllabilitycited by 1
  32. 2026Do Sparse Autoencoders Learn Meaningful Concept Hierarchies?cited by 1
  33. 2026Aligning Language Models with Selective Predictioncited by 1
  34. 2025AutoSynth: Automated Workflow Optimization for High-Quality Synthetic Dataset Generation via Monte Carlo Tree Searchcited by 0
  35. 2026Codified Foreshadowing-Payoff Text Generationcited by 0
  36. 2026Escaping the BLEU Trap: A Signal-Grounded Framework with Decoupled Semantic Guidance for EEG-to-Text Decodingcited by 0
  37. 2026VRM: Teaching Reward Models to Understand Authentic Human Preferencescited by 0
  38. 2026Combating Data Laundering in LLM Trainingcited by 0

50 most cited of 55 All 55 (JSON)