mlsanityData to 14 Oct 2026

PG-CE: A Progressive Generation Dataset with Constraint Enhancement for Controllable Text Generation

arXiv 2509.17669 ↗First posted 22 Sep 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

With the rapid development of Large Language Models (LLMs), Controllable Text Generation (CTG) has become a critical technology for enhancing system reliability and user experience. Addressing the limitations of traditional methods, this paper proposes the PG-CE (Progressive Generation with Constraint Enhancement) approach, which decomposes CTG tasks into three steps: type prediction, constraint construction, and guided generation. This method employs constraint generation models to dynamically build multi-dimensional constraints including tone, expression style, and thematic focus to guide output. Experiments demonstrate that PG-CE significantly improves generation quality across multiple scenarios while maintaining text controllability, thematic relevance, and response practicality. The research developed a dataset containing 90,000 constraint-text pairs (with an 8:2 ratio between daily and other topics), effectively reflecting real-world application requirements.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 37 references that are in the map. First posted on arXiv 22 Sep 2025.

Builds on

35 of 37 references.

References · 35

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  4. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  5. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  6. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
  7. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,292
  8. 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,255
  9. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
  10. 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,005
  11. 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 860
  12. 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 762
23 more
  1. 2023Instruction Tuning with GPT-4cited by 686
  2. 2021DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Expertscited by 441
  3. 2020GeDi: Generative Discriminator Guided Sequence Generationcited by 378
  4. 2023What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuningcited by 364
  5. 2021Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLPcited by 337
  6. 2020AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Promptscited by 249
  7. 2020MedDialog: Two Large-scale Medical Dialogue Datasetscited by 161
  8. 2023DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Servicescited by 120
  9. 2017Deceiving Google's Perspective API Built for Detecting Toxic Commentscited by 102
  10. 2023Controlled Text Generation with Natural Language Instructionscited by 87
  11. 2022Controllable Natural Language Generation with Contrastive Prefixescited by 75
  12. 2023TrustGPT: A Benchmark for Trustworthy and Responsible Large Language Modelscited by 58
  13. 2021A Plug-and-Play Method for Controlled Text Generationcited by 56
  14. 2023Lawyer LLaMA Technical Reportcited by 54
  15. 2023Self-Detoxifying Language Models via Toxification Reversalcited by 46
  16. 2023ChatCounselor: A Large Language Models for Mental Health Supportcited by 44
  17. 2022A Distributional Lens for Multi-Aspect Controllable Text Generationcited by 33
  18. 2024FinTral: A Family of GPT-4 Level Multimodal Financial Large Language Modelscited by 32
  19. 2023Generating Summaries with Controllable Readability Levelscited by 24
  20. 2021Inference Time Style Control for Summarizationcited by 13
  21. 2024RSA-Control: A Pragmatics-Grounded Lightweight Controllable Text Generation Frameworkcited by 11
  22. 2023Toward Unified Controllable Text Generation via Regular Expression Instructioncited by 7
  23. 2024Enhancing Conditional Image Generation with Explainable Latent Space Manipulationcited by 1

Built on by

Not cited yet.