Advancements in Scientific Controllable Text Generation Methods
Not on the map. Why?
Abstract (arXiv)
The previous work on controllable text generation is organized using a new schema we provide in this study. Seven components make up the schema, and each one is crucial to the creation process. To accomplish controlled generation for scientific literature, we describe the various modulation strategies utilised to modulate each of the seven components. We also offer a theoretical study and qualitative examination of these methods. This insight makes possible new architectures based on combinations of these components. Future research will compare these methods empirically to learn more about their strengths and utility.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 73 of its 98 references that are in the map. First posted on arXiv 8 Jul 2023.
Builds on
73 of 98 references.
References · 73
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2020Longformer: The Long-Document Transformercited by 3,413
38 more
- 2019The Curious Case of Neural Text Degenerationcited by 2,916
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
- 2020Learning to summarize from human feedbackcited by 2,588
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
- 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,475
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,292
- 2018Hierarchical Neural Story Generationcited by 1,193
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 828
- 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 799
- 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 762
- 2022Galactica: A Large Language Model for Sciencecited by 744
- 2019Universal Adversarial Triggers for Attacking and Analyzing NLPcited by 722
- 2021GPT Understands, Toocited by 716
- 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 688
- 2015Generating Sentences from a Continuous Spacecited by 612
- 2015Sequence Level Training with Recurrent Neural Networkscited by 576
- 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
- 2019Neural Text Generation with Unlikelihood Trainingcited by 503
- 2015Attention-Based Models for Speech Recognitioncited by 401
- 2017A Deep Reinforced Model for Abstractive Summarizationcited by 365
- 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 353
- 2016A Persona-Based Neural Conversation Modelcited by 223
- 2023Large Language Model Guided Tree-of-Thoughtcited by 221
- 2018Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfercited by 211
- 2020Extractive Summarization as Text Matchingcited by 189
- 2017Style Transfer in Text: Exploration and Evaluationcited by 146
- 2017A Knowledge-Grounded Neural Conversation Modelcited by 136
- 2015Semantically Conditioned LSTM-based Natural Language Generation for Spoken Dialogue Systemscited by 134
- 2022Internet-augmented language models through few-shot prompting for open-domain question answeringcited by 131
- 2019Structural Scaffolds for Citation Intent Classification in Scientific Publicationscited by 130
- 2019Learning to Speak and Act in a Fantasy Text Adventure Gamecited by 122
- 2018Learning to Write with Cooperative Discriminatorscited by 119
- 2023Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Datacited by 119
- 2018A Dataset for Document Grounded Conversationscited by 104
- 2023Guiding Large Language Models via Directional Stimulus Promptingcited by 95
50 most cited of 73 All 73 (JSON)
Built on by
Citing papers per year: 2024: 5; 2025: 0; 2026: 2.
7 papers.
- 2024LLMGuard: Guarding Against Unsafe LLM Behaviorcited by 13
- 2024MM-PhyRLHF: Reinforcement Learning Framework for Multimodal Physics Question-Answeringcited by 6
- 2024Enhancing LLMs for Physics Problem-Solving using Reinforcement Learning with Human-AI Feedbackcited by 6
- 2024Depression Detection and Analysis using Large Language Models on Textual and Audio-Visual Modalitiescited by 5
- 2024Su-RoBERTa: A Semi-supervised Approach to Predicting Suicide Risk through Social Media using Base Language Modelscited by 0
- 2026HORIZON: A Benchmark for In-the-wild User Behaviour Modelingcited by 0
- 2026MORPHOGEN: A Multilingual Benchmark for Evaluating Gender-Aware Morphological Generationcited by 0
- 2026MORPHOGEN: A Multilingual Benchmark for Evaluating Gender-Aware Morphological Generation20 Apr 2026
- 2026HORIZON: A Benchmark for In-the-wild User Behaviour Modeling19 Apr 2026
- 2024Enhancing LLMs for Physics Problem-Solving using Reinforcement Learning with Human-AI Feedback6 Dec 2024
- 2024Su-RoBERTa: A Semi-supervised Approach to Predicting Suicide Risk through Social Media using Base Language Models2 Dec 2024
- 2024Depression Detection and Analysis using Large Language Models on Textual and Audio-Visual Modalities8 Jul 2024
- 2024MM-PhyRLHF: Reinforcement Learning Framework for Multimodal Physics Question-Answering19 Apr 2024
- 2024LLMGuard: Guarding Against Unsafe LLM Behavior27 Feb 2024