Synthetically generated text for supervised text analysis
Not on the map. Why?
Abstract (arXiv)
Supervised text models are a valuable tool for political scientists but present several obstacles to their use, including the expense of hand-labeling documents, the difficulty of retrieving rare relevant documents for annotation, and copyright and privacy concerns involved in sharing annotated documents. This article proposes a partial solution to these three issues, in the form of controlled generation of synthetic text with large language models. I provide a conceptual overview of text generation, guidance on when researchers should prefer different techniques for generating synthetic text, a discussion of ethics, and a simple technique for improving the quality of synthetic text. I demonstrate the usefulness of synthetic text with three applications: generating synthetic tweets describing the fighting in Ukraine, synthetic news articles describing specified political events for training an event detection system, and a multilingual corpus of populist manifesto statements for training a sentence-level populism classifier.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 25 of its 80 references that are in the map. First posted on arXiv 28 Mar 2023.
Builds on
25 of 80 references.
References · 25
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,371
- 2016Semantics derived automatically from language corpora contain human-like biasescited by 894
- 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 849
- 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 800
- 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 793
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
13 more
- 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 591
- 2019Defending Against Neural Fake Newscited by 553
- 2020Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stoppingcited by 377
- 2019Automatic Detection of Generated Text is Easiest when Humans are Fooledcited by 260
- 2021Generating Datasets with Pretrained Language Modelscited by 192
- 2022Efficient Few-Shot Learning Without Promptscited by 135
- 2018Interactive Supercomputing on 40,000 Cores for Machine Learning and Data Analysiscited by 110
- 2018Tensor2Tensor for Neural Machine Translationcited by 85
- 2020A Theoretical Analysis of the Repetition Problem in Text Generationcited by 83
- 2021Adaptive Semiparametric Language Modelscited by 83
- 2020Exploring Controllable Text Generation Techniquescited by 55
- 2021Generate, Annotate, and Learn: NLP with Synthetic Textcited by 42
- 2021Corpus-Level Evaluation for Event QA: The IndiaPoliceEvents Corpus Covering the 2002 Gujarat Violencecited by 19
Built on by
Citing papers per year: 2023: 4; 2024: 1; 2025: 3; 2026: 2.
10 papers.
- 2024Codebook LLMs: Evaluating LLMs as Measurement Tools for Political Science Conceptscited by 28
- 2023Towards Coding Social Science Datasets with Language Modelscited by 10
- 2023A Multi-solution Study on GDPR AI-enabled Completeness Checking of DPAscited by 3
- 2023Creating Custom Event Data Without Dictionaries: A Bag-of-Trickscited by 2
- 2023Steering Language Generation: Harnessing Contrastive Expert Guidance and Negative Prompting for Coherent and Diverse Synthetic Data Generationcited by 2
- 2025What is a protest anyway? Codebook conceptualization is still a first-order concern in LLM-era classificationcited by 2
- 2025Political Leaning and Politicalness Classification of Textscited by 0
- 2025Identifying Fine-grained Forms of Populism in Political Discourse: A Case Study on Donald Trump's Presidential Campaignscited by 0
- 2026PrivMedChat: End-to-End Differentially Private RLHF for Medical Dialogue Systemscited by 0
- 2026Validating LLMs in social science: Epistemic threats and emerging normscited by 0
- 2026Validating LLMs in social science: Epistemic threats and emerging norms8 Jul 2026
- 2026PrivMedChat: End-to-End Differentially Private RLHF for Medical Dialogue Systems3 Mar 2026
- 2025What is a protest anyway? Codebook conceptualization is still a first-order concern in LLM-era classification3 Oct 2025
- 2025Identifying Fine-grained Forms of Populism in Political Discourse: A Case Study on Donald Trump's Presidential Campaigns25 Jul 2025
- 2025Political Leaning and Politicalness Classification of Texts18 Jul 2025
- 2024Codebook LLMs: Evaluating LLMs as Measurement Tools for Political Science Concepts15 Jul 2024
- 2023A Multi-solution Study on GDPR AI-enabled Completeness Checking of DPAs23 Nov 2023
- 2023Steering Language Generation: Harnessing Contrastive Expert Guidance and Negative Prompting for Coherent and Diverse Synthetic Data Generation15 Aug 2023
- 2023Towards Coding Social Science Datasets with Language Models3 Jun 2023
- 2023Creating Custom Event Data Without Dictionaries: A Bag-of-Tricks3 Apr 2023