Polypersona: Persona-Grounded LLM for Synthetic Survey Responses
Not on the map. Why?
Abstract (arXiv)
This paper introduces PolyPersona, a generative framework for synthesizing persona-conditioned survey responses across multiple domains. The framework instruction-tunes compact chat models using parameter-efficient LoRA adapters with 4-bit quantization under a resource-adaptive training setup. A dialogue-based data pipeline explicitly preserves persona cues, ensuring consistent behavioral alignment across generated responses. Using this pipeline, we construct a dataset of 3,568 synthetic survey responses spanning ten domains and 433 distinct personas, enabling controlled instruction tuning and systematic multi-domain evaluation. We evaluate the generated responses using a multi-metric evaluation suite that combines standard text generation metrics, including BLEU, ROUGE, and BERTScore, with survey-specific metrics designed to assess structural coherence, stylistic consistency, and sentiment alignment.Experimental results show that compact models such as TinyLlama 1.1B and Phi-2 achieve performance comparable to larger 7B to 8B baselines, with a highest BLEU score of 0.090 and ROUGE-1 of 0.429. These findings demonstrate that persona-conditioned fine-tuning enables small language models to generate reliable and coherent synthetic survey data. The proposed framework provides an efficient and reproducible approach for survey data generation, supporting scalable evaluation while facilitating bias analysis through transparent and open protocols.
Key facts. Cited by 3 papers in the map (data through 13 Oct 2026). Builds on 17 of its 56 references that are in the map. First posted on arXiv 16 Dec 2025.
Builds on
17 of 56 references.
References · 17
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,231
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,979
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,480
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,388
- 2023Mistral 7Bcited by 3,123
- 2024Qwen2 Technical Reportcited by 2,102
- 2023A Survey on Evaluation of Large Language Modelscited by 1,236
- 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,071
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 824
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 747
- 2024On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Surveycited by 242
- 2023Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitationscited by 98
5 more
- 2023Exploiting Asymmetry for Synthetic Training Data Generation: SynthIE and the Case of Information Extractioncited by 89
- 2023Faithful Persona-based Conversational Dataset Generation with Large Language Modelscited by 47
- 2024DataDreamer: A Tool for Synthetic Data Generation and Reproducible LLM Workflowscited by 43
- 2024Generative AI for Synthetic Data Generation: Methods, Challenges and the Futurecited by 32
- 2025Learning from Convenience Samples: A Case Study on Fine-Tuning LLMs for Survey Non-response in the German Longitudinal Election Studycited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Diagnosing Korean-Language LLM Political Bias via Census-Grounded Agent Simulationcited by 0
- 2026Distributional Validity of a Korean Synthetic Persona Panel: Evidence From the Korea Media Panel Surveycited by 0
- 2026Cultural Divergence Preservation: Diagnosing Flattening and Caricature in LLM-Simulated Survey Populationscited by 0
- 2026Cultural Divergence Preservation: Diagnosing Flattening and Caricature in LLM-Simulated Survey Populations24 Sep 2026
- 2026Distributional Validity of a Korean Synthetic Persona Panel: Evidence From the Korea Media Panel Survey23 Jul 2026
- 2026Diagnosing Korean-Language LLM Political Bias via Census-Grounded Agent Simulation18 May 2026
Similar, not cited
Close in wording, no citation either way
- 2024PERSONA: A Reproducible Testbed for Pluralistic Alignment
- 2026When Can Digital Personas Reliably Approximate Human Survey Findings?
- 2025German General Social Survey Personas: A Survey-Derived Persona Prompt Collection for Population-Aligned LLM Studies
- 2026When Persona Attributes Improve Population Alignment in Large Language Models
- 2025Measuring Lexical Diversity of Synthetic Data Generated through Fine-Grained Persona Prompting
- 2025DeepPersona: A Generative Engine for Scaling Deep Synthetic Personas
- 2025Post Persona Alignment for Multi-Session Dialogue Generation
- 2024Evaluating Large Language Model Biases in Persona-Steered Generation