Parametric Social Identity Injection and Diversification in Public Opinion Simulation
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) have recently been adopted as synthetic agents for public opinion simulation, offering a promising alternative to costly and slow human surveys. Despite their scalability, current LLM-based simulation methods fail to capture social diversity, producing flattened inter-group differences and overly homogeneous responses across demographic groups. We identify this limitation as a Diversity Collapse phenomenon in LLM hidden representations, where distinct social identities become increasingly indistinguishable across layers. Motivated by this observation, we propose Parametric Social Identity Injection (PSII), a general framework that injects explicit, parametric representations of demographic attributes and value orientations directly into intermediate hidden states of LLMs. Unlike prompt-based persona conditioning, PSII enables fine-grained and controllable identity modulation at the representation level. Extensive experiments on the World Values Survey using multiple open-source LLMs show that PSII significantly improves distributional fidelity and diversity, reducing KL divergence to real-world survey data while enhancing overall diversity. This work provides new insights into representation-level control of LLM agents and advances scalable, diversity-aware public opinion simulation.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 26 of its 44 references that are in the map. First posted on arXiv 17 Mar 2026.
Builds on
26 of 44 references.
References · 26
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Qwen Technical Reportcited by 3,273
- 2023Whose Opinions Do Language Models Reflect?cited by 759
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
- 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 303
- 2023CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 Languagescited by 172
- 2024Large language models that replace human participants can harmfully misportray and flatten identity groupscited by 137
- 2023Increasing Diversity While Maintaining Accuracy: Text Data Generation with Large Language Models and Human Interventionscited by 121
- 2024A Note on Shumailov et al. (2024): `AI Models Collapse When Trained on Recursively Generated Data'cited by 114
- 2023Aligning Language Models to User Opinionscited by 98
- 2023Sensitivity, Performance, Robustness: Deconstructing the Effect of Sociodemographic Promptingcited by 80
- 2025Language Model Fine-Tuning on Scaled Survey Data for Predicting Distributions of Public Opinionscited by 64
14 more
- 2022Algorithmic Fairness Datasets: the Story so Farcited by 51
- 2023Improving Diversity of Demographic Representation in Large Language Models via Collective-Critiques and Self-Votingcited by 46
- 2023Diminished Diversity-of-Thought in a Standard Large Language Modelcited by 43
- 2025Parametric Retrieval Augmented Generationcited by 38
- 2025Cultivating Pluralism In Algorithmic Monoculture: The Community Alignment Datasetcited by 32
- 2023How Far Can We Extract Diverse Perspectives from Large Language Models?cited by 22
- 2025Population-Aligned Persona Generation for LLM-based Social Simulationcited by 20
- 2024Are Large Language Models (LLMs) Good Social Predictors?cited by 13
- 2022Debiased Large Language Models Still Associate Muslims with Uniquely Violent Actscited by 8
- 2025Wisdom from Diversity: Bias Mitigation Through Hybrid Human-LLM Crowdscited by 6
- 2025Investigating Prosocial Behavior Theory in LLM Agents under Policy-Induced Inequitiescited by 6
- 2025Synthesizing Public Opinions with LLMs: Role Creation, Impacts, and the Future to eDemorcacycited by 5
- 2025Distribution Shift Alignment Helps LLMs Simulate Survey Response Distributionscited by 5
- 2026HAG: Hierarchical Demographic Tree-based Agent Generation for Topic-Adaptive Simulationcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026ScioMind: Cognitively Grounded Multi-Agent Social Simulation with Anchoring-Based Belief Dynamics and Dynamic Profiles
- 2024Agentic Society: Merging skeleton from real world and texture from Large Language Model
- 2025DEBATE: A Large-Scale Benchmark for Evaluating Opinion Dynamics in Role-Playing LLM Agents
- 2026Collective Opinion Dynamics in Structured LLM Populations
- 2025Human Preferences in Large Language Model Latent Space: A Technical Analysis on the Reliability of Synthetic Data in Voting Outcome Prediction
- 2023Simulating Opinion Dynamics with Networks of LLM-based Agents
- 2026Persona-Based Simulation of Human Opinion at Population Scale
- 2025Too Open for Opinion? Embracing Open-Endedness in Large Language Models for Social Simulation