PrimeX: A Dataset of Worldview, Opinion, and Explanation
Not on the map. Why?
Abstract (arXiv)
As the adoption of language models advances, so does the need to better represent individual users to the model. Are there aspects of an individual's belief system that a language model can utilize for improved alignment? Following prior research, we investigate this question in the domain of opinion prediction by developing PrimeX, a dataset of public opinion survey data from 858 US residents with two additional sources of belief information: written explanations from the respondents for why they hold specific opinions, and the Primal World Belief survey for assessing respondent worldview. We provide an extensive initial analysis of our data and show the value of belief explanations and worldview for personalizing language models. Our results demonstrate how the additional belief information in PrimeX can benefit both the NLP and psychological research communities, opening up avenues for further study.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 18 of its 41 references that are in the map. First posted on arXiv 30 Sep 2025.
Builds on
18 of 41 references.
References · 18
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2023Whose Opinions Do Language Models Reflect?cited by 759
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
- 2023Fine-Grained Human Feedback Gives Better Rewards for Language Model Trainingcited by 399
- 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 397
- 2022Social Simulacra: Creating Populated Prototypes for Social Computing Systemscited by 300
- 2024LLM Agents Grounded in Self-Reports Enable General-Purpose Simulation of Individualscited by 235
- 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMscited by 191
- 2023Aligning Language Models to User Opinionscited by 98
6 more
- 2023DICES Dataset: Diversity in Conversational AI Evaluation for Safetycited by 86
- 2024Roleplay-doh: Enabling Domain-Experts to Create LLM-simulated Patients via Eliciting and Adhering to Principlescited by 72
- 2024Virtual Personas for Language Models via an Anthology of Backstoriescited by 49
- 2024Persona-DB: Efficient Large Language Model Personalization for Response Prediction with Collaborative Data Refinementcited by 47
- 2023Aligning Large Language Models with Human Opinions through Persona Selection and Value--Belief--Norm Reasoningcited by 19
- 2025Improving Language Model Personas via Rationalization with Psychological Scaffoldscited by 9
Built on by
Citing papers per year: 2026: 1.
1 paper.