Persona-Assigned Large Language Models Exhibit Human-Like Motivated Reasoning
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Reasoning in humans is prone to biases due to underlying motivations like identity protection, that undermine rational decision-making and judgment. This textitmotivated reasoning at a collective level can be detrimental to society when debating critical issues such as human-driven climate change or vaccine safety, and can further aggravate political polarization. Prior studies have reported that large language models (LLMs) are also susceptible to human-like cognitive biases, however, the extent to which LLMs selectively reason toward identity-congruent conclusions remains largely unexplored. Here, we investigate whether assigning 8 personas across 4 political and socio-demographic attributes induces motivated reasoning in LLMs. Testing 8 LLMs (open source and proprietary) across two reasoning tasks from human-subject studies -- veracity discernment of misinformation headlines and evaluation of numeric scientific evidence -- we find that persona-assigned LLMs have up to 9% reduced veracity discernment relative to models without personas. Political personas specifically are up to 90% more likely to correctly evaluate scientific evidence on gun control when the ground truth is congruent with their induced political identity. Prompt-based debiasing methods are largely ineffective at mitigating these effects. Taken together, our empirical findings are the first to suggest that persona-assigned LLMs exhibit human-like motivated reasoning that is hard to mitigate through conventional debiasing prompts -- raising concerns of exacerbating identity-congruent reasoning in both LLMs and humans.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 17 of its 64 references that are in the map. First posted on arXiv 24 Jun 2025.
Builds on
17 of 64 references.
Closest ancestors · 1
Same direction, newest first
Other references · 16
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
- 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,998
- 2022Language Models (Mostly) Know What They Knowcited by 1,856
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 974
- 2023Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedbackcited by 812
- 2024LLM Agents Grounded in Self-Reports Enable General-Purpose Simulation of Individualscited by 249
- 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 212
4 more
- 2023The political ideology of conversational AI: Converging evidence on ChatGPT's pro-environmental, left-libertarian orientationcited by 189
- 2023Personality Traits in Large Language Modelscited by 169
- 2024Cognitive Bias in Decision-Making with LLMscited by 106
- 2024Modeling Human Subjectivity in LLMs Using Explicit and Implicit Human Factors in Personascited by 23
Built on by
Citing papers per year: 2025: 5; 2026: 8.
13 papers.
Sort:
By area:
- 2025The Personality Illusion: Revealing Dissociation Between Self-Reports & Behavior in LLMscited by 36
- 2025A Comprehensive Survey on Trustworthiness in Reasoning with Large Language Modelscited by 25
- 2026Catching rationalization in the act: detecting motivated reasoning before and after CoT via activation probingcited by 6
- 2026Overstating Attitudes, Ignoring Networks: LLM Biases in Simulating Misinformation Susceptibilitycited by 5
- 2025The AI in the Mirror: LLM Self-Recognition in an Iterated Public Goods Gamecited by 1
- 2025Confident, Calibrated, or Complicit: Safety Alignment and Ideological Bias in LLM Hate Speech Detectioncited by 1
- 2025Who Sees the Risk? Stakeholder Conflicts and Explanatory Policies in LLM-based Risk Assessmentcited by 0
- 2026Robust Persona-Aware Toxicity Detection with Prompt Optimization and Learned Ensemblingcited by 0
- 2026Can LLMs Emulate Human Belief Dynamics?cited by 0
- 2026Modeling Complex Behaviors: Multi-Personality Composition and Dynamic Switching in Vision-Language Modelscited by 0
- 2026Defeat Devices in AI Systemscited by 0
- 2026Bayesian and Motivated Reasoning in AI Agentscited by 0
- 2026From Caricature to Collective Artifact: How Persona Construction Drives Polarization in Generative Social Simulations12 Oct 2026
- 2026Bayesian and Motivated Reasoning in AI Agents31 Jul 2026
- 2026Defeat Devices in AI Systems27 Jun 2026
- 2026Modeling Complex Behaviors: Multi-Personality Composition and Dynamic Switching in Vision-Language Models9 Jun 2026
- 2026Can LLMs Emulate Human Belief Dynamics?5 May 2026
- 2026Catching rationalization in the act: detecting motivated reasoning before and after CoT via activation probing17 Mar 2026
- 2026Overstating Attitudes, Ignoring Networks: LLM Biases in Simulating Misinformation Susceptibility4 Feb 2026
- 2026Robust Persona-Aware Toxicity Detection with Prompt Optimization and Learned Ensembling5 Jan 2026
- 2025Who Sees the Risk? Stakeholder Conflicts and Explanatory Policies in LLM-based Risk Assessment5 Nov 2025
- 2025A Comprehensive Survey on Trustworthiness in Reasoning with Large Language Models4 Sep 2025
- 2025The Personality Illusion: Revealing Dissociation Between Self-Reports & Behavior in LLMs3 Sep 2025
- 2025Confident, Calibrated, or Complicit: Safety Alignment and Ideological Bias in LLM Hate Speech Detection31 Aug 2025
1 more
- 2025The Personality Illusion: Revealing Dissociation Between Self-Reports & Behavior in LLMscited by 36
- 2026Overstating Attitudes, Ignoring Networks: LLM Biases in Simulating Misinformation Susceptibilitycited by 5
- 2025The AI in the Mirror: LLM Self-Recognition in an Iterated Public Goods Gamecited by 1
- 2025Who Sees the Risk? Stakeholder Conflicts and Explanatory Policies in LLM-based Risk Assessmentcited by 0
- 2026Robust Persona-Aware Toxicity Detection with Prompt Optimization and Learned Ensemblingcited by 0
- 2026Can LLMs Emulate Human Belief Dynamics?cited by 0
- 2026Defeat Devices in AI Systemscited by 0
- 2026Bayesian and Motivated Reasoning in AI Agentscited by 0
- 2026From Caricature to Collective Artifact: How Persona Construction Drives Polarization in Generative Social Simulationscited by 0
- 2026From Caricature to Collective Artifact: How Persona Construction Drives Polarization in Generative Social Simulations12 Oct 2026
- 2026Bayesian and Motivated Reasoning in AI Agents31 Jul 2026
- 2026Defeat Devices in AI Systems27 Jun 2026
- 2026Can LLMs Emulate Human Belief Dynamics?5 May 2026
- 2026Overstating Attitudes, Ignoring Networks: LLM Biases in Simulating Misinformation Susceptibility4 Feb 2026
- 2026Robust Persona-Aware Toxicity Detection with Prompt Optimization and Learned Ensembling5 Jan 2026
- 2025Who Sees the Risk? Stakeholder Conflicts and Explanatory Policies in LLM-based Risk Assessment5 Nov 2025
- 2025The Personality Illusion: Revealing Dissociation Between Self-Reports & Behavior in LLMs3 Sep 2025
- 2025The AI in the Mirror: LLM Self-Recognition in an Iterated Public Goods Game25 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2026Persona Prompting as a Lens on LLM Social Reasoning
- 2025Examining Alignment of Large Language Models through Representative Heuristics: The Case of Political Stereotypes
- 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMs
- 2025Ideology-Based LLMs for Content Moderation
- 2026Replicating Human Motivated Reasoning Studies with LLMs
- 2024Political Bias in LLMs: Unaligned Moral Values in Agent-centric Simulations
- 2026Multi-Persona Thinking for Bias Mitigation in Large Language Models
- 2025Exploring Persona-dependent LLM Alignment for the Moral Machine Experiment