mlsanityData to 14 Oct 2026

Persona-Assigned Large Language Models Exhibit Human-Like Motivated Reasoning

arXiv 2506.20020 ↗First posted 24 Jun 2025cs.AI cs.CLcited by 13

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Reasoning in humans is prone to biases due to underlying motivations like identity protection, that undermine rational decision-making and judgment. This textitmotivated reasoning at a collective level can be detrimental to society when debating critical issues such as human-driven climate change or vaccine safety, and can further aggravate political polarization. Prior studies have reported that large language models (LLMs) are also susceptible to human-like cognitive biases, however, the extent to which LLMs selectively reason toward identity-congruent conclusions remains largely unexplored. Here, we investigate whether assigning 8 personas across 4 political and socio-demographic attributes induces motivated reasoning in LLMs. Testing 8 LLMs (open source and proprietary) across two reasoning tasks from human-subject studies -- veracity discernment of misinformation headlines and evaluation of numeric scientific evidence -- we find that persona-assigned LLMs have up to 9% reduced veracity discernment relative to models without personas. Political personas specifically are up to 90% more likely to correctly evaluate scientific evidence on gun control when the ground truth is congruent with their induced political identity. Prompt-based debiasing methods are largely ineffective at mitigating these effects. Taken together, our empirical findings are the first to suggest that persona-assigned LLMs exhibit human-like motivated reasoning that is hard to mitigate through conventional debiasing prompts -- raising concerns of exacerbating identity-congruent reasoning in both LLMs and humans.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 17 of its 64 references that are in the map. First posted on arXiv 24 Jun 2025.

Builds on

17 of 64 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Better Zero-Shot Reasoning with Role-Play Prompting15 Aug

Other references · 16

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  3. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  4. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  5. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  6. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,998
  7. 2022Language Models (Mostly) Know What They Knowcited by 1,856
  8. 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
  9. 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 974
  10. 2023Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedbackcited by 812
  11. 2024LLM Agents Grounded in Self-Reports Enable General-Purpose Simulation of Individualscited by 249
  12. 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 212
4 more
  1. 2023The political ideology of conversational AI: Converging evidence on ChatGPT's pro-environmental, left-libertarian orientationcited by 189
  2. 2023Personality Traits in Large Language Modelscited by 169
  3. 2024Cognitive Bias in Decision-Making with LLMscited by 106
  4. 2024Modeling Human Subjectivity in LLMs Using Explicit and Implicit Human Factors in Personascited by 23

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 8.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026Persona Prompting as a Lens on LLM Social Reasoning
  2. 2025Examining Alignment of Large Language Models through Representative Heuristics: The Case of Political Stereotypes
  3. 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMs
  4. 2025Ideology-Based LLMs for Content Moderation
  5. 2026Replicating Human Motivated Reasoning Studies with LLMs
  6. 2024Political Bias in LLMs: Unaligned Moral Values in Agent-centric Simulations
  7. 2026Multi-Persona Thinking for Bias Mitigation in Large Language Models
  8. 2025Exploring Persona-dependent LLM Alignment for the Moral Machine Experiment