mlsanityData to 14 Oct 2026

Exploring the Impact of Occupational Personas on Domain-Specific QA

arXiv 2505.24448 ↗First posted 30 May 2025cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Recent studies on personas have improved the way Large Language Models (LLMs) interact with users. However, the effect of personas on domain-specific question-answering (QA) tasks remains a subject of debate. This study analyzes whether personas enhance specialized QA performance by introducing two types of persona: Profession-Based Personas (PBPs) (e.g., scientist), which directly relate to domain expertise, and Occupational Personality-Based Personas (OPBPs) (e.g., scientific person), which reflect cognitive tendencies rather than explicit expertise. Through empirical evaluations across multiple scientific domains, we demonstrate that while PBPs can slightly improve accuracy, OPBPs often degrade performance, even when semantically related to the task. Our findings suggest that persona relevance alone does not guarantee effective knowledge utilization and that they may impose cognitive constraints that hinder optimal knowledge application. Future research can explore how nuanced distinctions in persona representations guide LLMs, potentially contributing to reasoning and knowledge retrieval that more closely mirror human social conceptualization.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 23 references that are in the map. First posted on arXiv 30 May 2025.

Builds on

16 of 23 references.

References · 16

  1. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  2. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  3. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
  4. 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 449
  5. 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 360
  6. 2023Character-LLM: A Trainable Agent for Role-Playingcited by 339
  7. 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaborationcited by 251
  8. 2023PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traitscited by 234
  9. 2023Better Zero-Shot Reasoning with Role-Play Promptingcited by 223
  10. 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 208
  11. 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMscited by 199
  12. 2023InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviewscited by 179
4 more
  1. 2024How do Large Language Models Handle Multilingualism?cited by 150
  2. 2023Are Personalized Stochastic Parrots More Dangerous? Evaluating Persona Biases in Dialogue Systemscited by 37
  3. 2021Revealing Persona Biases in Dialogue Systemscited by 33
  4. 2023PK-ICR: Persona-Knowledge Interactive Context Retrieval for Grounded Dialoguecited by 6

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024PersonaGym: Evaluating Persona Agents and LLMs
  2. 2026When Can Digital Personas Reliably Approximate Human Survey Findings?
  3. 2026Persona Conditioning as an Assessor-Sensitivity Probe for LLM-Based IR Evaluation
  4. 2025PersonaBOT: Bringing Customer Personas to Life with LLMs and RAG
  5. 2025Whose Personae? Synthetic Persona Experiments in LLM Research and Pathways to Transparency
  6. 2023You Truly Understand What I Need: Intellectual and Friendly Dialogue Agents grounding Knowledge and Persona
  7. 2026When Persona Attributes Improve Population Alignment in Large Language Models
  8. 2025PersonaFeedback: A Large-scale Human-annotated Benchmark For Personalization