mlsanityData to 7 Oct 2026

Stable Behavior, Limited Variation: Persona Validity in LLM Agents for Urban Sentiment Perception

arXiv 2604.28048 ↗First posted 30 Apr 2026cs.CL cs.SIcited by 2

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

Large Language Models (LLMs) are increasingly used as proxies for human perception in urban analysis, yet it remains unclear whether persona prompting produces meaningful and reproducible behavioral diversity. We investigate whether distinct personas influence urban sentiment judgments generated by multimodal LLMs. Using a factorial set of personas spanning gender, economic status, political orientation, and personality, we instantiate multiple agents per persona to evaluate urban scene images from the PerceptSent dataset and assess both within-persona consistency and cross-persona variation. Results show strong convergence among agents sharing a persona, indicating stable and reproducible behavior. However, cross-persona differentiation is limited: economic status and personality induce statistically detectable but practically modest variation, while gender shows no measurable effect and political orientation only negligible impact. Agents also exhibit an extremity bias, collapsing intermediate sentiment categories common in human annotations. As a result, performance remains strong on coarse-grained polarity tasks but degrades as sentiment resolution increases, suggesting that simple label-based persona prompting does not capture fine-grained perceptual judgments. To isolate the contribution of persona conditioning, we additionally evaluate the same model without personas. Surprisingly, the no-persona model sometimes matches or exceeds persona-conditioned agreement with human labels across all task variants, suggesting that simple label-based persona prompting may add limited annotation value in this setting.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 9 of its 19 references that are in the map. First posted on arXiv 30 Apr 2026.

Builds on

9 of 19 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Simulating Society Requires Simulating Thought8 Jun

Other references · 8

  1. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
  2. 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 506
  3. 2024Quantifying the Persona Effect in LLM Simulationscited by 164
  4. 2023Sensitivity, Performance, Robustness: Deconstructing the Effect of Sociodemographic Promptingcited by 80
  5. 2025The Prompt Makes the Person(a): A Systematic Evaluation of Sociodemographic Persona Prompting for Large Language Modelscited by 40
  6. 2025Are LLMs Empathetic to All? Investigating the Influence of Multi-Demographic Personas on a Model's Empathycited by 9
  7. 2019OutdoorSent: Sentiment Analysis of Urban Outdoor Images by Using Semantic and Deep Featurescited by 2
  8. 2025Multimodal LLMs See Sentimentcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Persona Prompting as a Lens on LLM Social Reasoning
  2. 2025A Thousand Words or An Image: Studying the Influence of Persona Modality in Multimodal LLMs
  3. 2024Evaluating Large Language Model Biases in Persona-Steered Generation
  4. 2025Us-vs-Them bias in Large Language Models ↗
  5. 2026Invisible Influences: Investigating Implicit Intersectional Biases through Persona Engineering in Large Language Models
  6. 2025German General Social Survey Personas: A Survey-Derived Persona Prompt Collection for Population-Aligned LLM Studies
  7. 2025From Single to Societal: Analyzing Persona-Induced Bias in Multi-Agent Interactions
  8. 2025Measuring Lexical Diversity of Synthetic Data Generated through Fine-Grained Persona Prompting