mlsanityData to 14 Oct 2026

Misalignment of LLM-Generated Personas with Human Perceptions in Low-Resource Settings

arXiv 2512.02058 ↗First posted 28 Nov 2025cs.CY cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances enable Large Language Models (LLMs) to generate AI personas, yet their lack of deep contextual, cultural, and emotional understanding poses a significant limitation. This study quantitatively compared human responses with those of eight LLM-generated social personas (e.g., Male, Female, Muslim, Political Supporter) within a low-resource environment like Bangladesh, using culturally specific questions. Results show human responses significantly outperform all LLMs in answering questions, and across all matrices of persona perception, with particularly large gaps in empathy and credibility. Furthermore, LLM-generated content exhibited a systematic bias along the lines of the ``Pollyanna Principle'', scoring measurably higher in positive sentiment (Phiavg = 5.99 for LLMs vs. 5.60 for Humans). These findings suggest that LLM personas do not accurately reflect the authentic experience of real people in resource-scarce environments. It is essential to validate LLM personas against real-world human data to ensure their alignment and reliability before deploying them in social science research.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 32 references that are in the map. First posted on arXiv 28 Nov 2025.

Builds on

16 of 32 references.

References · 16

  1. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 752
  2. 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 417
  3. 2023Character-LLM: A Trainable Agent for Role-Playingcited by 339
  4. 2024LLM Agents Grounded in Self-Reports Enable General-Purpose Simulation of Individualscited by 249
  5. 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 208
  6. 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMscited by 199
  7. 2024Quantifying the Persona Effect in LLM Simulationscited by 169
  8. 2025LLM Generated Persona is a Promise with a Catchcited by 81
  9. 2025Multilingual != Multicultural: Evaluating Gaps Between Multilingual Capabilities and Cultural Alignment in LLMscited by 39
  10. 2014Human language reveals a universal positivity biascited by 23
  11. 2020Generalized Word Shift Graphs: A Method for Visualizing and Explaining Pairwise Comparisons Between Textscited by 21
  12. 2024Personas with Attitudes: Controlling LLMs for Diverse Data Annotationcited by 21
4 more
  1. 2025Quantifying Language Disparities in Multilingual Large Language Modelscited by 7
  2. 2025Through the Prism of Culture: Evaluating LLMs' Understanding of Indian Subcultures and Traditionscited by 4
  3. 2025BanglaMATH : A Bangla benchmark dataset for testing LLM mathematical reasoning at grades 6, 7, and 8cited by 3
  4. 2025Story and essential meaning dynamics in Bangladesh's July 2024 Student-People's Uprisingcited by 1

Built on by

Not cited yet.