mlsanityData to 14 Oct 2026

Sentiment Simulation using Generative AI Agents

arXiv 2505.22125 ↗First posted 28 May 2025cs.MA cs.AI cs.CYcited by 1

Not on the map. Why?

Abstract (arXiv)

Traditional sentiment analysis relies on surface-level linguistic patterns and retrospective data, limiting its ability to capture the psychological and contextual drivers of human sentiment. These limitations constrain its effectiveness in applications that require predictive insight, such as policy testing, narrative framing, and behavioral forecasting. We present a robust framework for sentiment simulation using generative AI agents embedded with psychologically rich profiles. Agents are instantiated from a nationally representative survey of 2,485 Filipino respondents, combining sociodemographic information with validated constructs of personality traits, values, beliefs, and socio-political attitudes. The framework includes three stages: (1) agent embodiment via categorical or contextualized encodings, (2) exposure to real-world political and economic scenarios, and (3) generation of sentiment ratings accompanied by explanatory rationales. Using Quadratic Weighted Accuracy (QWA), we evaluated alignment between agent-generated and human responses. Contextualized encoding achieved 92% alignment in replicating original survey responses. In sentiment simulation tasks, agents reached 81%--86% accuracy against ground truth sentiment, with contextualized profile encodings significantly outperforming categorical (p < 0.0001, Cohen's d = 0.70). Simulation results remained consistent across repeated trials (+/-0.2--0.5% SD) and resilient to variation in scenario framing (p = 0.9676, Cohen's d = 0.02). Our findings establish a scalable framework for sentiment modeling through psychographically grounded AI agents. This work signals a paradigm shift in sentiment analysis from retrospective classification to prospective and dynamic simulation grounded in psychology of sentiment formation.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 11 of its 57 references that are in the map. First posted on arXiv 28 May 2025.

Builds on

11 of 57 references.

References · 11

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  3. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
  4. 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 515
  5. 2024LLM Agents Grounded in Self-Reports Enable General-Purpose Simulation of Individualscited by 249
  6. 2023User Behavior Simulation with Large Language Model based Agentscited by 140
  7. 2024LLM-Mirror: A Generated-Persona Approach for Survey Pre-Testingcited by 7
  8. 2020A systematic literature review on machine learning applications for consumer sentiment analysis using online reviewscited by 5
  9. 2024Using Large Language Models to Create AI Personas for Replication, Generalization and Prediction of Media Effects: An Empirical Test of 133 Published Experimental Research Findingscited by 4
  10. 2015Reflections on Sentiment/Opinion Analysiscited by 3
  11. 2021Identifying Biased Users in Online Social Networks to Enhance the Accuracy of Sentiment Analysis: A User Behavior-Based Approachcited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.