Illusory Truth or Mere Exposure? Model-Dependent Repetition Effects in LLM-Based Social Media Simulations
Not on the map. Why?
Abstract (arXiv)
Generative agent-based models (GABMs) are increasingly used to simulate social media dynamics, including misinformation spread. For such social simulations to be valid proxies of human behavior, LLM agents should replicate established human cognitive biases, among them the Illusory Truth Effect (ITE), where repeated exposure to a claim increases its perceived truth value. We investigate whether and how the ITE manifests across four LLMs (Gemma-3-4b-it, Qwen2.5-7B-Instruct, Llama-3.1-8B-Instruct, and GPT-5-nano) in a social media simulation context. We propose a two-phase within-context experimental design that embeds the repetition manipulation inside a realistic news feed interaction. Using this design, we collect 336,000 truth, importance, sentiment, and interest ratings across 100 statements, 10 feed variants, and 3 replications. The key comparison is between ratings assigned to repeated statements, seen throughout a simulation phase, and completely unseen ones, rated within the same experimental context window. We distinguish genuine ITE (truth-specific repetition boost) from mere exposure effects. We run an OLS regression followed by a Linear Mixed-Effect Model to account for differences across models and ratings. Our results reveal four qualitatively distinct patterns: Gemma-3 exhibits a genuine ITE; Qwen2.5 shows a mere exposure effect; GPT-5-nano displays no repetition effect on truth and mild skepticism toward repeated content; Llama-3.1 shows a small truth boost alongside decreases in evaluative dimensions. Crucially, temperature has no effect on these findings, and a variance decomposition highlights the high context-sensitivity of LLM rating behavior. Our findings caution against assuming uniform ITE replication across LLMs in social simulations, while suggesting that Gemma-3-4b-it may offer the most behaviorally realistic approximation for misinformation-related simulations.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 49 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
18 of 49 references.
References · 18
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2025Gemma 3 Technical Reportcited by 1,686
- 2023S3: Social-network Simulation System with Large Language Model-Empowered Agentscited by 228
- 2024OASIS: Open Agent Social Interaction Simulations with One Million Agentscited by 127
- 2023Simulating Social Media Using Large Language Models to Evaluate Alternative News Feed Algorithmscited by 64
- 2025SimBench: Benchmarking the Ability of Large Language Models to Simulate Human Behaviorscited by 48
- 2025Do Large Language Models Solve the Problems of Agent-Based Modeling? A Critical Review of Generative Social Simulationscited by 28
- 2024Agent-Based Modelling Meets Generative AI in Social Network Simulationscited by 25
- 2025Accumulating Context Changes the Beliefs of Language Modelscited by 25
- 2023Emergence of Scale-Free Networks in Social Interactions among Large Language Modelscited by 20
6 more
- 2024Understanding Knowledge Drift in LLMs through Misinformationcited by 9
- 2025Can Generative Agent-Based Modeling Replicate the Friendship Paradox in Social Media Simulations?cited by 9
- 2025Simulating Online Social Media Conversations on Controversial Topics Using AI Agents Calibrated on Real-World Datacited by 5
- 2025Computational Turing Test Reveals Systematic Differences Between Human and AI Languagecited by 5
- 2025Can We Fix Social Media? Testing Prosocial Interventions using Generative Social Simulationcited by 3
- 2025The Collective Turing Test: Large Language Models Can Generate Realistic Multi-User Discussionscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Do LLM-Driven Agents Exhibit Engagement Mechanisms? Controlled Tests of Information Load, Descriptive Norms, and Popularity Cues
- 2025Evaluating the Simulation of Human Personality-Driven Susceptibility to Misinformation with LLMs
- 2026Evaluating the Realism of LLM-powered Social Agents: A Case Study of Reactions to Spanish Online News
- 2025Simulating Misinformation Vulnerabilities With Agent Personas
- 2025Persuasion at Play: Understanding Misinformation Dynamics in Demographic-Aware Human-LLM Interactions
- 2026Stop Drawing Scientific Claims from LLM Social Simulations Without Robustness Audits
- 2026Overstating Attitudes, Ignoring Networks: LLM Biases in Simulating Misinformation Susceptibility
- 2025Don't Trust Generative Agents to Mimic Communication on Social Networks Unless You Benchmarked their Empirical Realism