mlsanityData to 7 Oct 2026

Persuasion with Large Language Models: A Survey of Empirical Evidence, Study Methodologies, and Ethical Implications

arXiv 2411.06837 ↗First posted 11 Nov 2024cs.CLcited by 30

Not on the map. Why?

Abstract (arXiv)

The rapid rise of Large Language Models (LLMs) has created new disruptive possibilities for persuasive communication, enabling fully-automated, personalized, and interactive content generation at an unprecedented scale. In this paper, we survey the emerging field of LLM-based persuasion, reviewing empirical studies that measure the influence of LLM Systems on human attitudes and behaviors. We categorize applications across domains such as politics, marketing, public health, e-commerce, and charitable giving, finding that such systems have frequently achieved human-level or even superhuman persuasiveness. Synthesizing recent evidence, we identify key factors influencing this effectiveness, including the interaction approach, model scale and capability, prompt design, personalization, and AI source disclosure. Furthermore, we critically examine the experimental designs and success metrics used to evaluate these Systems, distinguishing between direct behavioral outcomes and proxy indicators. Our survey suggests that the current capabilities of LLM-based persuasion pose profound ethical and societal risks, including to information integrity, fairness and inclusion, privacy, and individual autonomy. These risks underscore the urgent need for ethical guidelines and updated regulatory frameworks to avoid the widespread deployment of irresponsible and harmful LLM Systems.

Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 24 of its 98 references that are in the map. First posted on arXiv 11 Nov 2024.

Builds on

24 of 98 references.

References · 24

  1. 2023An Overview of Catastrophic AI Riskscited by 214
  2. 2019Persuasion for Good: Towards a Personalized Persuasive Dialogue System for Social Goodcited by 207
  3. 2023Combating Misinformation in the Age of LLMs: Opportunities and Challengescited by 94
  4. 2023AI model GPT-3 (dis)informs us better than humanscited by 75
  5. 2024Hidden Persuaders: LLMs' Political Leaning and Their Influence on Voterscited by 71
  6. 2024Large Language Models Reflect the Ideology of their Creatorscited by 56
  7. 2023The Persuasive Power of Large Language Modelscited by 46
  8. 2023Characterizing Manipulation from AI Systemscited by 43
  9. 2024Measuring and Benchmarking Large Language Models' Capabilities to Generate Persuasive Languagecited by 31
  10. 2023Quantifying the Impact of Large Language Models on Collective Opinion Dynamicscited by 22
  11. 2023Susceptibility to Influence of Large Language Modelscited by 17
  12. 2023MindShift: Leveraging Large Language Models for Mental-States-Based Problematic Smartphone Use Interventioncited by 16
12 more
  1. 2024Objection Overruled! Lay People can Distinguish Large Language Models from Lawyers, but still Favour Advice from an LLMcited by 16
  2. 2022Artificial Intelligence for Health Message Generation: Theory, Method, and an Empirical Study Using Prompt Engineeringcited by 14
  3. 2024Zero-shot Persuasive Chatbots with LLM-Generated Strategies and Information Retrievalcited by 14
  4. 2024Evidence of a log scaling law for political persuasion with large language modelscited by 11
  5. 2024Resistance Against Manipulative AI: key factors and possible actionscited by 9
  6. 2023The effect of source disclosure on evaluation of AI-generated messages: A two-part studycited by 8
  7. 2023The Adoption and Efficacy of Large Language Models: Evidence From Consumer Complaints in the Financial Industrycited by 8
  8. 2024Persuasiveness of Generated Free-Text Rationales in Subjective Decisions: A Case Study on Pairwise Argument Rankingcited by 7
  9. 2024Beyond Persuasion: Towards Conversational Recommender System with Credible Explanationscited by 7
  10. 2024AutoPersuade: A Framework for Evaluating and Explaining Persuasive Argumentscited by 7
  11. 2024Large Language Model Agents for Improving Engagement with Behavior Change Interventions: Application to Digital Mindfulnesscited by 3
  12. 2024Persuasion Games using Large Language Modelscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 15; 2026: 14.

30 papers.

Sort:

By area:

  1. 2025LLM Can be a Dangerous Persuader: Empirical Study of Persuasion Safety in Large Language Modelscited by 21
  2. 2025The Levers of Political Persuasion with Conversational AIcited by 19
  3. 2024Lies, Damned Lies, and Distributional Language Statistics: Persuasion and Deception with Large Language Modelscited by 14
  4. 2025It's the Thought that Counts: Evaluating the Attempts of Frontier LLMs to Persuade on Harmful Topicscited by 13
  5. 2025Persuasion Dynamics in LLMs: Investigating Robustness and Adaptability in Knowledge and Safety with DuET-PDcited by 13
  6. 2025Must Read: A Comprehensive Survey of Computational Persuasioncited by 12
  7. 2025ToMAP: Training Opponent-Aware LLM Persuaders with Theory of Mindcited by 12
  8. 2025Do Large Language Models Have a Planning Theory of Mind? Evidence from MindGames: a Multi-Step Persuasion Taskcited by 9
  9. 2025Persuasion Should be Double-Blind: A Multi-Domain Dialogue Dataset With Faithfulness Based on Causal Theory of Mindcited by 8
  10. 2025Among Them: A game-based framework for assessing persuasion capabilities of LLMscited by 7
  11. 2025Can (A)I Change Your Mind?cited by 5
  12. 2025OpenReview Should be Protected and Leveraged as a Community Asset for Research in the Era of Large Language Modelscited by 5
18 more
  1. 2025Beyond One-Way Influence: Bidirectional Opinion Dynamics in Multi-Turn Human-LLM Interactionscited by 5
  2. 2026Ads in AI Chatbots? An Analysis of How Large Language Models Navigate Conflicts of Interestcited by 3
  3. 2026LLMs can persuade only psychologically susceptible humans on societal issues, via trust in AI and emotional appeals, amid logical fallaciescited by 3
  4. 2026Measuring Epistemic Resilience of LLMs Under Misleading Medical Contextcited by 3
  5. 2025PRISON: Unmasking the Criminal Potential of Large Language Modelscited by 2
  6. 2026The Bots of Persuasion: Examining How Conversational Agents' Linguistic Expressions of Personality Affect User Perceptions and Decisionscited by 2
  7. 2026Large Language Models Persuade Without Planning Theory of Mindcited by 1
  8. 2025How Persuasive Could LLMs Be? A First Study Combining Linguistic-Rhetorical Analysis and User Experimentscited by 0
  9. 2025Structuring Collective Action with LLM-Guided Evolution: From Ill-Structured Problems to Executable Heuristicscited by 0
  10. 2026Perceived Political Bias in LLMs Reduces Persuasive Abilitiescited by 0
  11. 2026Spontaneous Persuasion: An Audit of Model Persuasiveness in Everyday Conversationscited by 0
  12. 2026Assessing and Explaining the Persuadability of Large Language Models as Legal Decision Toolscited by 0
  13. 2026TourMart: A Parametric Audit Instrument for Commission Steering in LLM Travel Agentscited by 0
  14. 2026Human Decision-Making with Persuasive and Narrative LLM Explanationscited by 0
  15. 2026A Model of Multi-turn Human Persuadability Using Probabilistic Belief Tracingcited by 0
  16. 2026The Closing Window: How Governments Could Lose Their Ability to Restrain Advanced AIcited by 0
  17. 2026Position: The Alignment Community is Unintentionally Building a Censor's Toolkitcited by 0
  18. 2026LLM Persuasion Is in the Eye of the Evaluationcited by 0