Persuasion with Large Language Models: A Survey of Empirical Evidence, Study Methodologies, and Ethical Implications
Not on the map. Why?
Abstract (arXiv)
The rapid rise of Large Language Models (LLMs) has created new disruptive possibilities for persuasive communication, enabling fully-automated, personalized, and interactive content generation at an unprecedented scale. In this paper, we survey the emerging field of LLM-based persuasion, reviewing empirical studies that measure the influence of LLM Systems on human attitudes and behaviors. We categorize applications across domains such as politics, marketing, public health, e-commerce, and charitable giving, finding that such systems have frequently achieved human-level or even superhuman persuasiveness. Synthesizing recent evidence, we identify key factors influencing this effectiveness, including the interaction approach, model scale and capability, prompt design, personalization, and AI source disclosure. Furthermore, we critically examine the experimental designs and success metrics used to evaluate these Systems, distinguishing between direct behavioral outcomes and proxy indicators. Our survey suggests that the current capabilities of LLM-based persuasion pose profound ethical and societal risks, including to information integrity, fairness and inclusion, privacy, and individual autonomy. These risks underscore the urgent need for ethical guidelines and updated regulatory frameworks to avoid the widespread deployment of irresponsible and harmful LLM Systems.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 24 of its 98 references that are in the map. First posted on arXiv 11 Nov 2024.
Builds on
24 of 98 references.
References · 24
- 2023An Overview of Catastrophic AI Riskscited by 214
- 2019Persuasion for Good: Towards a Personalized Persuasive Dialogue System for Social Goodcited by 207
- 2023Combating Misinformation in the Age of LLMs: Opportunities and Challengescited by 94
- 2023AI model GPT-3 (dis)informs us better than humanscited by 75
- 2024Hidden Persuaders: LLMs' Political Leaning and Their Influence on Voterscited by 71
- 2024Large Language Models Reflect the Ideology of their Creatorscited by 56
- 2023The Persuasive Power of Large Language Modelscited by 46
- 2023Characterizing Manipulation from AI Systemscited by 43
- 2024Measuring and Benchmarking Large Language Models' Capabilities to Generate Persuasive Languagecited by 31
- 2023Quantifying the Impact of Large Language Models on Collective Opinion Dynamicscited by 22
- 2023Susceptibility to Influence of Large Language Modelscited by 17
- 2023MindShift: Leveraging Large Language Models for Mental-States-Based Problematic Smartphone Use Interventioncited by 16
12 more
- 2024Objection Overruled! Lay People can Distinguish Large Language Models from Lawyers, but still Favour Advice from an LLMcited by 16
- 2022Artificial Intelligence for Health Message Generation: Theory, Method, and an Empirical Study Using Prompt Engineeringcited by 14
- 2024Zero-shot Persuasive Chatbots with LLM-Generated Strategies and Information Retrievalcited by 14
- 2024Evidence of a log scaling law for political persuasion with large language modelscited by 11
- 2024Resistance Against Manipulative AI: key factors and possible actionscited by 9
- 2023The effect of source disclosure on evaluation of AI-generated messages: A two-part studycited by 8
- 2023The Adoption and Efficacy of Large Language Models: Evidence From Consumer Complaints in the Financial Industrycited by 8
- 2024Persuasiveness of Generated Free-Text Rationales in Subjective Decisions: A Case Study on Pairwise Argument Rankingcited by 7
- 2024Beyond Persuasion: Towards Conversational Recommender System with Credible Explanationscited by 7
- 2024AutoPersuade: A Framework for Evaluating and Explaining Persuasive Argumentscited by 7
- 2024Large Language Model Agents for Improving Engagement with Behavior Change Interventions: Application to Digital Mindfulnesscited by 3
- 2024Persuasion Games using Large Language Modelscited by 3
Built on by
Citing papers per year: 2024: 1; 2025: 15; 2026: 14.
30 papers.
Sort:
By area:
- 2025LLM Can be a Dangerous Persuader: Empirical Study of Persuasion Safety in Large Language Modelscited by 21
- 2025The Levers of Political Persuasion with Conversational AIcited by 19
- 2024Lies, Damned Lies, and Distributional Language Statistics: Persuasion and Deception with Large Language Modelscited by 14
- 2025It's the Thought that Counts: Evaluating the Attempts of Frontier LLMs to Persuade on Harmful Topicscited by 13
- 2025Persuasion Dynamics in LLMs: Investigating Robustness and Adaptability in Knowledge and Safety with DuET-PDcited by 13
- 2025Must Read: A Comprehensive Survey of Computational Persuasioncited by 12
- 2025ToMAP: Training Opponent-Aware LLM Persuaders with Theory of Mindcited by 12
- 2025Do Large Language Models Have a Planning Theory of Mind? Evidence from MindGames: a Multi-Step Persuasion Taskcited by 9
- 2025Persuasion Should be Double-Blind: A Multi-Domain Dialogue Dataset With Faithfulness Based on Causal Theory of Mindcited by 8
- 2025Among Them: A game-based framework for assessing persuasion capabilities of LLMscited by 7
- 2025Can (A)I Change Your Mind?cited by 5
- 2025OpenReview Should be Protected and Leveraged as a Community Asset for Research in the Era of Large Language Modelscited by 5
18 more
- 2025Beyond One-Way Influence: Bidirectional Opinion Dynamics in Multi-Turn Human-LLM Interactionscited by 5
- 2026Ads in AI Chatbots? An Analysis of How Large Language Models Navigate Conflicts of Interestcited by 3
- 2026LLMs can persuade only psychologically susceptible humans on societal issues, via trust in AI and emotional appeals, amid logical fallaciescited by 3
- 2026Measuring Epistemic Resilience of LLMs Under Misleading Medical Contextcited by 3
- 2025PRISON: Unmasking the Criminal Potential of Large Language Modelscited by 2
- 2026The Bots of Persuasion: Examining How Conversational Agents' Linguistic Expressions of Personality Affect User Perceptions and Decisionscited by 2
- 2026Large Language Models Persuade Without Planning Theory of Mindcited by 1
- 2025How Persuasive Could LLMs Be? A First Study Combining Linguistic-Rhetorical Analysis and User Experimentscited by 0
- 2025Structuring Collective Action with LLM-Guided Evolution: From Ill-Structured Problems to Executable Heuristicscited by 0
- 2026Perceived Political Bias in LLMs Reduces Persuasive Abilitiescited by 0
- 2026Spontaneous Persuasion: An Audit of Model Persuasiveness in Everyday Conversationscited by 0
- 2026Assessing and Explaining the Persuadability of Large Language Models as Legal Decision Toolscited by 0
- 2026TourMart: A Parametric Audit Instrument for Commission Steering in LLM Travel Agentscited by 0
- 2026Human Decision-Making with Persuasive and Narrative LLM Explanationscited by 0
- 2026A Model of Multi-turn Human Persuadability Using Probabilistic Belief Tracingcited by 0
- 2026The Closing Window: How Governments Could Lose Their Ability to Restrain Advanced AIcited by 0
- 2026Position: The Alignment Community is Unintentionally Building a Censor's Toolkitcited by 0
- 2026LLM Persuasion Is in the Eye of the Evaluationcited by 0
- 2026LLM Persuasion Is in the Eye of the Evaluation7 Oct 2026
- 2026The Closing Window: How Governments Could Lose Their Ability to Restrain Advanced AI26 Jun 2026
- 2026Measuring Epistemic Resilience of LLMs Under Misleading Medical Context10 Jun 2026
- 2026Position: The Alignment Community is Unintentionally Building a Censor's Toolkit5 Jun 2026
- 2026A Model of Multi-turn Human Persuadability Using Probabilistic Belief Tracing3 Jun 2026
- 2026Human Decision-Making with Persuasive and Narrative LLM Explanations22 May 2026
- 2026TourMart: A Parametric Audit Instrument for Commission Steering in LLM Travel Agents11 May 2026
- 2026Assessing and Explaining the Persuadability of Large Language Models as Legal Decision Tools29 Apr 2026
- 2026Spontaneous Persuasion: An Audit of Model Persuasiveness in Everyday Conversations23 Apr 2026
- 2026LLMs can persuade only psychologically susceptible humans on societal issues, via trust in AI and emotional appeals, amid logical fallacies18 Apr 2026
- 2026Ads in AI Chatbots? An Analysis of How Large Language Models Navigate Conflicts of Interest9 Apr 2026
- 2026Perceived Political Bias in LLMs Reduces Persuasive Abilities20 Feb 2026
18 more
- 2026The Bots of Persuasion: Examining How Conversational Agents' Linguistic Expressions of Personality Affect User Perceptions and Decisions19 Feb 2026
- 2026Large Language Models Persuade Without Planning Theory of Mind19 Feb 2026
- 2025Beyond One-Way Influence: Bidirectional Opinion Dynamics in Multi-Turn Human-LLM Interactions22 Oct 2025
- 2025Structuring Collective Action with LLM-Guided Evolution: From Ill-Structured Problems to Executable Heuristics24 Sep 2025
- 2025Persuasion Dynamics in LLMs: Investigating Robustness and Adaptability in Knowledge and Safety with DuET-PD24 Aug 2025
- 2025How Persuasive Could LLMs Be? A First Study Combining Linguistic-Rhetorical Analysis and User Experiments13 Aug 2025
- 2025Do Large Language Models Have a Planning Theory of Mind? Evidence from MindGames: a Multi-Step Persuasion Task22 Jul 2025
- 2025The Levers of Political Persuasion with Conversational AI18 Jul 2025
- 2025PRISON: Unmasking the Criminal Potential of Large Language Models19 Jun 2025
- 2025It's the Thought that Counts: Evaluating the Attempts of Frontier LLMs to Persuade on Harmful Topics3 Jun 2025
- 2025ToMAP: Training Opponent-Aware LLM Persuaders with Theory of Mind29 May 2025
- 2025OpenReview Should be Protected and Leveraged as a Community Asset for Research in the Era of Large Language Models24 May 2025
- 2025Must Read: A Comprehensive Survey of Computational Persuasion12 May 2025
- 2025LLM Can be a Dangerous Persuader: Empirical Study of Persuasion Safety in Large Language Models14 Apr 2025
- 2025Can (A)I Change Your Mind?3 Mar 2025
- 2025Persuasion Should be Double-Blind: A Multi-Domain Dialogue Dataset With Faithfulness Based on Causal Theory of Mind28 Feb 2025
- 2025Among Them: A game-based framework for assessing persuasion capabilities of LLMs27 Feb 2025
- 2024Lies, Damned Lies, and Distributional Language Statistics: Persuasion and Deception with Large Language Models22 Dec 2024
- 2025LLM Can be a Dangerous Persuader: Empirical Study of Persuasion Safety in Large Language Modelscited by 21
- 2025The Levers of Political Persuasion with Conversational AIcited by 19
- 2024Lies, Damned Lies, and Distributional Language Statistics: Persuasion and Deception with Large Language Modelscited by 14
- 2025Persuasion Dynamics in LLMs: Investigating Robustness and Adaptability in Knowledge and Safety with DuET-PDcited by 13
- 2025Must Read: A Comprehensive Survey of Computational Persuasioncited by 12
- 2025ToMAP: Training Opponent-Aware LLM Persuaders with Theory of Mindcited by 12
- 2025Do Large Language Models Have a Planning Theory of Mind? Evidence from MindGames: a Multi-Step Persuasion Taskcited by 9
- 2025Persuasion Should be Double-Blind: A Multi-Domain Dialogue Dataset With Faithfulness Based on Causal Theory of Mindcited by 8
- 2025Among Them: A game-based framework for assessing persuasion capabilities of LLMscited by 7
- 2025Can (A)I Change Your Mind?cited by 5
- 2025OpenReview Should be Protected and Leveraged as a Community Asset for Research in the Era of Large Language Modelscited by 5
- 2025Beyond One-Way Influence: Bidirectional Opinion Dynamics in Multi-Turn Human-LLM Interactionscited by 5
12 most cited of 27 All 27 (JSON)
- 2026LLM Persuasion Is in the Eye of the Evaluation7 Oct 2026
- 2026The Closing Window: How Governments Could Lose Their Ability to Restrain Advanced AI26 Jun 2026
- 2026Measuring Epistemic Resilience of LLMs Under Misleading Medical Context10 Jun 2026
- 2026A Model of Multi-turn Human Persuadability Using Probabilistic Belief Tracing3 Jun 2026
- 2026Human Decision-Making with Persuasive and Narrative LLM Explanations22 May 2026
- 2026Assessing and Explaining the Persuadability of Large Language Models as Legal Decision Tools29 Apr 2026
- 2026Spontaneous Persuasion: An Audit of Model Persuasiveness in Everyday Conversations23 Apr 2026
- 2026LLMs can persuade only psychologically susceptible humans on societal issues, via trust in AI and emotional appeals, amid logical fallacies18 Apr 2026
- 2026Ads in AI Chatbots? An Analysis of How Large Language Models Navigate Conflicts of Interest9 Apr 2026
- 2026Perceived Political Bias in LLMs Reduces Persuasive Abilities20 Feb 2026
- 2026The Bots of Persuasion: Examining How Conversational Agents' Linguistic Expressions of Personality Affect User Perceptions and Decisions19 Feb 2026
- 2026Large Language Models Persuade Without Planning Theory of Mind19 Feb 2026
12 newest of 27 All 27 (JSON)