Labeling Messages as AI-Generated Does Not Reduce Their Persuasive Effects
Not on the map. Why?
Abstract (arXiv)
As generative artificial intelligence (AI) enables the creation and dissemination of information at massive scale and speed, it is increasingly important to understand how people perceive AI-generated content. One prominent policy proposal requires explicitly labeling AI-generated content to increase transparency and encourage critical thinking about the information, but prior research has not yet tested the effects of such labels. To address this gap, we conducted a survey experiment (N=1601) on a diverse sample of Americans, presenting participants with an AI-generated message about several public policies (e.g., allowing colleges to pay student-athletes), randomly assigning whether participants were told the message was generated by (a) an expert AI model, (b) a human policy expert, or (c) no label. We found that messages were generally persuasive, influencing participants' views of the policies by 9.74 percentage points on average. However, while 94.6% of participants assigned to the AI and human label conditions believed the authorship labels, labels had no significant effects on participants' attitude change toward the policies, judgments of message accuracy, nor intentions to share the message with others. These patterns were robust across a variety of participant characteristics, including prior knowledge of the policy, prior experience with AI, political party, education level, or age. Taken together, these results imply that, while authorship labels would likely enhance transparency, they are unlikely to substantially affect the persuasiveness of the labeled content, highlighting the need for alternative strategies to address challenges posed by AI-generated information.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 6 of its 30 references that are in the map. First posted on arXiv 14 Apr 2025.
Builds on
6 of 30 references.
References · 6
- 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMscited by 573
- 2021All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Textcited by 287
- 2023Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigationscited by 158
- 2022Human heuristics for AI-generated language are flawedcited by 105
- 2023AI model GPT-3 (dis)informs us better than humanscited by 78
- 2020Effects of Persuasive Dialogues: Testing Bot Identities and Inquiry Strategiescited by 29
Built on by
Citing papers per year: 2025: 7; 2026: 6.
13 papers.
Sort:
By area:
- 2025ELEPHANT: Measuring and understanding social sycophancy in LLMscited by 129
- 2025AI use in American newspapers is widespread, uneven, and rarely disclosedcited by 10
- 2025A Framework to Assess the Persuasion Risks Large Language Model Chatbots Pose to Democratic Societiescited by 9
- 2025Sycophantic AI Decreases Prosocial Intentions and Promotes Dependencecited by 6
- 2026AI systems out-persuade expert humanscited by 5
- 2025Ethics and Persuasion in Reinforcement Learning from Human Feedback: A Procedural Rhetorical Approachcited by 1
- 2025EMBRACE: Shaping Inclusive Opinion Representation by Aligning Implicit Conversations with Social Normscited by 1
- 2025Designing Effective Digital Literacy Interventions for Boosting Deepfake Discernmentcited by 1
- 2026Label Over Logic? How Source Cues Bias Human Fallacy Judgments More Than LLMscited by 1
- 2026Train Yourself as an LLM: Exploring Effects of AI Literacy on Persuasion via Role-playing LLM Trainingcited by 0
- 2026Toward Meaningful Transparency for AI Chatbots: Disclosing Persuasive Intent Reduces Persuasioncited by 0
- 2026Trustworthy FinAInce: Unpacking How AI-Mediated Financial Advice is Judgedcited by 0
- 2026Annie, Are You Okay? How Style- and Context-Based Personalization Shape AI-Assisted Decision-Making21 Sep 2026
- 2026Trustworthy FinAInce: Unpacking How AI-Mediated Financial Advice is Judged17 Sep 2026
- 2026Toward Meaningful Transparency for AI Chatbots: Disclosing Persuasive Intent Reduces Persuasion12 Aug 2026
- 2026AI systems out-persuade expert humans15 Jun 2026
- 2026Label Over Logic? How Source Cues Bias Human Fallacy Judgments More Than LLMs28 May 2026
- 2026Train Yourself as an LLM: Exploring Effects of AI Literacy on Persuasion via Role-playing LLM Training3 Apr 2026
- 2025AI use in American newspapers is widespread, uneven, and rarely disclosed21 Oct 2025
- 2025Sycophantic AI Decreases Prosocial Intentions and Promotes Dependence1 Oct 2025
- 2025Designing Effective Digital Literacy Interventions for Boosting Deepfake Discernment31 Jul 2025
- 2025EMBRACE: Shaping Inclusive Opinion Representation by Aligning Implicit Conversations with Social Norms27 Jul 2025
- 2025ELEPHANT: Measuring and understanding social sycophancy in LLMs20 May 2025
- 2025Ethics and Persuasion in Reinforcement Learning from Human Feedback: A Procedural Rhetorical Approach14 May 2025
- 2025ELEPHANT: Measuring and understanding social sycophancy in LLMscited by 129
- 2025AI use in American newspapers is widespread, uneven, and rarely disclosedcited by 10
- 2025A Framework to Assess the Persuasion Risks Large Language Model Chatbots Pose to Democratic Societiescited by 9
- 2025Sycophantic AI Decreases Prosocial Intentions and Promotes Dependencecited by 6
- 2026AI systems out-persuade expert humanscited by 5
- 2025EMBRACE: Shaping Inclusive Opinion Representation by Aligning Implicit Conversations with Social Normscited by 1
- 2025Designing Effective Digital Literacy Interventions for Boosting Deepfake Discernmentcited by 1
- 2026Label Over Logic? How Source Cues Bias Human Fallacy Judgments More Than LLMscited by 1
- 2026Train Yourself as an LLM: Exploring Effects of AI Literacy on Persuasion via Role-playing LLM Trainingcited by 0
- 2026Toward Meaningful Transparency for AI Chatbots: Disclosing Persuasive Intent Reduces Persuasioncited by 0
- 2026Trustworthy FinAInce: Unpacking How AI-Mediated Financial Advice is Judgedcited by 0
- 2026Annie, Are You Okay? How Style- and Context-Based Personalization Shape AI-Assisted Decision-Makingcited by 0
- 2026Annie, Are You Okay? How Style- and Context-Based Personalization Shape AI-Assisted Decision-Making21 Sep 2026
- 2026Trustworthy FinAInce: Unpacking How AI-Mediated Financial Advice is Judged17 Sep 2026
- 2026Toward Meaningful Transparency for AI Chatbots: Disclosing Persuasive Intent Reduces Persuasion12 Aug 2026
- 2026AI systems out-persuade expert humans15 Jun 2026
- 2026Label Over Logic? How Source Cues Bias Human Fallacy Judgments More Than LLMs28 May 2026
- 2026Train Yourself as an LLM: Exploring Effects of AI Literacy on Persuasion via Role-playing LLM Training3 Apr 2026
- 2025AI use in American newspapers is widespread, uneven, and rarely disclosed21 Oct 2025
- 2025Sycophantic AI Decreases Prosocial Intentions and Promotes Dependence1 Oct 2025
- 2025Designing Effective Digital Literacy Interventions for Boosting Deepfake Discernment31 Jul 2025
- 2025EMBRACE: Shaping Inclusive Opinion Representation by Aligning Implicit Conversations with Social Norms27 Jul 2025
- 2025ELEPHANT: Measuring and understanding social sycophancy in LLMs20 May 2025
- 2025A Framework to Assess the Persuasion Risks Large Language Model Chatbots Pose to Democratic Societies29 Apr 2025