mlsanityData to 14 Oct 2026

Labeling Messages as AI-Generated Does Not Reduce Their Persuasive Effects

arXiv 2504.09865 ↗First posted 14 Apr 2025cs.CY cs.AI cs.HCcited by 13

Not on the map. Why?

Abstract (arXiv)

As generative artificial intelligence (AI) enables the creation and dissemination of information at massive scale and speed, it is increasingly important to understand how people perceive AI-generated content. One prominent policy proposal requires explicitly labeling AI-generated content to increase transparency and encourage critical thinking about the information, but prior research has not yet tested the effects of such labels. To address this gap, we conducted a survey experiment (N=1601) on a diverse sample of Americans, presenting participants with an AI-generated message about several public policies (e.g., allowing colleges to pay student-athletes), randomly assigning whether participants were told the message was generated by (a) an expert AI model, (b) a human policy expert, or (c) no label. We found that messages were generally persuasive, influencing participants' views of the policies by 9.74 percentage points on average. However, while 94.6% of participants assigned to the AI and human label conditions believed the authorship labels, labels had no significant effects on participants' attitude change toward the policies, judgments of message accuracy, nor intentions to share the message with others. These patterns were robust across a variety of participant characteristics, including prior knowledge of the policy, prior experience with AI, political party, education level, or age. Taken together, these results imply that, while authorship labels would likely enhance transparency, they are unlikely to substantially affect the persuasiveness of the labeled content, highlighting the need for alternative strategies to address challenges posed by AI-generated information.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 6 of its 30 references that are in the map. First posted on arXiv 14 Apr 2025.

Builds on

6 of 30 references.

References · 6

  1. 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMscited by 573
  2. 2021All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Textcited by 287
  3. 2023Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigationscited by 158
  4. 2022Human heuristics for AI-generated language are flawedcited by 105
  5. 2023AI model GPT-3 (dis)informs us better than humanscited by 78
  6. 2020Effects of Persuasive Dialogues: Testing Bot Identities and Inquiry Strategiescited by 29

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 7; 2026: 6.

13 papers.

Sort:

By area: