AI model GPT-3 (dis)informs us better than humans
Not on the map. Why?
Abstract (arXiv)
Artificial intelligence is changing the way we create and evaluate information, and this is happening during an infodemic, which has been having dramatic effects on global health. In this paper we evaluate whether recruited individuals can distinguish disinformation from accurate information, structured in the form of tweets, and determine whether a tweet is organic or synthetic, i.e., whether it has been written by a Twitter user or by the AI model GPT-3. Our results show that GPT-3 is a double-edge sword, which, in comparison with humans, can produce accurate information that is easier to understand, but can also produce more compelling disinformation. We also show that humans cannot distinguish tweets generated by GPT-3 from tweets written by human users. Starting from our results, we reflect on the dangers of AI for disinformation, and on how we can improve information campaigns to benefit global health.
Key facts. Cited by 78 papers in the map (data through 14 Oct 2026). Builds on 4 of its 40 references that are in the map. First posted on arXiv 23 Jan 2023.
Builds on
4 of 40 references.
References · 4
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2021All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Textcited by 287
- 2021Detecting Hate Speech with GPT-3cited by 56
- 2021Tortured phrases: A dubious writing style emerging in science. Evidence of critical issues affecting established journalscited by 17
Built on by
Citing papers per year: 2023: 19; 2024: 24; 2025: 16; 2026: 19.
78 papers.
Sort:
By area:
- 2024Knowledge Conflicts for LLMs: A Surveycited by 283
- 2023Can LLM-Generated Misinformation Be Detected?cited by 177
- 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 163
- 2023Generative AIcited by 120
- 2023The Earth is Flat because...: Investigating LLMs' Belief towards Misinformation via Persuasive Conversationcited by 109
- 2023Language Model Behavior: A Comprehensive Surveycited by 92
- 2023Use of LLMs for Illicit Purposes: Threats, Prevention Measures, and Vulnerabilitiescited by 82
- 2025Large language models for automated scholarly paper review: A surveycited by 61
- 2024Large Language Model Safety: A Holistic Surveycited by 59
- 2023Generative Pre-trained Transformer: A Comprehensive Review on Enabling Technologies, Potential Applications, Emerging Challenges, and Future Directionscited by 55
- 2024Autonomous LLM-driven research from data to human-verifiable research paperscited by 53
- 2023Fighting Fire with Fire: The Dual Role of LLMs in Crafting and Detecting Elusive Disinformationcited by 51
38 more
- 2024AI-Driven Review Systems: Evaluating LLMs in Scalable and Bias-Aware Academic Reviewscited by 44
- 2023Disinformation Detection: An Evolving Challenge in the Age of LLMscited by 41
- 2023Neural Retrievers are Biased Towards LLM-Generated Contentcited by 38
- 2023Anatomy of an AI-powered malicious social botnetcited by 36
- 2024Persuasion with Large Language Models: A Survey of Empirical Evidence, Study Methodologies, and Ethical Implicationscited by 32
- 2023Overview of AuTexTification at IberLEF 2023: Detection and Attribution of Machine-Generated Text in Multiple Domainscited by 31
- 2024Scaling Trends for Data Poisoning in LLMscited by 30
- 2023Exploiting Novel GPT-4 APIscited by 28
- 2023Disentangling Perceptions of Offensiveness: Cultural and Moral Correlatescited by 26
- 2024Detecting AI-Generated Text: Factors Influencing Detectability with Current Methodscited by 23
- 2023Fact-checking information from large language models can decrease headline discernmentcited by 22
- 2024A Survey of AI-generated Text Forensic Systems: Detection, Attribution, and Characterizationcited by 19
- 2025LLM-Generated Fake News Induces Truth Decay in News Ecosystem: A Case Study on Neural News Recommendationcited by 19
- 2024When LLMs Play the Telephone Game: Cultural Attractors as Conceptual Tools to Evaluate LLMs in Multi-turn Settingscited by 17
- 2024Lies, Damned Lies, and Distributional Language Statistics: Persuasion and Deception with Large Language Modelscited by 15
- 2023Adapting Fake News Detection to the Era of Large Language Modelscited by 14
- 2024Large language models can consistently generate high-quality content for election disinformation operationscited by 14
- 2023Invisible Relevance Bias: Text-Image Retrieval Models Prefer AI-Generated Imagescited by 13
- 2025Labeling Messages as AI-Generated Does Not Reduce Their Persuasive Effectscited by 13
- 2024Fakes of Varying Shades: How Warning Affects Human Perception and Engagement Regarding LLM Hallucinationscited by 12
- 2024MetaSumPerceiver: Multimodal Multi-Document Evidence Summarization for Fact-Checkingcited by 10
- 2024Fake Artificial Intelligence Generated Contents (FAIGC): A Survey of Theories, Detection Methods, and Opportunitiescited by 8
- 2025GenAI Content Detection Task 3: Cross-Domain Machine-Generated Text Detection Challengecited by 7
- 2023In Generative AI we Trust: Can Chatbots Effectively Verify Political Information?cited by 6
- 2025Concept-Level Explainability for Auditing & Steering LLM Responsescited by 6
- 2025Linguistic and Embedding-Based Profiling of Texts generated by Humans and Large Language Modelscited by 6
- 2026JailNewsBench: Multi-Lingual and Regional Benchmark for Fake News Generation under Jailbreak Attackscited by 6
- 2024I Am Not Them: Fluid Identities and Persistent Out-group Bias in Large Language Modelscited by 5
- 2024Catching Chameleons: Detecting Evolving Disinformation Generated using Large Language Modelscited by 5
- 2024How will advanced AI systems impact democracy?cited by 5
- 2025Echoes of Power: Investigating Geopolitical Bias in US and China Large Language Modelscited by 5
- 2025Sword and Shield: Uses and Strategies of LLMs in Navigating Disinformationcited by 4
- 2024Lying Blindly: Bypassing ChatGPT's Safeguards to Generate Hard-to-Detect Disinformation Claimscited by 3
- 2025Increasing happiness through conversations with artificial intelligencecited by 2
- 2025PRISON: Unmasking the Criminal Potential of Large Language Modelscited by 2
- 2025Tailored untruths: How personalisation challenges LLM safeguardscited by 2
- 2026An Experimental Comparison of the Most Popular Approaches to Fake News Detectioncited by 2
- 2026AI advice suppresses people's willingness to say "I don't know", even when the advice is wrong and accuracy is incentivizedcited by 2
50 most cited of 78 All 78 (JSON)
- 2026Stance Drift: How AI-mediated Communication Distorts Our Message3 Oct 2026
- 2026VEX-Bench: Benchmarking Verification Complexity of LLM-Generated Misinformation28 Sep 2026
- 2026CrisisFake: Benchmark Validity of AI-Generated Text Detection for Disaster Social Sensing21 Sep 2026
- 2026Auditing Cross-Lingual Fairness in Language Model Watermarking20 Aug 2026
- 2026Falsehood and Impossibility Are Different Directions in an AI's Representation of Language13 Aug 2026
- 2026AI advice suppresses people's willingness to say "I don't know", even when the advice is wrong and accuracy is incentivized15 Jul 2026
- 2026Beyond AI-Generated Labels: Watermarking, Co-Creation, and Conflation of AI-Generation with Disinformation13 Jul 2026
- 2026Rethinking AI-Generated Text Detection: A Strong Baseline and the Distribution-Shift Problem That Remains4 Jul 2026
- 2026How Far Did They Go? The Persuasive Tactics of Covert LLM Agents in a Discontinued Field Experiment3 Jun 2026
- 2026DataShield: Safety-degrading Data Filtering for LLM Benign Instruction Fine-Tuning29 May 2026
- 2026Label Over Logic? How Source Cues Bias Human Fallacy Judgments More Than LLMs28 May 2026
- 2026From AI-Generated Content to Agentic Action: Security and Safety Threats in Generative AI15 May 2026
38 more
- 2026ALSO: Adversarial Online Strategy Optimization for Social Agents15 May 2026
- 2026The Algorithmic Caricature: Auditing LLM-Generated Political Discourse Across Crisis Events12 May 2026
- 2026Headlines You Won't Forget: Can Pronoun Insertion Increase Memorability?21 Apr 2026
- 2026Interpretable Stylistic Variation in Human and LLM Writing Across Genres, Models, and Decoding Strategies15 Apr 2026
- 2026An Experimental Comparison of the Most Popular Approaches to Fake News Detection26 Mar 2026
- 2026JailNewsBench: Multi-Lingual and Regional Benchmark for Fake News Generation under Jailbreak Attacks1 Mar 2026
- 2026Beyond Content: Behavioral Policies Reveal Actors in Information Operations2 Feb 2026
- 2025Tailored untruths: How personalisation challenges LLM safeguards14 Oct 2025
- 2025ChatGPT-generated texts show authorship traits that identify them as non-human22 Aug 2025
- 2025Designing Effective Digital Literacy Interventions for Boosting Deepfake Discernment31 Jul 2025
- 2025Linguistic and Embedding-Based Profiling of Texts generated by Humans and Large Language Models18 Jul 2025
- 2025PRISON: Unmasking the Criminal Potential of Large Language Models19 Jun 2025
- 2025Sword and Shield: Uses and Strategies of LLMs in Navigating Disinformation8 Jun 2025
- 2025Risks of AI-driven product development and strategies for their mitigation28 May 2025
- 2025Domain Gating Ensemble Networks for AI-Generated Text Detection20 May 2025
- 2025Images Amplify Misinformation Sharing in Vision-Language Models19 May 2025
- 2025Concept-Level Explainability for Auditing & Steering LLM Responses12 May 2025
- 2025LLM-Generated Fake News Induces Truth Decay in News Ecosystem: A Case Study on Neural News Recommendation28 Apr 2025
- 2025Labeling Messages as AI-Generated Does Not Reduce Their Persuasive Effects14 Apr 2025
- 2025Increasing happiness through conversations with artificial intelligence2 Apr 2025
- 2025Echoes of Power: Investigating Geopolitical Bias in US and China Large Language Models20 Mar 2025
- 2025Large language models for automated scholarly paper review: A survey17 Jan 2025
- 2025GenAI Content Detection Task 3: Cross-Domain Machine-Generated Text Detection Challenge15 Jan 2025
- 2024Large Language Model Safety: A Holistic Survey23 Dec 2024
- 2024Lies, Damned Lies, and Distributional Language Statistics: Persuasion and Deception with Large Language Models22 Dec 2024
- 2024Evaluating the Performance of Large Language Models in Scientific Claim Detection and Classification21 Dec 2024
- 2024Persuasion with Large Language Models: A Survey of Empirical Evidence, Study Methodologies, and Ethical Implications11 Nov 2024
- 2024Using GPT Models for Qualitative and Quantitative News Analytics in the 2024 US Presidental Election Process21 Oct 2024
- 2024How will advanced AI systems impact democracy?27 Aug 2024
- 2024AI-Driven Review Systems: Evaluating LLMs in Scalable and Bias-Aware Academic Reviews19 Aug 2024
- 2024Large language models can consistently generate high-quality content for election disinformation operations13 Aug 2024
- 2024Scaling Trends for Data Poisoning in LLMs6 Aug 2024
- 2024MetaSumPerceiver: Multimodal Multi-Document Evidence Summarization for Fact-Checking18 Jul 2024
- 2024When LLMs Play the Telephone Game: Cultural Attractors as Conceptual Tools to Evaluate LLMs in Multi-turn Settings5 Jul 2024
- 2024Catching Chameleons: Detecting Evolving Disinformation Generated using Large Language Models26 Jun 2024
- 2024Investigating the Influence of Prompt-Specific Shortcuts in AI Generated Text Detection24 Jun 2024
- 2024Detecting AI-Generated Text: Factors Influencing Detectability with Current Methods21 Jun 2024
- 2024PRISM: A Design Framework for Open-Source Foundation Model Safety14 Jun 2024
50 newest of 78 All 78 (JSON)
- 2024Large Language Model Safety: A Holistic Surveycited by 59
- 2024Scaling Trends for Data Poisoning in LLMscited by 30
- 2025Concept-Level Explainability for Auditing & Steering LLM Responsescited by 6
- 2026JailNewsBench: Multi-Lingual and Regional Benchmark for Fake News Generation under Jailbreak Attackscited by 6
- 2025Tailored untruths: How personalisation challenges LLM safeguardscited by 2
- 2026Auditing Cross-Lingual Fairness in Language Model Watermarkingcited by 1
- 2026Beyond AI-Generated Labels: Watermarking, Co-Creation, and Conflation of AI-Generation with Disinformationcited by 0
- 2026Auditing Cross-Lingual Fairness in Language Model Watermarking20 Aug 2026
- 2026Beyond AI-Generated Labels: Watermarking, Co-Creation, and Conflation of AI-Generation with Disinformation13 Jul 2026
- 2026JailNewsBench: Multi-Lingual and Regional Benchmark for Fake News Generation under Jailbreak Attacks1 Mar 2026
- 2025Tailored untruths: How personalisation challenges LLM safeguards14 Oct 2025
- 2025Concept-Level Explainability for Auditing & Steering LLM Responses12 May 2025
- 2024Large Language Model Safety: A Holistic Survey23 Dec 2024
- 2024Scaling Trends for Data Poisoning in LLMs6 Aug 2024
- 2023Exploiting Novel GPT-4 APIscited by 28
- 2026ALSO: Adversarial Online Strategy Optimization for Social Agentscited by 0
- 2026From AI-Generated Content to Agentic Action: Security and Safety Threats in Generative AIcited by 0
- 2026How Far Did They Go? The Persuasive Tactics of Covert LLM Agents in a Discontinued Field Experimentcited by 0
- 2026How Far Did They Go? The Persuasive Tactics of Covert LLM Agents in a Discontinued Field Experiment3 Jun 2026
- 2026From AI-Generated Content to Agentic Action: Security and Safety Threats in Generative AI15 May 2026
- 2026ALSO: Adversarial Online Strategy Optimization for Social Agents15 May 2026
- 2023Exploiting Novel GPT-4 APIs21 Dec 2023
- 2024Knowledge Conflicts for LLMs: A Surveycited by 283
- 2023Can LLM-Generated Misinformation Be Detected?cited by 177
- 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 163
- 2023Generative AIcited by 120
- 2023The Earth is Flat because...: Investigating LLMs' Belief towards Misinformation via Persuasive Conversationcited by 109
- 2023Language Model Behavior: A Comprehensive Surveycited by 92
- 2023Use of LLMs for Illicit Purposes: Threats, Prevention Measures, and Vulnerabilitiescited by 82
- 2025Large language models for automated scholarly paper review: A surveycited by 61
- 2023Generative Pre-trained Transformer: A Comprehensive Review on Enabling Technologies, Potential Applications, Emerging Challenges, and Future Directionscited by 55
- 2024Autonomous LLM-driven research from data to human-verifiable research paperscited by 53
- 2023Fighting Fire with Fire: The Dual Role of LLMs in Crafting and Detecting Elusive Disinformationcited by 51
- 2024AI-Driven Review Systems: Evaluating LLMs in Scalable and Bias-Aware Academic Reviewscited by 44
12 most cited of 65 All 65 (JSON)
- 2026Stance Drift: How AI-mediated Communication Distorts Our Message3 Oct 2026
- 2026VEX-Bench: Benchmarking Verification Complexity of LLM-Generated Misinformation28 Sep 2026
- 2026CrisisFake: Benchmark Validity of AI-Generated Text Detection for Disaster Social Sensing21 Sep 2026
- 2026Falsehood and Impossibility Are Different Directions in an AI's Representation of Language13 Aug 2026
- 2026AI advice suppresses people's willingness to say "I don't know", even when the advice is wrong and accuracy is incentivized15 Jul 2026
- 2026Rethinking AI-Generated Text Detection: A Strong Baseline and the Distribution-Shift Problem That Remains4 Jul 2026
- 2026DataShield: Safety-degrading Data Filtering for LLM Benign Instruction Fine-Tuning29 May 2026
- 2026Label Over Logic? How Source Cues Bias Human Fallacy Judgments More Than LLMs28 May 2026
- 2026The Algorithmic Caricature: Auditing LLM-Generated Political Discourse Across Crisis Events12 May 2026
- 2026Headlines You Won't Forget: Can Pronoun Insertion Increase Memorability?21 Apr 2026
- 2026Interpretable Stylistic Variation in Human and LLM Writing Across Genres, Models, and Decoding Strategies15 Apr 2026
- 2026An Experimental Comparison of the Most Popular Approaches to Fake News Detection26 Mar 2026
12 newest of 65 All 65 (JSON)