Many Ways to Be Fake: Benchmarking Fake News Detection Under Strategy-Driven AI Generation
Not on the map. Why?
Abstract (arXiv)
Recent advances in large language models (LLMs) have enabled the large-scale generation of highly fluent and deceptive news-like content. While prior work has often treated fake news detection as a binary classification problem, modern fake news increasingly arises through human-AI collaboration, where strategic inaccuracies are embedded within otherwise accurate and credible narratives. These mixed-truth cases represent a realistic and consequential threat, yet they remain underrepresented in existing benchmarks. To address this gap, we introduce MANYFAKE, a synthetic benchmark containing 6,798 fake news articles generated through multiple strategy-driven prompting pipelines that capture many ways fake news can be constructed and refined. Using this benchmark, we evaluate a range of state-of-the-art fake news detectors. Our results show that even advanced reasoning-enabled models approach saturation on fully fabricated stories, but remain brittle when falsehoods are subtle, optimized, and interwoven with accurate information.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 36 references that are in the map. First posted on arXiv 10 Apr 2026.
Builds on
16 of 36 references.
References · 16
- 2019Defending Against Neural Fake Newscited by 553
- 2017"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detectioncited by 361
- 2017Fake News Detection on Social Media: A Data Mining Perspectivecited by 334
- 2018FakeNewsNet: A Data Repository with News Content, Social Context and Spatialtemporal Information for Studying Fake News on Social Mediacited by 281
- 2023Can LLM-Generated Misinformation Be Detected?cited by 173
- 2017CSI: A Hybrid Deep Model for Fake News Detectioncited by 101
- 2023The science of fake newscited by 94
- 2017Beyond News Contents: The Role of Social Context for Fake News Detectioncited by 91
- 2023Fake News in Sheep's Clothing: Robust Fake News Detection Against LLM-Empowered Style Attackscited by 69
- 2023Fighting Fire with Fire: The Dual Role of LLMs in Crafting and Detecting Elusive Disinformationcited by 51
- 2023Towards Reliable Misinformation Mitigation: Generalization, Uncertainty, and GPT-4cited by 45
- 2025LLM-Generated Fake News Induces Truth Decay in News Ecosystem: A Case Study on Neural News Recommendationcited by 19
4 more
- 2024Fake Artificial Intelligence Generated Contents (FAIGC): A Survey of Theories, Detection Methods, and Opportunitiescited by 7
- 2025Debunk and Infer: Multimodal Fake News Detection via Diffusion-Generated Evidence and LLM Reasoningcited by 7
- 2024Have LLMs Reopened the Pandora's Box of AI-Generated Fake News?cited by 6
- 2025Echoes of Automation: The Increasing Use of LLMs in Newsmakingcited by 2
Built on by
Not cited yet.