Compound Deception in Elite Peer Review: A Failure Mode Taxonomy of 100 Fabricated Citations at NeurIPS 2025
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly used in academic writing workflows, yet they frequently hallucinate by generating citations to sources that do not exist. This study analyzes 100 AI-generated hallucinated citations that appeared in papers accepted by the 2025 Conference on Neural Information Processing Systems (NeurIPS), one of the world's most prestigious AI conferences. Despite review by 3-5 expert researchers per paper, these fabricated citations evaded detection, appearing in 53 published papers (approx. 1% of all accepted papers). We develop a five-category taxonomy that classifies hallucinations by their failure mode: Total Fabrication (66%), Partial Attribute Corruption (27%), Identifier Hijacking (4%), Placeholder Hallucination (2%), and Semantic Hallucination (1%). Our analysis reveals a critical finding: every hallucination (100%) exhibited compound failure modes. The distribution of secondary characteristics was dominated by Semantic Hallucination (63%) and Identifier Hijacking (29%), which often appeared alongside Total Fabrication to create a veneer of plausibility and false verifiability. These compound structures exploit multiple verification heuristics simultaneously, explaining why peer review fails to detect them. The distribution exhibits a bimodal pattern: 92% of contaminated papers contain 1-2 hallucinations (minimal AI use) while 8% contain 4-13 hallucinations (heavy reliance). These findings demonstrate that current peer review processes do not include effective citation verification and that the problem extends beyond NeurIPS to other major conferences, government reports, and professional consulting. We propose mandatory automated citation verification at submission as an implementable solution to prevent fabricated citations from becoming normalized in scientific literature.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 4 of its 14 references that are in the map. First posted on arXiv 5 Feb 2026.
Builds on
4 of 14 references.
References · 4
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2023A Survey of Hallucination in Large Foundation Modelscited by 365
- 2024Large Legal Fictions: Profiling Legal Hallucinations in Large Language Modelscited by 144
Built on by
Citing papers per year: 2026: 13.
13 papers.
Sort:
By area:
- 2026SciIntegrity-Bench: A Benchmark for Evaluating Academic Integrity in AI Scientist Systemscited by 4
- 2026Detecting and Correcting Reference Hallucinations in Commercial LLMs and Deep Research Agentscited by 3
- 2026TRACE: Trajectory Reasoning through Adaptive Cross-Step Evidence Aggregation for LLM Agentscited by 3
- 2026Distributed Denial of Science: How Indirect Data Poisoning of AI Systems Can Industrialize Scientific Fraudcited by 2
- 2026BibTeX Citation Errors in Scientific Publishing Agents: Evaluation and Mitigationcited by 1
- 2026Inspectable AI for Science: A Research Object Approach to Generative AI Governancecited by 1
- 2026Phantom References: Hallucinated Citations That Survive Peer Review at Top-Tier Conferencescited by 1
- 2026VERITAS: Towards a General-Purpose Replication Tool for Scientific Researchcited by 1
- 2026Paper Reconstruction Evaluation: Evaluating Presentation and Hallucination in AI-written Paperscited by 0
- 2026sciwrite-lint: Verification Infrastructure for the Age of Science Vibe-Writingcited by 0
- 2026Intelligence Is Not the Bottleneck: Validating an LLM First-Pass Manuscript Score Against Peer-Review Outcomescited by 0
- 2026The Slop Paradox: How Synthetic Standardization Erodes Clinical Uncertainty and Cross-Modal Alignment in AI-Rewritten Radiology Reportscited by 0
1 more
- 2026Toward Trustworthy Autonomous Science: A Two-Year Community Roadmap13 Jul 2026
- 2026Distributed Denial of Science: How Indirect Data Poisoning of AI Systems Can Industrialize Scientific Fraud12 Jul 2026
- 2026VERITAS: Towards a General-Purpose Replication Tool for Scientific Research3 Jul 2026
- 2026Phantom References: Hallucinated Citations That Survive Peer Review at Top-Tier Conferences1 Jul 2026
- 2026The Slop Paradox: How Synthetic Standardization Erodes Clinical Uncertainty and Cross-Modal Alignment in AI-Rewritten Radiology Reports16 Jun 2026
- 2026Intelligence Is Not the Bottleneck: Validating an LLM First-Pass Manuscript Score Against Peer-Review Outcomes14 Jun 2026
- 2026TRACE: Trajectory Reasoning through Adaptive Cross-Step Evidence Aggregation for LLM Agents5 Jun 2026
- 2026SciIntegrity-Bench: A Benchmark for Evaluating Academic Integrity in AI Scientist Systems11 May 2026
- 2026Inspectable AI for Science: A Research Object Approach to Generative AI Governance13 Apr 2026
- 2026sciwrite-lint: Verification Infrastructure for the Age of Science Vibe-Writing9 Apr 2026
- 2026Detecting and Correcting Reference Hallucinations in Commercial LLMs and Deep Research Agents3 Apr 2026
- 2026BibTeX Citation Errors in Scientific Publishing Agents: Evaluation and Mitigation3 Apr 2026
- 2026SciIntegrity-Bench: A Benchmark for Evaluating Academic Integrity in AI Scientist Systemscited by 4
- 2026BibTeX Citation Errors in Scientific Publishing Agents: Evaluation and Mitigationcited by 1
- 2026Inspectable AI for Science: A Research Object Approach to Generative AI Governancecited by 1
- 2026Phantom References: Hallucinated Citations That Survive Peer Review at Top-Tier Conferencescited by 1
- 2026VERITAS: Towards a General-Purpose Replication Tool for Scientific Researchcited by 1
- 2026sciwrite-lint: Verification Infrastructure for the Age of Science Vibe-Writingcited by 0
- 2026Intelligence Is Not the Bottleneck: Validating an LLM First-Pass Manuscript Score Against Peer-Review Outcomescited by 0
- 2026The Slop Paradox: How Synthetic Standardization Erodes Clinical Uncertainty and Cross-Modal Alignment in AI-Rewritten Radiology Reportscited by 0
- 2026Toward Trustworthy Autonomous Science: A Two-Year Community Roadmapcited by 0
- 2026Toward Trustworthy Autonomous Science: A Two-Year Community Roadmap13 Jul 2026
- 2026VERITAS: Towards a General-Purpose Replication Tool for Scientific Research3 Jul 2026
- 2026Phantom References: Hallucinated Citations That Survive Peer Review at Top-Tier Conferences1 Jul 2026
- 2026The Slop Paradox: How Synthetic Standardization Erodes Clinical Uncertainty and Cross-Modal Alignment in AI-Rewritten Radiology Reports16 Jun 2026
- 2026Intelligence Is Not the Bottleneck: Validating an LLM First-Pass Manuscript Score Against Peer-Review Outcomes14 Jun 2026
- 2026SciIntegrity-Bench: A Benchmark for Evaluating Academic Integrity in AI Scientist Systems11 May 2026
- 2026Inspectable AI for Science: A Research Object Approach to Generative AI Governance13 Apr 2026
- 2026sciwrite-lint: Verification Infrastructure for the Age of Science Vibe-Writing9 Apr 2026
- 2026BibTeX Citation Errors in Scientific Publishing Agents: Evaluation and Mitigation3 Apr 2026