When Auditors Fabricate: Batch-Size Degradation and Confident Hallucination in LLM Detection of Planted Document Contamination
Not on the map. Why?
Abstract (arXiv)
Large language models are increasingly proposed as automated auditors of document quality, yet their reliability as detectors of planted errors is poorly characterised. We construct a contaminated corpus of 150 academic papers spanning supply chain management and medical research, injecting 450 known contaminants of three types: typographical corruption, semantic reversal, and absurd out-of-context insertion. We then evaluate Google Gemini 3.0 Pro's ability to recover a 180-contaminant answer-key subset across 60 documents under three prompting regimes of increasing scale: single document, small batch, and large batch. Detection is unreliable even at small scale and collapses entirely at large scale: 50% recovery on single documents and 60% on small batches, a difference this sample cannot resolve, against 2.8% on large batches. The failure mode at scale is not abstention but fabrication. Rather than reporting incomplete processing, the model produced confident findings including invented contaminants of its own, absurdities such as "telepathic squirrel" and "quantum-powered toaster" that mimic the style of the planted material but do not appear in any document. Detection also varies by contamination type: absurd insertions were recovered at 75% in completed evaluations, while semantic reversals and typographical corruptions were each recovered at only 50%. The corruptions most likely to occur in the wild, plausible ones, are the ones most often missed. We conclude that LLM document auditing degrades not gracefully but deceptively, and outline the harness such systems require: bounded batch sizes, direct content injection, and mechanical verification of every reported finding against source text.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 11 references that are in the map. First posted on arXiv 9 Sep 2026.
Builds on
9 of 11 references.
References · 9
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2022Language Models (Mostly) Know What They Knowcited by 1,856
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,346
- 2023Large Language Models are not Fair Evaluatorscited by 1,085
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2023Can large language models provide useful feedback on research papers? A large-scale empirical analysiscited by 200
- 2023Time Travel in LLMs: Tracing Data Contamination in Large Language Modelscited by 177
- 2025When AI Co-Scientists Fail: SPOT-a Benchmark for Automated Verification of Scientific Researchcited by 26
Built on by
Not cited yet.