Beyond "Made with AI": Visualizing Provenance Density to Mitigate the Transparency Penalty
Not on the map. Why?
Abstract (arXiv)
As generative AI makes polished prose cheap to produce, users can no longer rely on fluency as a proxy for truth. We call this failure mode the Fluency Trap: users trust fluent hallucinations while also discounting accurate content once it is disclosed as AI-generated. Binary ``Made with AI'' labels respond with authorship disclosure, but they do not show what supports a claim. We propose Provenance Density, an evidence-visualization interface that shows the density of verified claims in a text. In a user study with 81 participants, an idealized Provenance Density interface produced a large discernment gap between truth and fabrication (+4.15 points, d=1.82), whereas participants given no signal showed no detectable discrimination. A technical audit with 200 samples shows that retrieval density alone is insufficient; unexpectedly, the Consistency Veto carries most of the discriminative signal on dynamic queries. As AI-generated content becomes indistinguishable from human writing, effective transparency must move from authorship disclosure toward evidence visualization.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 44 references that are in the map. First posted on arXiv 3 Sep 2026.
Builds on
10 of 44 references.
References · 10
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
- 2023Towards Understanding Sycophancy in Language Modelscited by 988
- 2023FreshLLMs: Refreshing Large Language Models with Search Engine Augmentationcited by 308
- 2023GPT detectors are biased against non-native English writerscited by 175
- 2022Human heuristics for AI-generated language are flawedcited by 104
- 2024Epistemic Injustice in Generative AIcited by 16
- 2025Machine Bullshit: Characterizing the Emergent Disregard for Truth in Large Language Modelscited by 6
- 2025Penalizing Transparency? How AI Disclosure and Author Demographics Shape Human and AI Judgments About Writingcited by 5
- 2025Understanding Reader Perception Shifts upon Disclosure of AI Authorshipcited by 3
Built on by
Not cited yet.