mlsanityData to 7 Oct 2026

Beyond "Made with AI": Visualizing Provenance Density to Mitigate the Transparency Penalty

arXiv 2609.03460 ↗First posted 3 Sep 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

As generative AI makes polished prose cheap to produce, users can no longer rely on fluency as a proxy for truth. We call this failure mode the Fluency Trap: users trust fluent hallucinations while also discounting accurate content once it is disclosed as AI-generated. Binary ``Made with AI'' labels respond with authorship disclosure, but they do not show what supports a claim. We propose Provenance Density, an evidence-visualization interface that shows the density of verified claims in a text. In a user study with 81 participants, an idealized Provenance Density interface produced a large discernment gap between truth and fabrication (+4.15 points, d=1.82), whereas participants given no signal showed no detectable discrimination. A technical audit with 200 samples shows that retrieval density alone is insufficient; unexpectedly, the Consistency Veto carries most of the discriminative signal on dynamic queries. As AI-generated content becomes indistinguishable from human writing, effective transparency must move from authorship disclosure toward evidence visualization.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 44 references that are in the map. First posted on arXiv 3 Sep 2026.

Builds on

10 of 44 references.

References · 10

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  3. 2023Towards Understanding Sycophancy in Language Modelscited by 988
  4. 2023FreshLLMs: Refreshing Large Language Models with Search Engine Augmentationcited by 308
  5. 2023GPT detectors are biased against non-native English writerscited by 175
  6. 2022Human heuristics for AI-generated language are flawedcited by 104
  7. 2024Epistemic Injustice in Generative AIcited by 16
  8. 2025Machine Bullshit: Characterizing the Emergent Disregard for Truth in Large Language Modelscited by 6
  9. 2025Penalizing Transparency? How AI Disclosure and Author Demographics Shape Human and AI Judgments About Writingcited by 5
  10. 2025Understanding Reader Perception Shifts upon Disclosure of AI Authorshipcited by 3

Built on by

Not cited yet.