mlsanityData to 14 Oct 2026

Authority, Truth, and Citation Bias: A Large-Scale Multi-Domain Benchmark for Studying Epistemic Susceptibility in Large Language Models

arXiv 2606.13104 ↗First posted 11 Jun 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models are increasingly deployed in citation-augmented settings, yet the effect of citation presence on model behavior independent of factual content remains poorly understood. We introduce AuthorityBench, a 220,564-prompt multi-domain benchmark that isolates how citation-based authority signals influence epistemic behavior in LLMs. The benchmark uses a fully balanced 2x2 factorial design crossing claim veracity with citation veracity, the first to do so, across four domains (general knowledge, science, law, and medicine), with controlled variation over 40 prompt templates, four venue prestige tiers, and a country-coded author name dataset. Evaluating seven models on 12 structured research questions, we find that citation presence, whether real or fabricated, consistently increases hallucination rates relative to a no-citation baseline. The effect is strongest when fabricated citations accompany true claims, raising hallucination rates by 3 to 22 percentage points and reaching 35 to 77% in the general knowledge domain, while legal claims are comparatively robust and venue prestige and author demographics show negligible impact. All datasets and evaluation code are available at: https://github.com/floating-reeds/AuthorityBench

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 24 references that are in the map. First posted on arXiv 11 Jun 2026.

Builds on

16 of 24 references.

References · 16

  1. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  2. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
  3. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
  4. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
  5. 2017Crowdsourcing Multiple Choice Science Questionscited by 765
  6. 2023Enabling Large Language Models to Generate Text with Citationscited by 595
  7. 2020Fact or Fiction: Verifying Scientific Claimscited by 554
  8. 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 543
  9. 2023Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflictscited by 341
  10. 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 332
  11. 2024Knowledge Conflicts for LLMs: A Surveycited by 283
  12. 2021When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Datasetcited by 201
4 more
  1. 2023Gender bias and stereotypes in Large Language Modelscited by 187
  2. 2026Whose Facts Win? LLM Source Preferences under Knowledge Conflictscited by 12
  3. 2026FACTUM: Mechanistic Detection of Citation Hallucination in Long-Form RAGcited by 6
  4. 2026Visualizing and Benchmarking LLM Factual Hallucination Tendencies via Internal State Analysis and Clusteringcited by 1

Built on by

Not cited yet.