mlsanityData to 14 Oct 2026

Attribution Bias in Large Language Models

arXiv 2604.05224 ↗First posted 6 Apr 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

As Large Language Models (LLMs) are increasingly used to support search and information retrieval, it is critical that they accurately attribute content to its original authors. In this work, we introduce AttriBench, the first fame- and demographically-balanced quote attribution benchmark dataset. By explicitly balancing author fame and demographics, AttriBench enables controlled investigation of demographic bias in quote attribution. Using this dataset, we evaluate 11 widely used LLMs across different prompt settings and find that quote attribution remains a challenging task even for frontier models. We observe large and systematic disparities in attribution accuracy between race, gender, and intersectional groups. We further introduce and investigate suppression, a distinct failure mode in which models omit attribution entirely, even when the model has access to authorship information. We find that suppression is widespread and unevenly distributed across demographic groups, revealing systematic biases not captured by standard accuracy metrics. Our results position quote attribution as a benchmark for representational fairness in LLMs.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 32 references that are in the map. First posted on arXiv 6 Apr 2026.

Builds on

14 of 32 references.

References · 14

  1. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
  2. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 924
  3. 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 701
  4. 2021BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generationcited by 412
  5. 2021Measuring Attribution in Natural Language Generation Modelscited by 256
  6. 2024Large Language Models for Education: A Survey and Outlookcited by 188
  7. 2024Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion Tokenscited by 153
  8. 2024CiteME: Can Language Models Accurately Cite Scientific Claims?cited by 48
  9. 2024The emergence of Large Language Models (LLM) as a tool in literature reviews: an LLM automated systematic reviewcited by 21
  10. 2022The Project Dialogism Novel Corpus: A Dataset for Quotation Attribution in Literary Textscited by 13
  11. 2021DirectQuote: A Dataset for Direct Quotation Extraction and Attribution in News Articlescited by 10
  12. 2023Improving Automatic Quotation Attribution in Literary Novelscited by 9
2 more
  1. 2024Evaluating LLMs for Quotation Attribution in Literary Texts: A Case Study of LLaMa3cited by 8
  2. 2025Who Gets Cited? Gender- and Majority-Bias in LLM-Driven Reference Selectioncited by 6

Built on by

Not cited yet.