mlsanityData to 14 Oct 2026

Citing Less Critically: LLMs Reshape the Rhetoric and Reach of Scientific Citation

arXiv 2609.01432 ↗First posted 1 Sep 2026cs.DL cs.CL cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

Scientific citations carry rhetorical intent. Scholars may cite prior work positively (supporting), negatively (contrasting), or neutrally (mentioning). As large language models (LLMs) increasingly assist scientific writing, whether they reproduce citations with the same rhetorical intent as humans remains unclear. We introduce a masked-citation task to compare human and LLM-generated citation behavior. For each citation context, an LLM generates a replacement citation sentence, producing a counterfactual corpus directly comparable to human citation. We analyze what, whom, and how models cite, using an LLM-as-a-judge to classify citation intent and a 20-million-edge coauthorship network to measure social distance between cited authors. Across six popular LLMs and 1,746 top NLP conference papers (63k+ contexts, 132k+ citations), three patterns emerge: (1) Compared with human citation, LLMs cite significantly less critically; (2) LLMs over-cite popular and older papers, a tendency amplified for contrasting citations where human writing more often draws on recent, niche work; (3) Whereas humans often cite within their close social network, especially for supporting citations, LLMs tend to draw on more socially distant authors. Together, these differences are double-edged: LLM citation reaches beyond a scholar's close collaborators while being less critical and amplifying visibility bias, reshaping the rhetoric and reach of scientific citation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 43 references that are in the map. First posted on arXiv 1 Sep 2026.

Builds on

15 of 43 references.

References · 15

  1. 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
  2. 2019Structural Scaffolds for Citation Intent Classification in Scientific Publicationscited by 130
  3. 2024CiteME: Can Language Models Accurately Cite Scientific Claims?cited by 48
  4. 2026AutoSOTA: An End-to-End Automated Research System for State-of-the-Art AI Model Discoverycited by 23
  5. 2024Large Language Models Reflect Human Citation Patterns with a Heightened Citation Biascited by 17
  6. 2024HLM-Cite: Hybrid Language Model Workflow for Text-based Scientific Citation Predictioncited by 15
  7. 2026LLM hallucinations in the wild: Large-scale evidence from non-existent citationscited by 7
  8. 2025Who Gets Cited? Gender- and Majority-Bias in LLM-Driven Reference Selectioncited by 6
  9. 2026LiveBrowseComp: Are Search Agents Searching, or Just Verifying What They Already Know?cited by 5
  10. 2021Investigating Disagreement in the Scientific Literaturecited by 3
  11. 2025Hallucinations in Bibliographic Recommendation: Citation Frequency as a Proxy for Training Data Redundancycited by 2
  12. 2016Citations: Indicators of Quality? The Impact Fallacycited by 1
3 more
  1. 2022The narrowing of literature use and the restricted mobility of papers in the sciencescited by 1
  2. 2024The origin, consequence, and visibility of criticism in sciencecited by 1
  3. 2025Citation proximus: the role of social and semantic ties in citing behaviourcited by 1

Built on by

Not cited yet.