mlsanityData to 7 Oct 2026

Density, asymmetry and citation dynamics in scientific literature

arXiv 2506.23366 ↗First posted 29 Jun 2025cs.DL cs.CL cs.SIcited by 0

Not on the map. Why?

Abstract (arXiv)

Scientific behavior is often characterized by a tension between building upon established knowledge and introducing novel ideas. Here, we investigate whether this tension is reflected in the relationship between the similarity of a scientific paper to previous research and its eventual citation rate. To operationalize similarity to previous research, we introduce two complementary metrics to characterize the local geometry of a publication's semantic neighborhood: (1) density (ρ), defined as the ratio between a fixed number of previously-published papers and the minimum distance enclosing those papers in a semantic embedding space, and (2) asymmetry (α), defined as the average directional difference between a paper and its nearest neighbors. We tested the predictive relationship between these two metrics and its subsequent citation rate using a Bayesian hierarchical regression approach, surveying ~ 53,000 publications across nine academic disciplines and five different document embeddings. While the individual effects of ρ on citation count are small and variable, incorporating density-based predictors consistently improves out-of-sample prediction when added to baseline models. These results suggest that the density of a paper's surrounding scientific literature may carry modest but informative signals about its eventual impact. Meanwhile, we find no evidence that publication asymmetry improves model predictions of citation rates. Our work provides a scalable framework for linking document embeddings to scientometric outcomes and highlights new questions regarding the role that semantic similarity plays in shaping the dynamics of scientific reward.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 28 references that are in the map. First posted on arXiv 29 Jun 2025.

Builds on

9 of 28 references.

References · 9

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  2. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  3. 2018Deep contextualized word representationscited by 2,285
  4. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
  5. 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 426
  6. 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4cited by 112
  7. 2022Predicting the Future of AI with AI: High-quality link prediction in an exponentially growing knowledge networkcited by 34
  8. 2013Tradition and Innovation in Scientists' Research Strategiescited by 26
  9. 2021New Directions in Science Emerge from Disconnection and Discordcited by 8

Built on by

Not cited yet.