Hidden Citations Obscure True Impact in Science
Not on the map. Why?
Abstract (arXiv)
References, the mechanism scientists rely on to signal previous knowledge, lately have turned into widely used and misused measures of scientific impact. Yet, when a discovery becomes common knowledge, citations suffer from obliteration by incorporation. This leads to the concept of hidden citation, representing a clear textual credit to a discovery without a reference to the publication embodying it. Here, we rely on unsupervised interpretable machine learning applied to the full text of each paper to systematically identify hidden citations. We find that for influential discoveries hidden citations outnumber citation counts, emerging regardless of publishing venue and discipline. We show that the prevalence of hidden citations is not driven by citation counts, but rather by the degree of the discourse on the topic within the text of the manuscripts, indicating that the more discussed is a discovery, the less visible it is to standard bibliometric analysis. Hidden citations indicate that bibliometric measures offer a limited perspective on quantifying the true impact of a discovery, raising the need to extract knowledge from the full text of the scientific corpus.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 45 references that are in the map. First posted on arXiv 24 Oct 2023.
Builds on
7 of 45 references.
References · 7
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
- 2017Latent Dirichlet Allocation (LDA) and Topic modeling: models, applications, a surveycited by 91
- 2013Quantifying Long-Term Scientific Impactcited by 29
- 2020Neural Embeddings of Scholarly Periodicals Reveal Complex Disciplinary Organizationscited by 16
- 2019Historical comparison of gender inequality in scientific careers across countries and disciplinescited by 14
- 2018The Scientific Prize Network Predicts Who Pushes the Boundaries of Sciencecited by 2
Built on by
Not cited yet.