Is there really a Citation Age Bias in NLP?
Not on the map. Why?
Abstract (arXiv)
Citations are a key ingredient of scientific research to relate a paper to others published in the community. Recently, it has been noted that there is a citation age bias in the Natural Language Processing (NLP) community, one of the currently fastest growing AI subfields, in that the mean age of the bibliography of NLP papers has become ever younger in the last few years, leading to `citation amnesia' in which older knowledge is increasingly forgotten. In this work, we put such claims into perspective by analyzing the bibliography of ~300k papers across 15 different scientific fields submitted to the popular preprint server Arxiv in the time period from 2013 to 2022. We find that all AI subfields (in particular: cs.AI, cs.CL, cs.CV, cs.LG) have similar trends of citation amnesia, in which the age of the bibliography has roughly halved in the last 10 years (from above 12 in 2013 to below 7 in 2022), on average. Rather than diagnosing this as a citation age bias in the NLP community, we believe this pattern is an artefact of the dynamics of these research fields, in which new knowledge is produced in ever shorter time intervals.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 39 references that are in the map. First posted on arXiv 7 Jan 2024.
Builds on
20 of 39 references.
References · 20
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,196
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
- 2019MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distancecited by 415
- 2019Structural Scaffolds for Citation Intent Classification in Scientific Publicationscited by 129
- 2019On the Use of ArXiv as a Datasetcited by 101
- 2023AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZcited by 74
- 2023ChatGPT: A Meta-Analysis after 2.5 Monthscited by 50
- 2023We are Who We Cite: Bridges of Influence Between Natural Language Processing and Other Academic Fieldscited by 20
- 2022Geographic Citation Gaps in NLP Researchcited by 19
8 more
- 2020Gender Gap in Natural Language Processing Research: Disparities in Authorship and Citationscited by 17
- 2023Forgotten Knowledge: Examining the Citational Amnesia in NLPcited by 13
- 2023Exploring the Landscape of Natural Language Processing Researchcited by 7
- 2022Transformers Go for the LOLs: Generating (Humourous) Titles from Scientific Abstracts End-to-Endcited by 6
- 2019Predicting Research Trends From Arxivcited by 5
- 2014On the Shoulders of Giants: The Growing Impact of Older Articlescited by 4
- 2015Attention decay in sciencecited by 4
- 2022Did AI get more negative recently?cited by 4
Built on by
Citing papers per year: 2024: 1.
1 paper.