We are Who We Cite: Bridges of Influence Between Natural Language Processing and Other Academic Fields
Not on the map. Why?
Abstract (arXiv)
Natural Language Processing (NLP) is poised to substantially influence the world. However, significant progress comes hand-in-hand with substantial risks. Addressing them requires broad engagement with various fields of study. Yet, little empirical work examines the state of such engagement (past or current). In this paper, we quantify the degree of influence between 23 fields of study and NLP (on each other). We analyzed ~77k NLP papers, ~3.1m citations from NLP papers to other papers, and ~1.8m citations from other papers to NLP papers. We show that, unlike most fields, the cross-field engagement of NLP, measured by our proposed Citation Field Diversity Index (CFDI), has declined from 0.58 in 1980 to 0.31 in 2022 (an all-time low). In addition, we find that NLP has grown more insular -- citing increasingly more NLP papers and having fewer papers that act as bridges between fields. NLP citations are dominated by computer science; Less than 8% of NLP citations are to linguistics, and less than 3% are to math and psychology. These findings underscore NLP's urgent need to reflect on its engagement with various fields.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 14 of its 52 references that are in the map. First posted on arXiv 23 Oct 2023.
Builds on
14 of 52 references.
References · 14
- 2018Model Cards for Model Reportingcited by 1,068
- 2023The Semantic Scholar Open Data Platformcited by 109
- 2022What Do NLP Researchers Believe? Results of the NLP Community Metasurveycited by 28
- 2023The Elephant in the Room: Analyzing the Presence of Big Tech in Natural Language Processing Researchcited by 27
- 2020Examining Citations of Natural Language Processing Literaturecited by 20
- 2022Geographic Citation Gaps in NLP Researchcited by 19
- 2020Gender Gap in Natural Language Processing Research: Disparities in Authorship and Citationscited by 17
- 2021The CSO Classifier: Ontology-Driven Detection of Research Topics in Scholarly Articlescited by 16
- 2023AI Usage Cards: Responsibly Reporting AI-generated Contentcited by 16
- 2023Forgotten Knowledge: Examining the Citational Amnesia in NLPcited by 13
- 2022D3: A Massive Dataset of Scholarly Metadata for Analyzing the State of Computer Science Researchcited by 11
- 2018Interdisciplinarity as Diversity in Citation Patterns among Journals: Rao-Stirling Diversity, Relative Variety, and the Gini coefficientcited by 7
Built on by
Citing papers per year: 2023: 1; 2024: 13; 2025: 4; 2026: 2.
20 papers.
Sort:
- 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 200
- 2024Stop! In the Name of Flaws: Disentangling Personal Names and Sociodemographic Attributes in NLPcited by 22
- 2024From Insights to Actions: The Impact of Interpretability and Analysis Research on NLPcited by 20
- 2024Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challengescited by 18
- 2024CiteAssist: A System for Automated Preprint Citation and BibTeX Generationcited by 11
- 2024What's Wrong? Refining Meeting Summaries with LLM Feedbackcited by 8
- 2025CHIMERA: A Knowledge Base of Scientific Idea Recombinations for Research Analysis and Ideationcited by 6
- 2024Citation Amnesia: On The Recency Bias of NLP and Other Academic Fieldscited by 5
- 2024Transforming Scholarly Landscapes: Influence of Large Language Models on Academic Fields beyond Computer Sciencecited by 4
- 2024Understanding "Democratization" in NLP and ML Researchcited by 3
- 2023Collaboration or Corporate Capture? Quantifying NLP's Reliance on Industry Artifacts and Contributionscited by 2
- 2024What We Talk About When We Talk About LMs: Implicit Paradigm Shifts and the Ship of Language Modelscited by 2
8 more
- 2025In-depth Research Impact Summarization through Fine-Grained Temporal Citation Analysiscited by 2
- 2024Is there really a Citation Age Bias in NLP?cited by 1
- 2024SciEvo: A 2 Million, 30-Year Cross-disciplinary Dataset for Temporal Scientometric Analysiscited by 1
- 2025Good Intentions Beyond ACL: Who Does NLP for Social Good, and Where?cited by 1
- 2024Leveraging Large Language Models for Actionable Course Evaluation Student Feedback to Lecturerscited by 0
- 2025Big Tech-Funded AI Papers Have Higher Citation Impact, Greater Insularity, and Larger Recency Biascited by 0
- 2026How Does Research Evolve? Tracing Cross-Domain Trajectories in NLP, ML, and CV Through Claim-Grounded Typed Citationscited by 0
- 2026The Future of NLP may not be at NLP Conferences: Scholarly Migration Patterns in Natural Language Processingcited by 0
- 2026The Future of NLP may not be at NLP Conferences: Scholarly Migration Patterns in Natural Language Processing2 Jul 2026
- 2026How Does Research Evolve? Tracing Cross-Domain Trajectories in NLP, ML, and CV Through Claim-Grounded Typed Citations21 Jun 2026
- 2025Big Tech-Funded AI Papers Have Higher Citation Impact, Greater Insularity, and Larger Recency Bias5 Dec 2025
- 2025Good Intentions Beyond ACL: Who Does NLP for Social Good, and Where?6 Oct 2025
- 2025CHIMERA: A Knowledge Base of Scientific Idea Recombinations for Research Analysis and Ideation27 May 2025
- 2025In-depth Research Impact Summarization through Fine-Grained Temporal Citation Analysis20 May 2025
- 2024SciEvo: A 2 Million, 30-Year Cross-disciplinary Dataset for Temporal Scientometric Analysis12 Oct 2024
- 2024Transforming Scholarly Landscapes: Influence of Large Language Models on Academic Fields beyond Computer Science29 Sep 2024
- 2024What's Wrong? Refining Meeting Summaries with LLM Feedback16 Jul 2024
- 2024CiteAssist: A System for Automated Preprint Citation and BibTeX Generation3 Jul 2024
- 2024What We Talk About When We Talk About LMs: Implicit Paradigm Shifts and the Ship of Language Models2 Jul 2024
- 2024Leveraging Large Language Models for Actionable Course Evaluation Student Feedback to Lecturers1 Jul 2024
8 more
- 2024From Insights to Actions: The Impact of Interpretability and Analysis Research on NLP18 Jun 2024
- 2024Understanding "Democratization" in NLP and ML Research17 Jun 2024
- 2024Stop! In the Name of Flaws: Disentangling Personal Names and Sociodemographic Attributes in NLP27 May 2024
- 2024Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challenges24 May 2024
- 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Models11 Apr 2024
- 2024Citation Amnesia: On The Recency Bias of NLP and Other Academic Fields19 Feb 2024
- 2024Is there really a Citation Age Bias in NLP?7 Jan 2024
- 2023Collaboration or Corporate Capture? Quantifying NLP's Reliance on Industry Artifacts and Contributions6 Dec 2023
- 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 200
- 2024Stop! In the Name of Flaws: Disentangling Personal Names and Sociodemographic Attributes in NLPcited by 22
- 2024From Insights to Actions: The Impact of Interpretability and Analysis Research on NLPcited by 20
- 2024Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challengescited by 18
- 2024CiteAssist: A System for Automated Preprint Citation and BibTeX Generationcited by 11
- 2024What's Wrong? Refining Meeting Summaries with LLM Feedbackcited by 8
- 2025CHIMERA: A Knowledge Base of Scientific Idea Recombinations for Research Analysis and Ideationcited by 6
- 2024Citation Amnesia: On The Recency Bias of NLP and Other Academic Fieldscited by 5
- 2024Transforming Scholarly Landscapes: Influence of Large Language Models on Academic Fields beyond Computer Sciencecited by 4
- 2024Understanding "Democratization" in NLP and ML Researchcited by 3
- 2023Collaboration or Corporate Capture? Quantifying NLP's Reliance on Industry Artifacts and Contributionscited by 2
- 2024What We Talk About When We Talk About LMs: Implicit Paradigm Shifts and the Ship of Language Modelscited by 2
12 most cited of 20 All 20 (JSON)
- 2026The Future of NLP may not be at NLP Conferences: Scholarly Migration Patterns in Natural Language Processing2 Jul 2026
- 2026How Does Research Evolve? Tracing Cross-Domain Trajectories in NLP, ML, and CV Through Claim-Grounded Typed Citations21 Jun 2026
- 2025Big Tech-Funded AI Papers Have Higher Citation Impact, Greater Insularity, and Larger Recency Bias5 Dec 2025
- 2025Good Intentions Beyond ACL: Who Does NLP for Social Good, and Where?6 Oct 2025
- 2025CHIMERA: A Knowledge Base of Scientific Idea Recombinations for Research Analysis and Ideation27 May 2025
- 2025In-depth Research Impact Summarization through Fine-Grained Temporal Citation Analysis20 May 2025
- 2024SciEvo: A 2 Million, 30-Year Cross-disciplinary Dataset for Temporal Scientometric Analysis12 Oct 2024
- 2024Transforming Scholarly Landscapes: Influence of Large Language Models on Academic Fields beyond Computer Science29 Sep 2024
- 2024What's Wrong? Refining Meeting Summaries with LLM Feedback16 Jul 2024
- 2024CiteAssist: A System for Automated Preprint Citation and BibTeX Generation3 Jul 2024
- 2024What We Talk About When We Talk About LMs: Implicit Paradigm Shifts and the Ship of Language Models2 Jul 2024
- 2024Leveraging Large Language Models for Actionable Course Evaluation Student Feedback to Lecturers1 Jul 2024
12 newest of 20 All 20 (JSON)