Transforming Scholarly Landscapes: Influence of Large Language Models on Academic Fields beyond Computer Science
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) have ushered in a transformative era in Natural Language Processing (NLP), reshaping research and extending NLP's influence to other fields of study. However, there is little to no work examining the degree to which LLMs influence other research fields. This work empirically and systematically examines the influence and use of LLMs in fields beyond NLP. We curate 106 LLMs and analyze ~148k papers citing LLMs to quantify their influence and reveal trends in their usage patterns. Our analysis reveals not only the increasing prevalence of LLMs in non-CS fields but also the disparities in their usage, with some fields utilizing them more frequently than others since 2018, notably Linguistics and Engineering together accounting for ~45% of LLM citations. Our findings further indicate that most of these fields predominantly employ task-agnostic LLMs, proficient in zero or few-shot learning without requiring further fine-tuning, to address their domain-specific problems. This study sheds light on the cross-disciplinary impact of NLP through LLMs, providing a better understanding of the opportunities and challenges.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 37 of its 74 references that are in the map. First posted on arXiv 29 Sep 2024.
Builds on
37 of 74 references.
References · 37
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2023A Survey of Large Language Modelscited by 2,537
- 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
- 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
- 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 890
25 more
- 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 820
- 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 702
- 2023Challenges and Applications of Large Language Modelscited by 251
- 2022Talking About Large Language Modelscited by 174
- 2022Language Models with Image Descriptors are Strong Few-Shot Video-Language Learnerscited by 117
- 2023Foundation Models and Fair Usecited by 112
- 2023The Semantic Scholar Open Data Platformcited by 109
- 2021Reduced, Reused and Recycled: The Life of a Dataset in Machine Learning Researchcited by 100
- 2020Growth rates of modern science: A latent piecewise growth curve approach to model publication numbers from established and new literature databasescited by 75
- 2022Code4Struct: Code Generation for Few-Shot Event Structure Predictioncited by 70
- 2023Ecosystem Graphs: The Social Footprint of Foundation Modelscited by 31
- 2020Examining Citations of Natural Language Processing Literaturecited by 20
- 2023An Evaluation on Large Language Model Outputs: Discourse and Memorizationcited by 20
- 2023We are Who We Cite: Bridges of Influence Between Natural Language Processing and Other Academic Fieldscited by 20
- 2022Geographic Citation Gaps in NLP Researchcited by 19
- 2023A Diachronic Analysis of Paradigm Shifts in NLP Research: When, How, and Why?cited by 14
- 2023Forgotten Knowledge: Examining the Citational Amnesia in NLPcited by 13
- 2015Measuring academic influence: Not all citations are equalcited by 11
- 2023Personalized Jargon Identification for Enhanced Interdisciplinary Communicationcited by 11
- 2018Interdisciplinarity as Diversity in Citation Patterns among Journals: Rao-Stirling Diversity, Relative Variety, and the Gini coefficientcited by 7
- 2015A Review of Theory and Practice in Scientometricscited by 6
- 2019Visualizing a Field of Research: A Methodology of Systematic Scientometric Reviewscited by 6
- 2024Citation Amnesia: On The Recency Bias of NLP and Other Academic Fieldscited by 5
- 2023Defining a New NLP Playgroundcited by 4
- 2024What We Talk About When We Talk About LMs: Implicit Paradigm Shifts and the Ship of Language Modelscited by 2
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluationcited by 41
- 2025Foundations of LLM Knowledge Materialization: Termination, Reproducibility, Robustnesscited by 2
- 2026How Open Must Language Models be to Enable Reliable Scientific Inference?cited by 2
- 2026The Shrinking Lifespan of LLMs in Sciencecited by 1
- 2026The Shrinking Lifespan of LLMs in Science8 Apr 2026
- 2026How Open Must Language Models be to Enable Reliable Scientific Inference?27 Mar 2026
- 2025Foundations of LLM Knowledge Materialization: Termination, Reproducibility, Robustness8 Oct 2025
- 2025Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluation7 Feb 2025