mlsanityData to 7 Oct 2026

Transforming Scholarly Landscapes: Influence of Large Language Models on Academic Fields beyond Computer Science

arXiv 2409.19508 ↗First posted 29 Sep 2024cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) have ushered in a transformative era in Natural Language Processing (NLP), reshaping research and extending NLP's influence to other fields of study. However, there is little to no work examining the degree to which LLMs influence other research fields. This work empirically and systematically examines the influence and use of LLMs in fields beyond NLP. We curate 106 LLMs and analyze ~148k papers citing LLMs to quantify their influence and reveal trends in their usage patterns. Our analysis reveals not only the increasing prevalence of LLMs in non-CS fields but also the disparities in their usage, with some fields utilizing them more frequently than others since 2018, notably Linguistics and Engineering together accounting for ~45% of LLM citations. Our findings further indicate that most of these fields predominantly employ task-agnostic LLMs, proficient in zero or few-shot learning without requiring further fine-tuning, to address their domain-specific problems. This study sheds light on the cross-disciplinary impact of NLP through LLMs, providing a better understanding of the opportunities and challenges.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 37 of its 74 references that are in the map. First posted on arXiv 29 Sep 2024.

Builds on

37 of 74 references.

References · 37

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  6. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  7. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  8. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  9. 2023A Survey of Large Language Modelscited by 2,537
  10. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
  11. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
  12. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 890
25 more
  1. 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 820
  2. 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 702
  3. 2023Challenges and Applications of Large Language Modelscited by 251
  4. 2022Talking About Large Language Modelscited by 174
  5. 2022Language Models with Image Descriptors are Strong Few-Shot Video-Language Learnerscited by 117
  6. 2023Foundation Models and Fair Usecited by 112
  7. 2023The Semantic Scholar Open Data Platformcited by 109
  8. 2021Reduced, Reused and Recycled: The Life of a Dataset in Machine Learning Researchcited by 100
  9. 2020Growth rates of modern science: A latent piecewise growth curve approach to model publication numbers from established and new literature databasescited by 75
  10. 2022Code4Struct: Code Generation for Few-Shot Event Structure Predictioncited by 70
  11. 2023Ecosystem Graphs: The Social Footprint of Foundation Modelscited by 31
  12. 2020Examining Citations of Natural Language Processing Literaturecited by 20
  13. 2023An Evaluation on Large Language Model Outputs: Discourse and Memorizationcited by 20
  14. 2023We are Who We Cite: Bridges of Influence Between Natural Language Processing and Other Academic Fieldscited by 20
  15. 2022Geographic Citation Gaps in NLP Researchcited by 19
  16. 2023A Diachronic Analysis of Paradigm Shifts in NLP Research: When, How, and Why?cited by 14
  17. 2023Forgotten Knowledge: Examining the Citational Amnesia in NLPcited by 13
  18. 2015Measuring academic influence: Not all citations are equalcited by 11
  19. 2023Personalized Jargon Identification for Enhanced Interdisciplinary Communicationcited by 11
  20. 2018Interdisciplinarity as Diversity in Citation Patterns among Journals: Rao-Stirling Diversity, Relative Variety, and the Gini coefficientcited by 7
  21. 2015A Review of Theory and Practice in Scientometricscited by 6
  22. 2019Visualizing a Field of Research: A Methodology of Systematic Scientometric Reviewscited by 6
  23. 2024Citation Amnesia: On The Recency Bias of NLP and Other Academic Fieldscited by 5
  24. 2023Defining a New NLP Playgroundcited by 4
  25. 2024What We Talk About When We Talk About LMs: Implicit Paradigm Shifts and the Ship of Language Modelscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.