mlsanityData to 7 Oct 2026

Oil & Water? Diffusion of AI Within and Across Scientific Fields

arXiv 2405.15828 ↗First posted 24 May 2024cs.DL cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

This study empirically investigates claims of the increasing ubiquity of artificial intelligence (AI) within roughly 80 million research publications across 20 diverse scientific fields, by examining the change in scholarly engagement with AI from 1985 through 2022. We observe exponential growth, with AI-engaged publications increasing approximately thirteenfold (13x) across all fields, suggesting a dramatic shift from niche to mainstream. Moreover, we provide the first empirical examination of the distribution of AI-engaged publications across publication venues within individual fields, with results that reveal a broadening of AI engagement within disciplines. While this broadening engagement suggests a move toward greater disciplinary integration in every field, increased ubiquity is associated with a semantic tension between AI-engaged research and more traditional disciplinary research. Through an analysis of tens of millions of document embeddings, we observe a complex interplay between AI-engaged and non-AI-engaged research within and across fields, suggesting that increasing ubiquity is something of an oil-and-water phenomenon -- AI-engaged work is spreading out over fields, but not mixing well with non-AI-engaged work.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 12 of its 31 references that are in the map. First posted on arXiv 24 May 2024.

Builds on

12 of 31 references.

References · 12

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  3. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  4. 2019Generating Long Sequences with Sparse Transformerscited by 1,523
  5. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
  6. 2017Solving high-dimensional partial differential equations using deep learningcited by 549
  7. 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 426
  8. 2018Discovering physical concepts with neural networkscited by 117
  9. 2021Reduced, Reused and Recycled: The Life of a Dataset in Machine Learning Researchcited by 100
  10. 2018The Geometry of Culture: Analyzing Meaning through Word Embeddingscited by 87
  11. 2023The Future of Fundamental Science Led by Generative Closed-Loop Artificial Intelligencecited by 12
  12. 2021Being Together in Place as a Catalyst for Scientific Advancecited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 2; 2026: 2.

6 papers.