The Elephant in the Room: Analyzing the Presence of Big Tech in Natural Language Processing Research
Not on the map. Why?
Abstract (arXiv)
Recent advances in deep learning methods for natural language processing (NLP) have created new business opportunities and made NLP research critical for industry development. As one of the big players in the field of NLP, together with governments and universities, it is important to track the influence of industry on research. In this study, we seek to quantify and characterize industry presence in the NLP community over time. Using a corpus with comprehensive metadata of 78,187 NLP publications and 701 resumes of NLP publication authors, we explore the industry presence in the field since the early 90s. We find that industry presence among NLP authors has been steady before a steep increase over the past five years (180% growth from 2017 to 2022). A few companies account for most of the publications and provide funding to academic researchers through grants and internships. Our study shows that the presence and impact of the industry on natural language processing research are significant and fast-growing. This work calls for increased transparency of industry influence in the field.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 10 of its 57 references that are in the map. First posted on arXiv 4 May 2023.
Builds on
10 of 57 references.
References · 10
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020The De-democratization of AI: Deep Learning and the Compute Divide in Artificial Intelligence Researchcited by 67
- 2020The Grey Hoodie Project: Big Tobacco, Big Tech, and the threat on academic integritycited by 38
- 2020Examining Citations of Natural Language Processing Literaturecited by 20
- 2020Gender Gap in Natural Language Processing Research: Disparities in Authorship and Citationscited by 17
- 2022D3: A Massive Dataset of Scholarly Metadata for Analyzing the State of Computer Science Researchcited by 11
- 2015A Review of Theory and Practice in Scientometricscited by 6
- 2021DRIFT: A Toolkit for Diachronic Analysis of Scientific Literaturecited by 4
- 2022CS-Insights: A System for Analyzing Computer Science Researchcited by 2
Built on by
Citing papers per year: 2023: 7; 2024: 8; 2025: 4; 2026: 8.
27 papers.
Sort:
- 2023Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Modelscited by 186
- 2023Position: Key Claims in LLM Research Have a Long Tail of Footnotescited by 20
- 2023We are Who We Cite: Bridges of Influence Between Natural Language Processing and Other Academic Fieldscited by 20
- 2024Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challengescited by 18
- 2024Agreement-Based Cascading for Efficient Inferencecited by 16
- 2023Forgotten Knowledge: Examining the Citational Amnesia in NLPcited by 13
- 2023Regulation and NLP (RegNLP): Taming Large Language Modelscited by 5
- 2024Citation Amnesia: On The Recency Bias of NLP and Other Academic Fieldscited by 5
- 2023To Build Our Future, We Must Know Our Past: Contextualizing Paradigm Shifts in Natural Language Processingcited by 4
- 2024The complementary contributions of academia and industry to AI researchcited by 4
- 2024On Tables with Numbers, with Numberscited by 4
- 2024Building Better: Avoiding Pitfalls in Developing Language Resources when Data is Scarcecited by 4
15 more
- 2025Misalignment or misuse? The AGI alignment tradeoffcited by 4
- 2023Collaboration or Corporate Capture? Quantifying NLP's Reliance on Industry Artifacts and Contributionscited by 2
- 2024What We Talk About When We Talk About LMs: Implicit Paradigm Shifts and the Ship of Language Modelscited by 2
- 2025What Do Indonesians Really Need from Language Technology? A Nationwide Surveycited by 2
- 2026Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Reviewcited by 2
- 2026Quantifying the Knowledge Proximity Between Academic and Industry Research: An Entity and Semantic Perspectivecited by 1
- 2026ClaimFlow: Tracing the Evolution of Scientific Claims in NLPcited by 1
- 2024Data Processing for the OpenGPT-X Model Familycited by 0
- 2025Big Tech-Funded AI Papers Have Higher Citation Impact, Greater Insularity, and Larger Recency Biascited by 0
- 2025Big AI is accelerating the metacrisis: What can we do?cited by 0
- 2026Structural shifts in institutional participation and collaboration within the AI arXiv preprint research ecosystemcited by 0
- 2026Tracing the Evolution of Word Embedding Techniques in Natural Language Processingcited by 0
- 2026LLMs in the Real World: Evaluating "AI" in Emergency Contextscited by 0
- 2026The Future of NLP may not be at NLP Conferences: Scholarly Migration Patterns in Natural Language Processingcited by 0
- 2026Beyond Good Intentions: When Does the Framing of Multilingual and Low-Resource NLP Research Become a Caricature?cited by 0
- 2026Beyond Good Intentions: When Does the Framing of Multilingual and Low-Resource NLP Research Become a Caricature?31 Aug 2026
- 2026The Future of NLP may not be at NLP Conferences: Scholarly Migration Patterns in Natural Language Processing2 Jul 2026
- 2026LLMs in the Real World: Evaluating "AI" in Emergency Contexts29 May 2026
- 2026Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review30 Apr 2026
- 2026ClaimFlow: Tracing the Evolution of Scientific Claims in NLP17 Mar 2026
- 2026Tracing the Evolution of Word Embedding Techniques in Natural Language Processing27 Feb 2026
- 2026Quantifying the Knowledge Proximity Between Academic and Industry Research: An Entity and Semantic Perspective5 Feb 2026
- 2026Structural shifts in institutional participation and collaboration within the AI arXiv preprint research ecosystem3 Feb 2026
- 2025Big AI is accelerating the metacrisis: What can we do?31 Dec 2025
- 2025Big Tech-Funded AI Papers Have Higher Citation Impact, Greater Insularity, and Larger Recency Bias5 Dec 2025
- 2025What Do Indonesians Really Need from Language Technology? A Nationwide Survey9 Jun 2025
- 2025Misalignment or misuse? The AGI alignment tradeoff4 Jun 2025
15 more
- 2024Building Better: Avoiding Pitfalls in Developing Language Resources when Data is Scarce16 Oct 2024
- 2024Data Processing for the OpenGPT-X Model Family11 Oct 2024
- 2024On Tables with Numbers, with Numbers12 Aug 2024
- 2024Agreement-Based Cascading for Efficient Inference2 Jul 2024
- 2024What We Talk About When We Talk About LMs: Implicit Paradigm Shifts and the Ship of Language Models2 Jul 2024
- 2024Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challenges24 May 2024
- 2024Citation Amnesia: On The Recency Bias of NLP and Other Academic Fields19 Feb 2024
- 2024The complementary contributions of academia and industry to AI research4 Jan 2024
- 2023Collaboration or Corporate Capture? Quantifying NLP's Reliance on Industry Artifacts and Contributions6 Dec 2023
- 2023We are Who We Cite: Bridges of Influence Between Natural Language Processing and Other Academic Fields23 Oct 2023
- 2023To Build Our Future, We Must Know Our Past: Contextualizing Paradigm Shifts in Natural Language Processing11 Oct 2023
- 2023Regulation and NLP (RegNLP): Taming Large Language Models9 Oct 2023
- 2023Position: Key Claims in LLM Research Have a Long Tail of Footnotes14 Aug 2023
- 2023Forgotten Knowledge: Examining the Citational Amnesia in NLP29 May 2023
- 2023Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Models23 May 2023
- 2023Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Modelscited by 186
- 2023Position: Key Claims in LLM Research Have a Long Tail of Footnotescited by 20
- 2023We are Who We Cite: Bridges of Influence Between Natural Language Processing and Other Academic Fieldscited by 20
- 2024Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challengescited by 18
- 2024Agreement-Based Cascading for Efficient Inferencecited by 16
- 2023Forgotten Knowledge: Examining the Citational Amnesia in NLPcited by 13
- 2023Regulation and NLP (RegNLP): Taming Large Language Modelscited by 5
- 2024Citation Amnesia: On The Recency Bias of NLP and Other Academic Fieldscited by 5
- 2023To Build Our Future, We Must Know Our Past: Contextualizing Paradigm Shifts in Natural Language Processingcited by 4
- 2024The complementary contributions of academia and industry to AI researchcited by 4
- 2024On Tables with Numbers, with Numberscited by 4
- 2024Building Better: Avoiding Pitfalls in Developing Language Resources when Data is Scarcecited by 4
12 most cited of 27 All 27 (JSON)
- 2026Beyond Good Intentions: When Does the Framing of Multilingual and Low-Resource NLP Research Become a Caricature?31 Aug 2026
- 2026The Future of NLP may not be at NLP Conferences: Scholarly Migration Patterns in Natural Language Processing2 Jul 2026
- 2026LLMs in the Real World: Evaluating "AI" in Emergency Contexts29 May 2026
- 2026Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review30 Apr 2026
- 2026ClaimFlow: Tracing the Evolution of Scientific Claims in NLP17 Mar 2026
- 2026Tracing the Evolution of Word Embedding Techniques in Natural Language Processing27 Feb 2026
- 2026Quantifying the Knowledge Proximity Between Academic and Industry Research: An Entity and Semantic Perspective5 Feb 2026
- 2026Structural shifts in institutional participation and collaboration within the AI arXiv preprint research ecosystem3 Feb 2026
- 2025Big AI is accelerating the metacrisis: What can we do?31 Dec 2025
- 2025Big Tech-Funded AI Papers Have Higher Citation Impact, Greater Insularity, and Larger Recency Bias5 Dec 2025
- 2025What Do Indonesians Really Need from Language Technology? A Nationwide Survey9 Jun 2025
- 2025Misalignment or misuse? The AGI alignment tradeoff4 Jun 2025
12 newest of 27 All 27 (JSON)