Who is leading in AI? An analysis of industry AI research
Not on the map. Why?
Abstract (arXiv)
AI research is increasingly industry-driven, making it crucial to understand company contributions to this field. We compare leading AI companies by research publications, citations, size of training runs, and contributions to algorithmic innovations. Our analysis reveals the substantial role played by Google, OpenAI and Meta. We find that these three companies have been responsible for some of the largest training runs, developed a large fraction of the algorithmic innovations that underpin large language models, and led in various metrics of citation impact. In contrast, leading Chinese companies such as Tencent and Baidu had a lower impact on many of these metrics compared to US counterparts. We observe many industry labs are pursuing large training runs, and that training runs from relative newcomers -- such as OpenAI and Anthropic -- have matched or surpassed those of long-standing incumbents such as Google. The data reveals a diverse ecosystem of companies steering AI progress, though US labs such as Google, OpenAI and Meta lead across critical metrics.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 26 of its 41 references that are in the map. First posted on arXiv 24 Nov 2023.
Builds on
26 of 41 references.
References · 26
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2016Layer Normalizationcited by 5,669
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2016Identity Mappings in Deep Residual Networkscited by 1,965
- 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,868
- 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,850
14 more
- 2020GLU Variants Improve Transformercited by 1,804
- 2019Generating Long Sequences with Sparse Transformerscited by 1,546
- 2022Competition-Level Code Generation with AlphaCodecited by 1,462
- 2020On Layer Normalization in the Transformer Architecturecited by 922
- 2018Adafactor: Adaptive Learning Rates with Sublinear Memory Costcited by 905
- 2019Fast Transformer Decoding: One Write-Head is All You Needcited by 717
- 2022Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Modelcited by 559
- 2017Convolutional Sequence to Sequence Learningcited by 552
- 2018Generating Wikipedia by Summarizing Long Sequencescited by 335
- 2017Don't Decay the Learning Rate, Increase the Batch Sizecited by 320
- 2018Adaptive Input Representations for Neural Language Modelingcited by 226
- 2020The De-democratization of AI: Deep Learning and the Compute Divide in Artificial Intelligence Researchcited by 67
- 2021ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 46
- 2021Yuan 1.0: Large-Scale Pre-trained Language Model in Zero-Shot and Few-Shot Learningcited by 35
Built on by
Citing papers per year: 2024: 2; 2025: 2.
4 papers.
- 2024Trust AI Regulation? Discerning users are vital to build trust and effective AI regulationcited by 9
- 2025Real-World Gaps in AI Governance Researchcited by 5
- 2025The Role of Computing Resources in Publishing Foundation Model Researchcited by 2
- 2024Quantifying detection rates for dangerous capabilities: a theoretical model of dangerous capability evaluationscited by 1
- 2025The Role of Computing Resources in Publishing Foundation Model Research15 Oct 2025
- 2025Real-World Gaps in AI Governance Research30 Apr 2025
- 2024Quantifying detection rates for dangerous capabilities: a theoretical model of dangerous capability evaluations19 Dec 2024
- 2024Trust AI Regulation? Discerning users are vital to build trust and effective AI regulation14 Mar 2024