The Paradigm Shifts in Artificial Intelligence
Not on the map. Why?
Abstract (arXiv)
Kuhn's framework of scientific progress (Kuhn, 1962) provides a useful framing of the paradigm shifts that have occurred in Artificial Intelligence over the last 60 years. The framework is also useful in understanding what is arguably a new paradigm shift in AI, signaled by the emergence of large pre-trained systems such as GPT-3, on which conversational agents such as ChatGPT are based. Such systems make intelligence a commoditized general purpose technology that is configurable to applications. In this paper, I summarize the forces that led to the rise and fall of each paradigm, and discuss the pressing issues and risks associated with the current paradigm shift in AI.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 8 of its 73 references that are in the map. First posted on arXiv 2 Aug 2023.
Builds on
8 of 73 references.
References · 8
- 2017Attention Is All You Needcited by 60,361
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Measuring Progress on Scalable Oversight for Large Language Modelscited by 225
- 2017Multi-task Self-Supervised Visual Learningcited by 200
- 2022Talking About Large Language Modelscited by 175
- 2015Ask Me Anything: Dynamic Memory Networks for Natural Language Processingcited by 117
Built on by
Citing papers per year: 2025: 1.
1 paper.