The AI-Enabled Scientific Frontier
Not on the map. Why?
Abstract (arXiv)
As artificial intelligence's capabilities improve, it is increasingly viewed as a general scientific method. But how true are these claims? Does AI outperform all techniques, or only some, and how is this changing? To assess the claims, we assemble a corpus of 2,507 head-to-head comparisons between AI and other scientific analysis techniques across 27 scientific disciplines from papers published between 2000 and early 2025. We find a profound dichotomy. Relative to traditional statistics, AI often outperforms, but at a significantly higher computational cost. But there are also nearly a quarter of cases where AI is both more expensive and performs worse than traditional statistical techniques and this fraction has been stable for a decade. Relative to scientific computing, AI often underperforms, but at lower computational cost. This has begun to change: since 2020, AI's performance against scientific computing has notably strengthened and it now outperforms on more than half of comparisons. These patterns suggest that AI is therefore not a universal replacement for existing methods, but rather a valuable -- and improving -- part of a new AI-enabled scientific frontier.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 42 references that are in the map. First posted on arXiv 14 Sep 2026.
Builds on
13 of 42 references.
References · 13
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,375
- 2019Green AIcited by 627
- 2021Tabular Data: Deep Learning is Not All You Needcited by 535
- 2021The Intrinsic Dimension of Images and Its Impact on Learningcited by 315
- 2019Intrinsic dimension of data representations in deep neural networkscited by 282
- 2020Towards the Systematic Reporting of the Energy and Carbon Footprints of Machine Learningcited by 249
- 2023Neural Operators for Accelerating Scientific Simulations and Designcited by 221
- 2022Why do tree-based models still outperform deep learning on tabular data?cited by 199
- 2020The Computational Limits of Deep Learningcited by 193
- 2024The rising costs of training frontier AI modelscited by 95
- 2021Scientific Machine Learning Benchmarkscited by 60
- 2016Deep Neural Networks to Enable Real-time Multimessenger Astrophysicscited by 24
1 more
- 2022The Importance of (Exponentially More) Computing Powercited by 4
Built on by
Not cited yet.