mlsanityData to 7 Oct 2026

No Intelligence Without Statistics: The Invisible Backbone of Artificial Intelligence

arXiv 2510.19212 ↗First posted 22 Oct 2025stat.ME cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The rapid ascent of artificial intelligence (AI) is often portrayed as a revolution born from computer science and engineering. This narrative, however, obscures a fundamental truth: the theoretical and methodological core of AI is, and has always been, statistical. This paper systematically argues that the field of statistics provides the indispensable foundation for machine learning and modern AI. We deconstruct AI into nine foundational pillars-Inference, Density Estimation, Sequential Learning, Generalization, Representation Learning, Interpretability, Causality, Optimization, and Unification-demonstrating that each is built upon century-old statistical principles. From the inferential frameworks of hypothesis testing and estimation that underpin model evaluation, to the density estimation roots of clustering and generative AI; from the time-series analysis inspiring recurrent networks to the causal models that promise true understanding, we trace an unbroken statistical lineage. While celebrating the computational engines that power modern AI, we contend that statistics provides the brain-the theoretical frameworks, uncertainty quantification, and inferential goals-while computer science provides the brawn-the scalable algorithms and hardware. Recognizing this statistical backbone is not merely an academic exercise, but a necessary step for developing more robust, interpretable, and trustworthy intelligent systems. We issue a call to action for education, research, and practice to re-embrace this statistical foundation. Ignoring these roots risks building a fragile future; embracing them is the path to truly intelligent machines. There is no machine learning without statistical learning; no artificial intelligence without statistical thought.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 90 references that are in the map. First posted on arXiv 22 Oct 2025.

Builds on

14 of 90 references.

References · 14

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  4. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  5. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  6. 2013Intriguing properties of neural networkscited by 5,114
  7. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  8. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  9. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  10. 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,597
  11. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
  12. 2017Meta-learners for Estimating Heterogeneous Treatment Effects using Machine Learningcited by 475
2 more
  1. 2017Stochastic Gradient Descent as Approximate Bayesian Inferencecited by 298
  2. 2017A Bayesian Perspective on Generalization and Stochastic Gradient Descentcited by 134

Built on by

Not cited yet.