Rigor with Machine Learning from Field Theory to the Poincar'e Conjecture
Not on the map. Why?
Abstract (arXiv)
Machine learning techniques are increasingly powerful, leading to many breakthroughs in the natural sciences, but they are often stochastic, error-prone, and blackbox. How, then, should they be utilized in fields such as theoretical physics and pure mathematics that place a premium on rigor and understanding? In this Perspective we discuss techniques for obtaining rigor in the natural sciences with machine learning. Non-rigorous methods may lead to rigorous results via conjecture generation or verification by reinforcement learning. We survey applications of these techniques-for-rigor ranging from string theory to the smooth 4d Poincar'e conjecture in low-dimensional topology. One can also imagine building direct bridges between machine learning theory and either mathematics or theoretical physics. As examples, we describe a new approach to field theory motivated by neural network theory, and a theory of Riemannian metric flows induced by neural network gradient descent, which encompasses Perelman's formulation of the Ricci flow that was utilized to resolve the 3d Poincar'e conjecture.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 36 of its 85 references that are in the map. First posted on arXiv 20 Feb 2024.
Builds on
36 of 85 references.
References · 36
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,597
- 2018Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examplescited by 1,259
- 2019Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descentcited by 732
- 2017Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithmcited by 723
- 2020Discovering Symbolic Models from Deep Learning with Inductive Biasescited by 335
- 2022Autoformalization with Large Language Modelscited by 252
- 2022HyperTree Proof Search for Neural Theorem Provingcited by 192
- 2021The Principles of Deep Learning Theorycited by 169
- 2019Tensor Programs I: Wide Feedforward or Recurrent Neural Networks of Any Architecture are Gaussian Processescited by 148
- 2020Tensor Programs II: Neural Tangent Kernel for Any Architecturecited by 139
- 2020Neural Networks and Quantum Field Theorycited by 58
24 more
- 2018TacticToe: Learning to Prove with Tacticscited by 43
- 2020Learning to Unknotcited by 40
- 2020Neural Network Approximations for Calabi-Yau Metricscited by 32
- 2021Symmetry-via-Duality: Invariant Neural Network Densities from Parameter-Space Correlatorscited by 28
- 2021Learning Size and Shape of Calabi-Yau Spacescited by 28
- 2021Building Quantum Field Theories Out of Neuronscited by 27
- 2021Nonperturbative renormalization for the neural network-QFT correspondencecited by 24
- 2021The edge of chaos: quantum field theory and deep neural networkscited by 23
- 2017Deep-Learning the Landscapecited by 21
- 2023Neural Network Field Theories: Non-Gaussianity, Actions, and Localitycited by 21
- 2023Structures of Neural Network Effective Theoriescited by 13
- 2023Bayesian Renormalizationcited by 13
- 2020Disentangling a Deep Learned Volume Formulacited by 12
- 2021Learning knot invariants across dimensionscited by 12
- 2022The Inverse of Exact Renormalization Group Flows as Statistical Inferencecited by 11
- 2023Searching for ribbons with machine learningcited by 11
- 2021Heterotic String Model Building with Monad Bundles and Reinforcement Learningcited by 10
- 2022A duality connecting neural network and cosmological dynamicscited by 10
- 2023Machine-Learned Premise Selection for Leancited by 10
- 2023Metric Flows with Neural Networkscited by 9
- 2023Mathematical conjecture generation using machine intelligencecited by 8
- 2023Graph Neural Networks and 3-Dimensional Topologycited by 4
- 2020Simple Dataset for Proof Method Recommendation in Isabelle/HOL (Dataset Description)cited by 3
- 2014Developments in Formal Proofscited by 2
Built on by
Citing papers per year: 2024: 7; 2025: 5.
12 papers.
- 2024KAN: Kolmogorov-Arnold Networkscited by 634
- 2024Data for Mathematical Copilots: Better Ways of Presenting Proofs for Machine Learningcited by 11
- 2024A Triumvirate of AI Driven Theoretical Discoverycited by 5
- 2024Deep Learning as Ricci Flowcited by 4
- 2024TASI Lectures on Physics for Machine Learningcited by 4
- 2024Learning BPS Spectra and the Gap Conjecturecited by 3
- 2025On knot detection via picture recognitioncited by 2
- 2024Learning 3-Manifold Triangulationscited by 1
- 2025On the Learnability of Knot Invariants: Representation, Predictability, and Neural Similaritycited by 0
- 2025Colored Jones Polynomials and the Volume Conjecturecited by 0
- 2025Deep Learning based discovery of Integrable Systemscited by 0
- 2025Computations and ML for surjective rational mapscited by 0
- 2025Computations and ML for surjective rational maps9 Oct 2025
- 2025On knot detection via picture recognition6 Oct 2025
- 2025Deep Learning based discovery of Integrable Systems13 Mar 2025
- 2025Colored Jones Polynomials and the Volume Conjecture25 Feb 2025
- 2025On the Learnability of Knot Invariants: Representation, Predictability, and Neural Similarity17 Feb 2025
- 2024Data for Mathematical Copilots: Better Ways of Presenting Proofs for Machine Learning19 Dec 2024
- 2024TASI Lectures on Physics for Machine Learning31 Jul 2024
- 2024A Triumvirate of AI Driven Theoretical Discovery30 May 2024
- 2024Learning BPS Spectra and the Gap Conjecture16 May 2024
- 2024Learning 3-Manifold Triangulations15 May 2024
- 2024KAN: Kolmogorov-Arnold Networks30 Apr 2024
- 2024Deep Learning as Ricci Flow22 Apr 2024