A Neural Symbolic Model for Space Physics
Not on the map. Why?
Abstract (arXiv)
In this study, we unveil a new AI model, termed PhyE2E, to discover physical formulas through symbolic regression. PhyE2E simplifies symbolic regression by decomposing it into sub-problems using the second-order derivatives of an oracle neural network, and employs a transformer model to translate data into symbolic formulas in an end-to-end manner. The resulting formulas are refined through Monte-Carlo Tree Search and Genetic Programming. We leverage a large language model to synthesize extensive symbolic expressions resembling real physics, and train the model to recover these formulas directly from data. A comprehensive evaluation reveals that PhyE2E outperforms existing state-of-the-art approaches, delivering superior symbolic accuracy, precision in data fitting, and consistency in physical units. We deployed PhyE2E to five applications in space physics, including the prediction of sunspot numbers, solar rotational angular velocity, emission line contribution functions, near-Earth plasma pressure, and lunar-tide plasma signals. The physical formulas generated by AI demonstrate a high degree of accuracy in fitting the experimental data from satellites and astronomical telescopes. We have successfully upgraded the formula proposed by NASA in 1993 regarding solar activity, and for the first time, provided the explanations for the long cycle of solar activity in an explicit form. We also found that the decay of near-Earth plasma pressure is proportional to r^2 to Earth, where subsequent mathematical derivations are consistent with satellite data from another independent study. Moreover, we found physical formulas that can describe the relationships between emission lines in the extreme ultraviolet spectrum of the Sun, temperatures, electron densities, and magnetic fields. The formula obtained is consistent with the properties that physicists had previously hypothesized it should possess.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 26 of its 73 references that are in the map. First posted on arXiv 11 Mar 2025.
Builds on
26 of 73 references.
References · 26
- 2017Attention Is All You Needcited by 60,361
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 548
- 2019Deep Learning for Symbolic Mathematicscited by 270
- 2021Contemporary Symbolic Regression Methods and their Relative Performancecited by 215
- 2022End-to-end symbolic regression with transformerscited by 203
- 2021Neural Symbolic Regression that Scalescited by 192
- 2020AI Feynman 2.0: Pareto-optimal symbolic regression exploiting graph modularitycited by 144
- 2024KAN 2.0: Kolmogorov-Arnold Networks Meet Sciencecited by 118
- 2021SymbolicGPT: A Generative Transformer Model for Symbolic Regressioncited by 105
- 2024Symbolic Regression with a Learned Concept Librarycited by 83
- 2023Transformer-based Planning for Symbolic Regressioncited by 79
14 more
- 2019Bayesian Symbolic Regressioncited by 78
- 2022Symbolic Physics Learner: Discovering governing equations via Monte Carlo tree searchcited by 66
- 2021Linear algebra with transformerscited by 63
- 2023Deep symbolic regression for physics guided by units constraints: toward the automated discovery of physical lawscited by 55
- 2023Deep Generative Symbolic Regression with Monte-Carlo-Tree-Searchcited by 41
- 2018Learning concise representations for regression by evolving networks of treescited by 33
- 2023AI-Aristotle: A Physics-Informed framework for Systems Biology Gray-Box Identificationcited by 29
- 2023Controllable Neural Symbolic Regressioncited by 20
- 2023ParFam -- (Neural Guided) Symbolic Regression Based on Continuous Global Optimizationcited by 10
- 2023AI-Lorenz: A physics-data-driven framework for black-box and gray-box identification of chaotic systems with symbolic regressioncited by 9
- 2023RSRM: Reinforcement Symbolic Regression Machinecited by 8
- 2024Deep Optimizer States: Towards Scalable Training of Transformer Models Using Interleaved Offloadingcited by 7
- 2024Bootstrapping OTS-Funcimg Pre-training Model (Botfip) -- A Comprehensive Symbolic Regression Frameworkcited by 2
- 2024An Efficient and Generalizable Symbolic Regression Method for Time Series Analysiscited by 2
Built on by
Citing papers per year: 2025: 4; 2026: 7.
11 papers.
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontierscited by 37
- 2025The Need for Verification in AI-Driven Scientific Discoverycited by 7
- 2026Data-driven discovery of governing differential equations across physical systemscited by 3
- 2025Beyond Accuracy and Complexity: The Effective Information Criterion for Structurally Stable Symbolic Regressioncited by 1
- 2025The Machine Learning Approach to Moment Closure Relations for Plasma: A Reviewcited by 1
- 2026Prior-Guided Symbolic Regression: Towards Scientific Consistency in Equation Discoverycited by 1
- 2026Discover Fast Power Allocation Solution for Multi-Target Tracking via AlphaEvolve Evolutioncited by 0
- 2026Evidence-Grounded Frontier Mapping and Agentic Hypothesis Generation in Nanomedicinecited by 0
- 2026Decision-Making under Combinatorial Riskcited by 0
- 2026Not Every Term Adds New Structure: Sobolev Novelty for Symbolic Regressioncited by 0
- 2026Synthesizing Physics Formulae with Transformerscited by 0
- 2026Synthesizing Physics Formulae with Transformers2 Oct 2026
- 2026Not Every Term Adds New Structure: Sobolev Novelty for Symbolic Regression26 Sep 2026
- 2026Decision-Making under Combinatorial Risk8 Jun 2026
- 2026Data-driven discovery of governing differential equations across physical systems8 Jun 2026
- 2026Evidence-Grounded Frontier Mapping and Agentic Hypothesis Generation in Nanomedicine18 May 2026
- 2026Discover Fast Power Allocation Solution for Multi-Target Tracking via AlphaEvolve Evolution3 May 2026
- 2026Prior-Guided Symbolic Regression: Towards Scientific Consistency in Equation Discovery13 Feb 2026
- 2025The Machine Learning Approach to Moment Closure Relations for Plasma: A Review27 Nov 2025
- 2025Beyond Accuracy and Complexity: The Effective Information Criterion for Structurally Stable Symbolic Regression26 Sep 2025
- 2025The Need for Verification in AI-Driven Scientific Discovery1 Sep 2025
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontiers28 Aug 2025