Learning Symbolic Physics with Graph Networks
Not on the map. Why?
Abstract (arXiv)
We introduce an approach for imposing physically motivated inductive biases on graph networks to learn interpretable representations and improved zero-shot generalization. Our experiments show that our graph network models, which implement this inductive bias, can learn message representations equivalent to the true force vector when trained on n-body gravitational and spring-like simulations. We use symbolic regression to fit explicit algebraic equations to our trained model's message function and recover the symbolic form of Newton's law of gravitation without prior knowledge. We also show that our model generalizes better at inference time to systems with more bodies than had been experienced during training. Our approach is extensible, in principle, to any unknown interaction law learned by a graph network, and offers a valuable technique for interpreting and inferring explicit causal theories about the world from implicit knowledge captured by deep learning.
Key facts. Cited by 52 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 9; 2023: 8; 2024: 8; 2025: 9; 2026: 1.
52 papers.
Sort:
By area:
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
- 2021Graph Neural Networks with Learnable Structural and Positional Representationscited by 326
- 2022A Generalization of ViT/MLP-Mixer to Graphscited by 93
- 2021Beltrami Flow and Neural Diffusion on Graphscited by 84
- 2022Rediscovering orbital mechanics with machine learningcited by 71
- 2021Entropy-based Logic Explanations of Neural Networkscited by 51
- 2021Logic Explained Networkscited by 45
- 2023Interpretable Machine Learning for Science with PySR and SymbolicRegression.jlcited by 36
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontierscited by 34
- 2023The transformative potential of machine learning for experiments in fluid mechanicscited by 26
- 2021An Approach to Symbolic Regression Using Feyncited by 20
- 2023Machine Learning for Partial Differential Equationscited by 20
38 more
- 2021Known Operator Learning and Hybrid Machine Learning in Medical Imaging -- A Review of the Past, the Present, and the Futurecited by 18
- 2021A Bayesian neural network predicts the dissolution of compact planetary systemscited by 15
- 2024Symmetry-Informed Governing Equation Discoverycited by 14
- 2021Applying Machine Learning to Study Fluid Mechanicscited by 13
- 2021Symbolic regression outperforms other models for small data setscited by 12
- 2021Maximum Entropy Weighted Independent Set Pooling for Graph Neural Networkscited by 12
- 2022SYMBA: Symbolic Computation of Squared Amplitudes in High Energy Physics with Machine Learningcited by 12
- 2025Interpretable Machine Learning in Physics: A Reviewcited by 11
- 2021Identifying Physical Law of Hamiltonian Systems via Meta-Learningcited by 8
- 2022Simulating Liquids with Graph Networkscited by 8
- 2022Is the Machine Smarter than the Theorist: Deriving Formulas for Particle Kinematics with Symbolic Regressioncited by 8
- 2021Unsupervised Resource Allocation with Graph Neural Networkscited by 7
- 2023Categorical Foundations of Explainable AI: A Unifying Theorycited by 7
- 2022Augmenting astrophysical scaling relations with machine learning: application to reducing the Sunyaev-Zeldovich flux-mass scattercited by 6
- 2022Learning Mechanically Driven Emergent Behavior with Message Passing Neural Networkscited by 6
- 2025Discovering Symbolic Differential Equations with Symmetry Invariantscited by 6
- 2025When is a System Discoverable from Data? Discovery Requires Chaoscited by 6
- 2021Deep Learning of Conjugate Mappingscited by 5
- 2023Oracle-Preserving Latent Flowscited by 5
- 2024Symbolic Regression for Beyond the Standard Model Physicscited by 5
- 2022textttMangrove: Learning Galaxy Properties from Merger Treescited by 4
- 2024Exploring the Truth and Beauty of Theory Landscapes with Machine Learningcited by 4
- 2025Governing Equation Discovery from Data Based on Differential Invariantscited by 4
- 2021Interpretable Embedding Procedure Knowledge Transfer via Stacked Principal Component Analysis and Graph Neural Networkcited by 3
- 2024Graph External Attention Enhanced Transformercited by 3
- 2023Seeking Truth and Beauty in Flavor Physics with Machine Learningcited by 2
- 2021Graph convolutional network for predicting abnormal grain growth in Monte Carlo simulations of microstructural evolutioncited by 1
- 2022AI Research Associate for Early-Stage Scientific Discoverycited by 1
- 2023Interpretable Neural PDE Solvers using Symbolic Frameworkscited by 1
- 2023Deep learning complete intersection Calabi-Yau manifoldscited by 1
- 2024Multi-Hierarchical Surrogate Learning for Structural Dynamical Crash Simulations Using Graph Convolutional Neural Networkscited by 1
- 2024Data-driven Modeling in Metrology -- A Short Introduction, Current Developments and Future Perspectivescited by 1
- 2024Decomposing heterogeneous dynamical systems with graph neural networkscited by 1
- 2024Explaining Hypergraph Neural Networks: From Local Explanations to Global Conceptscited by 1
- 2025Positional Encoding meets Persistent Homology on Graphscited by 1
- 2025From Embeddings to Equations: Genetic-Programming Surrogates for Interpretable Transformer Classificationcited by 1
- 2025Symbolic Regression and Differentiable Fits in Beyond the Standard Model Physicscited by 1
- 2021Improving Simulations with Symmetry Control Neural Networkscited by 0
50 most cited of 52 All 52 (JSON)
- 2026Symbolic Classification-Enabled LHC Limits for BSM Global Fits21 May 2026
- 2025When is a System Discoverable from Data? Discovery Requires Chaos12 Nov 2025
- 2025Symbolic Regression and Differentiable Fits in Beyond the Standard Model Physics23 Oct 2025
- 2025From Embeddings to Equations: Genetic-Programming Surrogates for Interpretable Transformer Classification16 Sep 2025
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontiers28 Aug 2025
- 2025Positional Encoding meets Persistent Homology on Graphs6 Jun 2025
- 2025Governing Equation Discovery from Data Based on Differential Invariants24 May 2025
- 2025Discovering Symbolic Differential Equations with Symmetry Invariants17 May 2025
- 2025Interpretable Machine Learning in Physics: A Review30 Mar 2025
- 2025Machine learning identifies nullclines in oscillatory dynamical systems20 Mar 2025
- 2024Explaining Hypergraph Neural Networks: From Local Explanations to Global Concepts10 Oct 2024
- 2024Decomposing heterogeneous dynamical systems with graph neural networks27 Jul 2024
38 more
- 2024Data-driven Modeling in Metrology -- A Short Introduction, Current Developments and Future Perspectives24 Jun 2024
- 2024Graph External Attention Enhanced Transformer31 May 2024
- 2024Symbolic Regression for Beyond the Standard Model Physics28 May 2024
- 2024Symmetry-Informed Governing Equation Discovery27 May 2024
- 2024Multi-Hierarchical Surrogate Learning for Structural Dynamical Crash Simulations Using Graph Convolutional Neural Networks14 Feb 2024
- 2024Exploring the Truth and Beauty of Theory Landscapes with Machine Learning21 Jan 2024
- 2023Deep learning complete intersection Calabi-Yau manifolds20 Nov 2023
- 2023Seeking Truth and Beauty in Flavor Physics with Machine Learning31 Oct 2023
- 2023Interpretable Neural PDE Solvers using Symbolic Frameworks31 Oct 2023
- 2023Interpretable Machine Learning for Science with PySR and SymbolicRegression.jl2 May 2023
- 2023Categorical Foundations of Explainable AI: A Unifying Theory27 Apr 2023
- 2023Machine Learning for Partial Differential Equations30 Mar 2023
- 2023The transformative potential of machine learning for experiments in fluid mechanics28 Mar 2023
- 2023Oracle-Preserving Latent Flows2 Feb 2023
- 2022A Generalization of ViT/MLP-Mixer to Graphs27 Dec 2022
- 2022Is the Machine Smarter than the Theorist: Deriving Formulas for Particle Kinematics with Symbolic Regression15 Nov 2022
- 2022textttMangrove: Learning Galaxy Properties from Merger Trees24 Oct 2022
- 2022SYMBA: Symbolic Computation of Squared Amplitudes in High Energy Physics with Machine Learning17 Jun 2022
- 2022Simulating Liquids with Graph Networks14 Mar 2022
- 2022Rediscovering orbital mechanics with machine learning4 Feb 2022
- 2022Learning Mechanically Driven Emergent Behavior with Message Passing Neural Networks3 Feb 2022
- 2022AI Research Associate for Early-Stage Scientific Discovery2 Feb 2022
- 2022Augmenting astrophysical scaling relations with machine learning: application to reducing the Sunyaev-Zeldovich flux-mass scatter4 Jan 2022
- 2021Beltrami Flow and Neural Diffusion on Graphs18 Oct 2021
- 2021Graph convolutional network for predicting abnormal grain growth in Monte Carlo simulations of microstructural evolution18 Oct 2021
- 2021Graph Neural Networks with Learnable Structural and Positional Representations15 Oct 2021
- 2021Applying Machine Learning to Study Fluid Mechanics5 Oct 2021
- 2021Logic Explained Networks11 Aug 2021
- 2021Known Operator Learning and Hybrid Machine Learning in Medical Imaging -- A Review of the Past, the Present, and the Future10 Aug 2021
- 2021Maximum Entropy Weighted Independent Set Pooling for Graph Neural Networks3 Jul 2021
- 2021Unsupervised Resource Allocation with Graph Neural Networks17 Jun 2021
- 2021Entropy-based Logic Explanations of Neural Networks12 Jun 2021
- 2021Improving Simulations with Symmetry Control Neural Networks29 Apr 2021
- 2021Interpretable Embedding Procedure Knowledge Transfer via Stacked Principal Component Analysis and Graph Neural Network28 Apr 2021
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges27 Apr 2021
- 2021An Approach to Symbolic Regression Using Feyn12 Apr 2021
- 2021Deep Learning of Conjugate Mappings1 Apr 2021
- 2021Symbolic regression outperforms other models for small data sets28 Mar 2021
50 newest of 52 All 52 (JSON)
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
- 2021Graph Neural Networks with Learnable Structural and Positional Representationscited by 326
- 2022A Generalization of ViT/MLP-Mixer to Graphscited by 93
- 2021Beltrami Flow and Neural Diffusion on Graphscited by 84
- 2022Rediscovering orbital mechanics with machine learningcited by 71
- 2021Entropy-based Logic Explanations of Neural Networkscited by 51
- 2021Logic Explained Networkscited by 45
- 2023Interpretable Machine Learning for Science with PySR and SymbolicRegression.jlcited by 36
- 2023The transformative potential of machine learning for experiments in fluid mechanicscited by 26
- 2021An Approach to Symbolic Regression Using Feyncited by 20
- 2023Machine Learning for Partial Differential Equationscited by 20
- 2021Known Operator Learning and Hybrid Machine Learning in Medical Imaging -- A Review of the Past, the Present, and the Futurecited by 18
12 most cited of 51 All 51 (JSON)
- 2026Symbolic Classification-Enabled LHC Limits for BSM Global Fits21 May 2026
- 2025When is a System Discoverable from Data? Discovery Requires Chaos12 Nov 2025
- 2025Symbolic Regression and Differentiable Fits in Beyond the Standard Model Physics23 Oct 2025
- 2025From Embeddings to Equations: Genetic-Programming Surrogates for Interpretable Transformer Classification16 Sep 2025
- 2025Positional Encoding meets Persistent Homology on Graphs6 Jun 2025
- 2025Governing Equation Discovery from Data Based on Differential Invariants24 May 2025
- 2025Discovering Symbolic Differential Equations with Symmetry Invariants17 May 2025
- 2025Interpretable Machine Learning in Physics: A Review30 Mar 2025
- 2025Machine learning identifies nullclines in oscillatory dynamical systems20 Mar 2025
- 2024Explaining Hypergraph Neural Networks: From Local Explanations to Global Concepts10 Oct 2024
- 2024Decomposing heterogeneous dynamical systems with graph neural networks27 Jul 2024
- 2024Data-driven Modeling in Metrology -- A Short Introduction, Current Developments and Future Perspectives24 Jun 2024
12 newest of 51 All 51 (JSON)