Interpretable Machine Learning for Science with PySR and SymbolicRegression.jl
Not on the map. Why?
Abstract (arXiv)
PySR is an open-source library for practical symbolic regression, a type of machine learning which aims to discover human-interpretable symbolic models. PySR was developed to democratize and popularize symbolic regression for the sciences, and is built on a high-performance distributed back-end, a flexible search algorithm, and interfaces with several deep learning packages. PySR's internal search algorithm is a multi-population evolutionary algorithm, which consists of a unique evolve-simplify-optimize loop, designed for optimization of unknown scalar constants in newly-discovered empirical expressions. PySR's backend is the extremely optimized Julia library SymbolicRegression.jl, which can be used directly from Julia. It is capable of fusing user-defined operators into SIMD kernels at runtime, performing automatic differentiation, and distributing populations of expressions to thousands of cores across a cluster. In describing this software, we also introduce a new benchmark, "EmpiricalBench," to quantify the applicability of symbolic regression algorithms in science. This benchmark measures recovery of historical empirical equations from original and synthetic datasets.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). Builds on 34 of its 114 references that are in the map. First posted on arXiv 2 May 2023.
Builds on
34 of 114 references.
References · 34
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2018Regularized Evolution for Image Classifier Architecture Searchcited by 902
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
- 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 491
- 2020Universal Differential Equations for Scientific Machine Learningcited by 345
- 2020Discovering Symbolic Models from Deep Learning with Inductive Biasescited by 335
- 2019Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradientscited by 294
- 2021Contemporary Symbolic Regression Methods and their Relative Performancecited by 209
- 2022Why do tree-based models still outperform deep learning on tabular data?cited by 198
- 2022End-to-end symbolic regression with transformerscited by 195
- 2018Learning Equations for Extrapolation and Controlcited by 151
- 2020AI Feynman 2.0: Pareto-optimal symbolic regression exploiting graph modularitycited by 140
22 more
- 2020AutoML-Zero: Evolving Machine Learning Algorithms From Scratchcited by 137
- 2021PySINDy: A comprehensive Python package for robust sparse system identificationcited by 88
- 2019Bayesian Symbolic Regressioncited by 77
- 2020AI Poincar'e: Machine Learning Conservation Laws from Trajectoriescited by 77
- 2019DeepMoD: Deep learning for Model Discovery in noisy datacited by 70
- 2022Symbolic Regression is NP-hardcited by 68
- 2020A Bayesian machine scientist to aid in the solution of challenging scientific problemscited by 61
- 2022Deep Symbolic Regression for Recurrent Sequencescited by 53
- 2019Learning Symbolic Physics with Graph Networkscited by 52
- 2018Don't Unroll Adjoint: Differentiating SSA-Form Programscited by 44
- 2020Discovering Symmetry Invariants and Conserved Quantities by Interpreting Siamese Neural Networkscited by 33
- 2019Epsilon-Lexicase Selection for Regressioncited by 31
- 2021An Approach to Symbolic Regression Using Feyncited by 20
- 2022Evolving symbolic density functionalscited by 19
- 2021Analytical Modelling of Exoplanet Transit Specroscopy with Dimensional Analysis and Symbolic Regressioncited by 18
- 2018A Greedy Search Tree Heuristic for Symbolic Regressioncited by 17
- 2019Data-driven discovery of free-form governing differential equationscited by 16
- 2021AI Descartes: Combining Data and Theory for Derivable Scientific Discoverycited by 7
- 2021High-performance symbolic-numerics via multiple dispatchcited by 6
- 2023Interpretable Symbolic Regression for Data Science: Analysis of the 2022 Competitioncited by 6
- 2022Automated discovery of interpretable gravitational-wave population modelscited by 5
- 2022The SZ flux-mass (Y-M) relation at low halo masses: improvements with symbolic regression and strong constraints on baryonic feedbackcited by 5
Built on by
Citing papers per year: 2023: 6; 2024: 5; 2025: 13; 2026: 12.
36 papers.
Sort:
By area:
- 2025NewtonBench: Benchmarking Generalizable Scientific Law Discovery in LLM Agentscited by 32
- 2023AI-Aristotle: A Physics-Informed framework for Systems Biology Gray-Box Identificationcited by 29
- 2025NeuralFoil: An Airfoil Aerodynamics Analysis Tool Using Physics-Informed Machine Learningcited by 11
- 2023Learning Closed-form Equations for Subgrid-scale Closures from High-fidelity Data: Promises and Challengescited by 9
- 2023AI-Lorenz: A physics-data-driven framework for black-box and gray-box identification of chaotic systems with symbolic regressioncited by 9
- 2024In Context Learning and Reasoning for Symbolic Regression with Large Language Modelscited by 7
- 2023Adaptive Uncertainty-Guided Model Selection for Data-Driven PDE Discoverycited by 6
- 2026Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world modelscited by 6
- 2025Foundation Model Self-Play: Open-Ended Strategy Innovation via Foundation Modelscited by 5
- 2024Distilling Reinforcement Learning Policies for Interpretable Robot Locomotion: Gradient Boosting Machines and Symbolic Regressioncited by 4
- 2025T-SHRED: Symbolic Regression for Regularization and Model Discovery with Transformer Shallow Recurrent Decoderscited by 4
- 2024COST CA20120 INTERACT Framework of Artificial Intelligence Based Channel Modelingcited by 3
24 more
- 2025Kozax: Flexible and Scalable Genetic Programming in JAXcited by 3
- 2025Symbolic Regression with Multimodal Large Language Models and Kolmogorov Arnold Networkscited by 3
- 2023Discovering Interpretable Physical Models using Symbolic Regression and Discrete Exterior Calculuscited by 2
- 2024Hyperdimensional computing: a fast, robust and interpretable paradigm for biological datacited by 2
- 2024Discovering an interpretable mathematical expression for a full wind-turbine wake with artificial intelligence enhanced symbolic regressioncited by 2
- 2025Introduction to Symbolic Regression in the Physical Sciencescited by 2
- 2026An Empirical Investigation of Neural ODEs and Symbolic Regression for Dynamical Systemscited by 2
- 2023Discovering Symbolic Laws Directly from Trajectories with Hamiltonian Graph Neural Networkscited by 1
- 2025Combining Large Language Models and Gradient-Free Optimization for Automatic Control Policy Synthesiscited by 1
- 2025Symbolic Regression and Differentiable Fits in Beyond the Standard Model Physicscited by 1
- 2026DeepInflation: an AI agent for research and model discovery of inflationcited by 1
- 2026Architecture-Induced Recoverability Bias in Differentiable Symbolic Regressioncited by 1
- 2026Discovery of Interpretable Surrogates via Agentic AI: Application to Gravitational Wavescited by 1
- 2025Sparse Interpretable Deep Learning with LIES Networks for Symbolic Regressioncited by 0
- 2025Machine-Learning-Assisted Photonic Device Development: A Multiscale Approach from Theory to Characterizationcited by 0
- 2025SRLR: Symbolic Regression based Logic Recovery to Counter Programmable Logic Controller Attackscited by 0
- 2025From GNNs to Symbolic Surrogates via Kolmogorov-Arnold Networks for Delay Predictioncited by 0
- 2026Test-Time Scaling for Scientific Equation Discoverycited by 0
- 2026FluxDisco: Symbolic Regression for Stoichiometric Dynamical Systems via Monte Carlo Graph Searchcited by 0
- 2026Symbolic Density Estimators for Unnormalized Distributionscited by 0
- 2026Coefficient Calibration as Selection Pressure in Symbolic Regressioncited by 0
- 2026RISR: Residual-Informed Scientific Equation Discovery with Large Language Modelscited by 0
- 2026An Interpretable Approach to PDE Solution Discovery via Structural Experience Distillationcited by 0
- 2026Machine Learning Meets High-Energy Nuclear Physics: From Pattern Recognition to Physics-Integrated Discoverycited by 0
- 2026Machine Learning Meets High-Energy Nuclear Physics: From Pattern Recognition to Physics-Integrated Discovery8 Oct 2026
- 2026An Interpretable Approach to PDE Solution Discovery via Structural Experience Distillation8 Oct 2026
- 2026RISR: Residual-Informed Scientific Equation Discovery with Large Language Models8 Oct 2026
- 2026Coefficient Calibration as Selection Pressure in Symbolic Regression7 Oct 2026
- 2026Symbolic Density Estimators for Unnormalized Distributions7 Oct 2026
- 2026FluxDisco: Symbolic Regression for Stoichiometric Dynamical Systems via Monte Carlo Graph Search4 Sep 2026
- 2026Test-Time Scaling for Scientific Equation Discovery21 Aug 2026
- 2026Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models10 Aug 2026
- 2026Discovery of Interpretable Surrogates via Agentic AI: Application to Gravitational Waves11 May 2026
- 2026Architecture-Induced Recoverability Bias in Differentiable Symbolic Regression25 Apr 2026
- 2026An Empirical Investigation of Neural ODEs and Symbolic Regression for Dynamical Systems28 Jan 2026
- 2026DeepInflation: an AI agent for research and model discovery of inflation14 Jan 2026
24 more
- 2025From GNNs to Symbolic Surrogates via Kolmogorov-Arnold Networks for Delay Prediction24 Dec 2025
- 2025Introduction to Symbolic Regression in the Physical Sciences17 Dec 2025
- 2025SRLR: Symbolic Regression based Logic Recovery to Counter Programmable Logic Controller Attacks12 Dec 2025
- 2025Symbolic Regression and Differentiable Fits in Beyond the Standard Model Physics23 Oct 2025
- 2025NewtonBench: Benchmarking Generalizable Scientific Law Discovery in LLM Agents8 Oct 2025
- 2025Combining Large Language Models and Gradient-Free Optimization for Automatic Control Policy Synthesis1 Oct 2025
- 2025Foundation Model Self-Play: Open-Ended Strategy Innovation via Foundation Models9 Jul 2025
- 2025Machine-Learning-Assisted Photonic Device Development: A Multiscale Approach from Theory to Characterization24 Jun 2025
- 2025T-SHRED: Symbolic Regression for Regularization and Model Discovery with Transformer Shallow Recurrent Decoders18 Jun 2025
- 2025Sparse Interpretable Deep Learning with LIES Networks for Symbolic Regression9 Jun 2025
- 2025Symbolic Regression with Multimodal Large Language Models and Kolmogorov Arnold Networks12 May 2025
- 2025NeuralFoil: An Airfoil Aerodynamics Analysis Tool Using Physics-Informed Machine Learning20 Mar 2025
- 2025Kozax: Flexible and Scalable Genetic Programming in JAX5 Feb 2025
- 2024COST CA20120 INTERACT Framework of Artificial Intelligence Based Channel Modeling31 Oct 2024
- 2024In Context Learning and Reasoning for Symbolic Regression with Large Language Models22 Oct 2024
- 2024Discovering an interpretable mathematical expression for a full wind-turbine wake with artificial intelligence enhanced symbolic regression2 Jun 2024
- 2024Distilling Reinforcement Learning Policies for Interpretable Robot Locomotion: Gradient Boosting Machines and Symbolic Regression21 Mar 2024
- 2024Hyperdimensional computing: a fast, robust and interpretable paradigm for biological data27 Feb 2024
- 2023AI-Lorenz: A physics-data-driven framework for black-box and gray-box identification of chaotic systems with symbolic regression21 Dec 2023
- 2023Discovering Interpretable Physical Models using Symbolic Regression and Discrete Exterior Calculus10 Oct 2023
- 2023AI-Aristotle: A Physics-Informed framework for Systems Biology Gray-Box Identification29 Sep 2023
- 2023Adaptive Uncertainty-Guided Model Selection for Data-Driven PDE Discovery20 Aug 2023
- 2023Discovering Symbolic Laws Directly from Trajectories with Hamiltonian Graph Neural Networks11 Jul 2023
- 2023Learning Closed-form Equations for Subgrid-scale Closures from High-fidelity Data: Promises and Challenges8 Jun 2023
- 2023AI-Aristotle: A Physics-Informed framework for Systems Biology Gray-Box Identificationcited by 29
- 2025NeuralFoil: An Airfoil Aerodynamics Analysis Tool Using Physics-Informed Machine Learningcited by 11
- 2023Learning Closed-form Equations for Subgrid-scale Closures from High-fidelity Data: Promises and Challengescited by 9
- 2023AI-Lorenz: A physics-data-driven framework for black-box and gray-box identification of chaotic systems with symbolic regressioncited by 9
- 2023Adaptive Uncertainty-Guided Model Selection for Data-Driven PDE Discoverycited by 6
- 2024Distilling Reinforcement Learning Policies for Interpretable Robot Locomotion: Gradient Boosting Machines and Symbolic Regressioncited by 4
- 2025T-SHRED: Symbolic Regression for Regularization and Model Discovery with Transformer Shallow Recurrent Decoderscited by 4
- 2024COST CA20120 INTERACT Framework of Artificial Intelligence Based Channel Modelingcited by 3
- 2025Kozax: Flexible and Scalable Genetic Programming in JAXcited by 3
- 2023Discovering Interpretable Physical Models using Symbolic Regression and Discrete Exterior Calculuscited by 2
- 2024Hyperdimensional computing: a fast, robust and interpretable paradigm for biological datacited by 2
- 2024Discovering an interpretable mathematical expression for a full wind-turbine wake with artificial intelligence enhanced symbolic regressioncited by 2
12 most cited of 29 All 29 (JSON)
- 2026Machine Learning Meets High-Energy Nuclear Physics: From Pattern Recognition to Physics-Integrated Discovery8 Oct 2026
- 2026An Interpretable Approach to PDE Solution Discovery via Structural Experience Distillation8 Oct 2026
- 2026RISR: Residual-Informed Scientific Equation Discovery with Large Language Models8 Oct 2026
- 2026Coefficient Calibration as Selection Pressure in Symbolic Regression7 Oct 2026
- 2026Symbolic Density Estimators for Unnormalized Distributions7 Oct 2026
- 2026FluxDisco: Symbolic Regression for Stoichiometric Dynamical Systems via Monte Carlo Graph Search4 Sep 2026
- 2026Architecture-Induced Recoverability Bias in Differentiable Symbolic Regression25 Apr 2026
- 2026An Empirical Investigation of Neural ODEs and Symbolic Regression for Dynamical Systems28 Jan 2026
- 2026DeepInflation: an AI agent for research and model discovery of inflation14 Jan 2026
- 2025From GNNs to Symbolic Surrogates via Kolmogorov-Arnold Networks for Delay Prediction24 Dec 2025
- 2025Introduction to Symbolic Regression in the Physical Sciences17 Dec 2025
- 2025SRLR: Symbolic Regression based Logic Recovery to Counter Programmable Logic Controller Attacks12 Dec 2025
12 newest of 29 All 29 (JSON)