Where are we now? A large benchmark study of recent symbolic regression methods
Not on the map. Why?
Abstract (arXiv)
In this paper we provide a broad benchmarking of recent genetic programming approaches to symbolic regression in the context of state of the art machine learning approaches. We use a set of nearly 100 regression benchmark problems culled from open source repositories across the web. We conduct a rigorous benchmarking of four recent symbolic regression approaches as well as nine machine learning approaches from scikit-learn. The results suggest that symbolic regression performs strongly compared to state-of-the-art gradient boosting algorithms, although in terms of running times is among the slowest of the available methodologies. We discuss the results in detail and point to future research directions that may allow symbolic regression to gain wider adoption in the machine learning community.
Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 9; 2023: 10; 2024: 7; 2025: 7; 2026: 5.
44 papers.
Sort:
By area:
- 2022Rethinking Symbolic Regression Datasets and Benchmarks for Scientific Discoverycited by 44
- 2022A computational framework for physics-informed symbolic regression with straightforward integration of domain knowledgecited by 31
- 2021Shape-constrained Symbolic Regression -- Improving Extrapolation with Prior Knowledgecited by 27
- 2024AlphaForge: A Framework to Mine and Dynamically Combine Formulaic Alpha Factorscited by 25
- 2023Benchmarking sparse system identification with low-dimensional chaoscited by 19
- 2025Call for Action: towards the next generation of symbolic regression benchmarkcited by 16
- 2022GSR: A Generalized Symbolic Regression Approachcited by 11
- 2021Problem-solving benefits of down-sampled lexicase selectioncited by 8
- 2022Automated Learning of Interpretable Models with Quantified Uncertaintycited by 8
- 2022CoNSoLe: Convex Neural Symbolic Learningcited by 7
- 2025Knowledge Integration for Physics-informed Symbolic Regression Using Pre-trained Large Language Modelscited by 7
- 2023Interpretable Symbolic Regression for Data Science: Analysis of the 2022 Competitioncited by 6
32 more
- 2023MESSY Estimation: Maximum-Entropy based Stochastic and Symbolic densitY Estimationcited by 5
- 2023Symbolic Regression as Feature Engineering Method for Machine and Deep Learning Regression Taskscited by 5
- 2021Generative and reproducible benchmarks for comprehensive evaluation of machine learning classifierscited by 4
- 2022Symbolic-Regression Boostingcited by 4
- 2026A-SR: Self-Evolving Agentic LLMs for Symbolic Regression via Hierarchical Coordinationcited by 4
- 2023Particularitycited by 3
- 2023AutoNumerics-Zero: Automated Discovery of State-of-the-Art Mathematical Functionscited by 3
- 2024Interpretability in Symbolic Regression: a benchmark of Explanatory Methods using the Feynman data setcited by 3
- 2025Iterated Agent for Symbolic Regressioncited by 3
- 2022Symbolic Regression with Fast Function Extraction and Nonlinear Least Squares Optimizationcited by 2
- 2023Symbolic Metamodels for Interpreting Black-boxes Using Primitive Functionscited by 2
- 2023Differentiable Genetic Programming for High-dimensional Symbolic Regressioncited by 2
- 2024ISR: Invertible Symbolic Regressioncited by 2
- 2025TinyverseGP: Towards a Modular Cross-domain Benchmarking Framework for Genetic Programmingcited by 2
- 2025Data-driven Discovery of Digital Twins in Biomedical Researchcited by 2
- 2022Exploring Hidden Semantics in Neural Networks with Symbolic Regressioncited by 1
- 2023Information Fusion via Symbolic Regression: A Tutorial in the Context of Human Healthcited by 1
- 2024Univariate Skeleton Prediction in Multivariate Systems Using Transformerscited by 1
- 2024A neural network approach for solving the Monge-Amp`ere equation with transport boundary conditioncited by 1
- 2025Symbolic Quantile Regression for the Interpretable Prediction of Conditional Quantilescited by 1
- 2026Symmetry-Constrained Language-Guided Program Synthesis for Discovering Governing Equations from Noisy and Partial Observationscited by 1
- 2021Zoetrope Genetic Programming for Regressioncited by 0
- 2021EBIC.JL -- an Efficient Implementation of Evolutionary Biclustering Algorithm in Juliacited by 0
- 2021Pedagogical Rule Extraction to Learn Interpretable Models - an Empirical Studycited by 0
- 2022Iterative Genetic Improvement: Scaling Stochastic Program Synthesiscited by 0
- 2023Enhanced Genetic Programming Models with Multiple Equations for Accurate Semi-Autogenous Grinding Mill Throughput Predictioncited by 0
- 2024Evolutionary Causal Discovery with Relative Impact Stratification for Interpretable Data Analysiscited by 0
- 2024SPINEX_ Symbolic Regression: Similarity-based Symbolic Regression with Explainable Neighbors Explorationcited by 0
- 2025Impilict Runge-Kutta based sparse identification of governing equations in biologically motivated systemscited by 0
- 2026ERBench: A Benchmark and Testsuite for Equation Discovery Algorithmscited by 0
- 2026Efficient Constant Optimization for Symbolic Regression with GPU-Accelerated Tree-Based Genetic Programmingcited by 0
- 2026How AI Agents Discover Scientific Equations: From Hydrotope Rediscovery to New Water-Wave Amplitudescited by 0
- 2026How AI Agents Discover Scientific Equations: From Hydrotope Rediscovery to New Water-Wave Amplitudes30 Sep 2026
- 2026Efficient Constant Optimization for Symbolic Regression with GPU-Accelerated Tree-Based Genetic Programming3 Sep 2026
- 2026A-SR: Self-Evolving Agentic LLMs for Symbolic Regression via Hierarchical Coordination5 Aug 2026
- 2026ERBench: A Benchmark and Testsuite for Equation Discovery Algorithms8 Jun 2026
- 2026Symmetry-Constrained Language-Guided Program Synthesis for Discovering Governing Equations from Noisy and Partial Observations6 Mar 2026
- 2025Iterated Agent for Symbolic Regression9 Oct 2025
- 2025Knowledge Integration for Physics-informed Symbolic Regression Using Pre-trained Large Language Models3 Sep 2025
- 2025Data-driven Discovery of Digital Twins in Biomedical Research29 Aug 2025
- 2025Symbolic Quantile Regression for the Interpretable Prediction of Conditional Quantiles11 Aug 2025
- 2025Call for Action: towards the next generation of symbolic regression benchmark6 May 2025
- 2025TinyverseGP: Towards a Modular Cross-domain Benchmarking Framework for Genetic Programming14 Apr 2025
- 2025Impilict Runge-Kutta based sparse identification of governing equations in biologically motivated systems27 Feb 2025
32 more
- 2024SPINEX_ Symbolic Regression: Similarity-based Symbolic Regression with Explainable Neighbors Exploration5 Nov 2024
- 2024A neural network approach for solving the Monge-Amp`ere equation with transport boundary condition25 Oct 2024
- 2024AlphaForge: A Framework to Mine and Dynamically Combine Formulaic Alpha Factors26 Jun 2024
- 2024Univariate Skeleton Prediction in Multivariate Systems Using Transformers25 Jun 2024
- 2024ISR: Invertible Symbolic Regression10 May 2024
- 2024Evolutionary Causal Discovery with Relative Impact Stratification for Interpretable Data Analysis25 Apr 2024
- 2024Interpretability in Symbolic Regression: a benchmark of Explanatory Methods using the Feynman data set8 Apr 2024
- 2023Enhanced Genetic Programming Models with Multiple Equations for Accurate Semi-Autogenous Grinding Mill Throughput Prediction18 Dec 2023
- 2023AutoNumerics-Zero: Automated Discovery of State-of-the-Art Mathematical Functions13 Dec 2023
- 2023Symbolic Regression as Feature Engineering Method for Machine and Deep Learning Regression Tasks10 Nov 2023
- 2023Particularity12 Jun 2023
- 2023MESSY Estimation: Maximum-Entropy based Stochastic and Symbolic densitY Estimation7 Jun 2023
- 2023Information Fusion via Symbolic Regression: A Tutorial in the Context of Human Health31 May 2023
- 2023Differentiable Genetic Programming for High-dimensional Symbolic Regression18 Apr 2023
- 2023Interpretable Symbolic Regression for Data Science: Analysis of the 2022 Competition3 Apr 2023
- 2023Symbolic Metamodels for Interpreting Black-boxes Using Primitive Functions9 Feb 2023
- 2023Benchmarking sparse system identification with low-dimensional chaos4 Feb 2023
- 2022Symbolic Regression with Fast Function Extraction and Nonlinear Least Squares Optimization20 Sep 2022
- 2022A computational framework for physics-informed symbolic regression with straightforward integration of domain knowledge13 Sep 2022
- 2022Symbolic-Regression Boosting24 Jun 2022
- 2022Rethinking Symbolic Regression Datasets and Benchmarks for Scientific Discovery21 Jun 2022
- 2022CoNSoLe: Convex Neural Symbolic Learning1 Jun 2022
- 2022GSR: A Generalized Symbolic Regression Approach31 May 2022
- 2022Exploring Hidden Semantics in Neural Networks with Symbolic Regression22 Apr 2022
- 2022Automated Learning of Interpretable Models with Quantified Uncertainty12 Apr 2022
- 2022Iterative Genetic Improvement: Scaling Stochastic Program Synthesis26 Feb 2022
- 2021Pedagogical Rule Extraction to Learn Interpretable Models - an Empirical Study25 Dec 2021
- 2021Generative and reproducible benchmarks for comprehensive evaluation of machine learning classifiers14 Jul 2021
- 2021Problem-solving benefits of down-sampled lexicase selection10 Jun 2021
- 2021EBIC.JL -- an Efficient Implementation of Evolutionary Biclustering Algorithm in Julia3 May 2021
- 2021Shape-constrained Symbolic Regression -- Improving Extrapolation with Prior Knowledge29 Mar 2021
- 2021Zoetrope Genetic Programming for Regression26 Feb 2021
- 2022Rethinking Symbolic Regression Datasets and Benchmarks for Scientific Discoverycited by 44
- 2022A computational framework for physics-informed symbolic regression with straightforward integration of domain knowledgecited by 31
- 2021Shape-constrained Symbolic Regression -- Improving Extrapolation with Prior Knowledgecited by 27
- 2024AlphaForge: A Framework to Mine and Dynamically Combine Formulaic Alpha Factorscited by 25
- 2023Benchmarking sparse system identification with low-dimensional chaoscited by 19
- 2025Call for Action: towards the next generation of symbolic regression benchmarkcited by 16
- 2022GSR: A Generalized Symbolic Regression Approachcited by 11
- 2021Problem-solving benefits of down-sampled lexicase selectioncited by 8
- 2022Automated Learning of Interpretable Models with Quantified Uncertaintycited by 8
- 2022CoNSoLe: Convex Neural Symbolic Learningcited by 7
- 2025Knowledge Integration for Physics-informed Symbolic Regression Using Pre-trained Large Language Modelscited by 7
- 2023Interpretable Symbolic Regression for Data Science: Analysis of the 2022 Competitioncited by 6
12 most cited of 41 All 41 (JSON)
- 2026Efficient Constant Optimization for Symbolic Regression with GPU-Accelerated Tree-Based Genetic Programming3 Sep 2026
- 2026ERBench: A Benchmark and Testsuite for Equation Discovery Algorithms8 Jun 2026
- 2026Symmetry-Constrained Language-Guided Program Synthesis for Discovering Governing Equations from Noisy and Partial Observations6 Mar 2026
- 2025Knowledge Integration for Physics-informed Symbolic Regression Using Pre-trained Large Language Models3 Sep 2025
- 2025Data-driven Discovery of Digital Twins in Biomedical Research29 Aug 2025
- 2025Symbolic Quantile Regression for the Interpretable Prediction of Conditional Quantiles11 Aug 2025
- 2025Call for Action: towards the next generation of symbolic regression benchmark6 May 2025
- 2025TinyverseGP: Towards a Modular Cross-domain Benchmarking Framework for Genetic Programming14 Apr 2025
- 2025Impilict Runge-Kutta based sparse identification of governing equations in biologically motivated systems27 Feb 2025
- 2024SPINEX_ Symbolic Regression: Similarity-based Symbolic Regression with Explainable Neighbors Exploration5 Nov 2024
- 2024A neural network approach for solving the Monge-Amp`ere equation with transport boundary condition25 Oct 2024
- 2024AlphaForge: A Framework to Mine and Dynamically Combine Formulaic Alpha Factors26 Jun 2024
12 newest of 41 All 41 (JSON)