# Call for Action: towards the next generation of symbolic regression benchmark

arXiv: https://arxiv.org/abs/2505.03977 · HTML: https://mlsanity.com/paper/2505.03977/

## Key facts

- Cited by 17 papers in the map (data through 14 Oct 2026).
- Builds on 19 of its 60 references that are in the map.
- First posted on arXiv 6 May 2025.

## Builds on (most cited first, 19 of 19)

- [AI Feynman: a Physics-Inspired Method for Symbolic Regression](https://mlsanity.com/paper/1905.11481/) (2019)
- [Contemporary Symbolic Regression Methods and their Relative Performance](https://mlsanity.com/paper/2107.14351/) (2021)
- [End-to-end symbolic regression with transformers](https://mlsanity.com/paper/2204.10532/) (2022)
- [Neural Symbolic Regression that Scales](https://mlsanity.com/paper/2106.06427/) (2021)
- [The Hardware Lottery](https://mlsanity.com/paper/2009.06489/) (2020)
- [Learning Equations for Extrapolation and Control](https://mlsanity.com/paper/1806.07259/) (2018)
- [PMLB: A Large Benchmark Suite for Machine Learning Evaluation and Comparison](https://mlsanity.com/paper/1703.00512/) (2017)
- [Interpretable Scientific Discovery with Symbolic Regression: A Review](https://mlsanity.com/paper/2211.10873/) (2022)
- [Transformer-based Planning for Symbolic Regression](https://mlsanity.com/paper/2303.06833/) (2023)
- [Bayesian Symbolic Regression](https://mlsanity.com/paper/1910.08892/) (2019)
- [PMLB v1.0: An open source dataset collection for benchmarking machine learning methods](https://mlsanity.com/paper/2012.00058/) (2020)
- [Eco2AI: carbon emissions tracking of machine learning models as the first step towards sustainable AI](https://mlsanity.com/paper/2208.00406/) (2022)
- [Rethinking Symbolic Regression Datasets and Benchmarks for Scientific Discovery](https://mlsanity.com/paper/2206.10540/) (2022)
- [Where are we now? A large benchmark study of recent symbolic regression methods](https://mlsanity.com/paper/1804.09331/) (2018)
- [Learning concise representations for regression by evolving networks of trees](https://mlsanity.com/paper/1807.00981/) (2018)
- [An Approach to Symbolic Regression Using Feyn](https://mlsanity.com/paper/2104.05417/) (2021)
- [A Greedy Search Tree Heuristic for Symbolic Regression](https://mlsanity.com/paper/1801.01807/) (2018)
- [Symbolic Regression by Exhaustive Search: Reducing the Search Space Using Syntactical Constraints and Efficient Semantic Structure Deduplication](https://mlsanity.com/paper/2109.13895/) (2021)
- [Data types as a more ergonomic frontend for Grammar-Guided Genetic Programming](https://mlsanity.com/paper/2210.04826/) (2022)

## Built on by (most cited first, 17 of 17)

- [Position: Biology is the Challenge Physics-Informed ML Needs to Evolve](https://mlsanity.com/paper/2510.25368/) (2025)
- [LLM-ODE: Data-driven Discovery of Dynamical Systems with Large Language Models](https://mlsanity.com/paper/2603.20910/) (2026)
- [Beyond Accuracy and Complexity: The Effective Information Criterion for Structurally Stable Symbolic Regression](https://mlsanity.com/paper/2509.21780/) (2025)
- [Towards symbolic regression for interpretable clinical decision scores](https://mlsanity.com/paper/2512.07961/) (2025)
- [Exploring Multi-view Symbolic Regression methods in physical sciences](https://mlsanity.com/paper/2509.10500/) (2025)
- [Multi-task GINN-LP for Multi-target Symbolic Regression](https://mlsanity.com/paper/2511.13463/) (2025)
- [Symbolic Regression for Shared Expressions: Introducing Partial Parameter Sharing](https://mlsanity.com/paper/2601.04051/) (2026)
- [Improving Evaluation of Recombination-based Cartesian Genetic Programming](https://mlsanity.com/paper/2605.28353/) (2026)
- [EditSR: Enhancing Neural Symbolic Regression via Edit-based Rectification](https://mlsanity.com/paper/2606.07915/) (2026)
- [ERBench: A Benchmark and Testsuite for Equation Discovery Algorithms](https://mlsanity.com/paper/2606.09276/) (2026)
- [Validating Causal Abstraction Metrics on Simulated Complex Systems](https://mlsanity.com/paper/2607.00267/) (2026)
- [Bayesian Symbolic Regression with Entropic Reinforcement Learning](https://mlsanity.com/paper/2608.09617/) (2026)
- [LLMs as Post-hoc Auditors of Physiological Plausibility in Symbolic Regression: A Clinician-Evaluated Case Study](https://mlsanity.com/paper/2609.11431/) (2026)
- [Not Every Term Adds New Structure: Sobolev Novelty for Symbolic Regression](https://mlsanity.com/paper/2609.32597/) (2026)
- [SymbolicArena: A Unified Infrastructure for Benchmark Distillation and Dynamic Evaluation in Symbolic Regression](https://mlsanity.com/paper/2609.35113/) (2026)
- [EvoMO-SR: Multiobjective LLM-based Evolution of Symbolic Expressions with substructure guidance](https://mlsanity.com/paper/2609.36187/) (2026)
- [Improving Neural Symbolic Regression with a Diverse Prior and Post-training Alignment](https://mlsanity.com/paper/2610.17994/) (2026)

## Abstract (arXiv)

Symbolic Regression (SR) is a powerful technique for discovering interpretable mathematical expressions. However, benchmarking SR methods remains challenging due to the diversity of algorithms, datasets, and evaluation criteria. In this work, we present an updated version of SRBench. Our benchmark expands the previous one by nearly doubling the number of evaluated methods, refining evaluation metrics, and using improved visualizations of the results to understand the performances. Additionally, we analyze trade-offs between model complexity, accuracy, and energy consumption. Our results show that no single algorithm dominates across all datasets. We propose a call for action from SR community in maintaining and evolving SRBench as a living benchmark that reflects the state-of-the-art in symbolic regression, by standardizing hyperparameter tuning, execution constraints, and computational resource allocation. We also propose deprecation criteria to maintain the benchmark's relevance and discuss best practices for improving SR algorithms, such as adaptive hyperparameter tuning and energy-efficient implementations.
