mlsanityData to 7 Oct 2026

DrSR: LLM based Scientific Equation Discovery with Dual Reasoning from Data and Experience

arXiv 2506.04282 ↗First posted 4 Jun 2025cs.LGcited by 20

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

Symbolic regression is a fundamental tool for discovering interpretable mathematical expressions from data, with broad applications across scientific and engineering domains. Recently, large language models (LLMs) have demonstrated strong performance in this task, leveraging embedded scientific priors and reasoning capabilities to surpass traditional methods. However, existing LLM-based approaches, such as LLM-SR, often over-rely on internal priors, lacking explicit data understanding and systematic reflection during equation generation. To address these limitations, we propose DrSR (Dual Reasoning Symbolic Regression), a framework that combines data-driven insight with reflective learning to enhance both robustness and discovery capability. Specifically, DrSR guides LLMs to analyze structural relationships (e.g., monotonicity, nonlinearity, and correlation) within the data to generate structured descriptions. Simultaneously, it monitors equation performance and establishes a feedback loop to refine subsequent generations. By integrating data understanding and generation reflection in a closed loop, DrSR enables more efficient exploration of the symbolic expression space. Experiments across interdisciplinary datasets in physics, chemistry, biology, and materials science demonstrate that DrSR substantially improves the valid equation rate and consistently outperforms both classical and recent LLM-based methods in terms of accuracy, generalization, and search efficiency. These results underscore its potential for scientific equation discovery.

Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 49 references that are in the map. First posted on arXiv 4 Jun 2025.

Builds on

32 of 49 references.

References · 32

  1. 2024Mixtral of Expertscited by 1,785
  2. 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
  3. 2019Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradientscited by 294
  4. 2022End-to-end symbolic regression with transformerscited by 195
  5. 2021Neural Symbolic Regression that Scalescited by 185
  6. 2018Learning Equations for Extrapolation and Controlcited by 151
  7. 2023Language Model Crossover: Variation through Few-Shot Promptingcited by 119
  8. 2024LLM-SR: Scientific Equation Discovery via Programming with Large Language Modelscited by 117
  9. 2016Extrapolation and learning equationscited by 106
  10. 2022Interpretable Scientific Discovery with Symbolic Regression: A Reviewcited by 105
  11. 2021SymbolicGPT: A Generative Transformer Model for Symbolic Regressioncited by 101
  12. 2021Symbolic Regression via Neural-Guided Genetic Programming Population Seedingcited by 97
20 more
  1. 2019Integration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discoverycited by 93
  2. 2024Symbolic Regression with a Learned Concept Librarycited by 76
  3. 2022Rediscovering orbital mechanics with machine learningcited by 71
  4. 2022Symbolic Physics Learner: Discovering governing equations via Monte Carlo tree searchcited by 61
  5. 2025LLM-SRBench: A New Benchmark for Scientific Equation Discovery with Large Language Modelscited by 61
  6. 2022SymFormer: End-to-end symbolic regression using transformer-based architecturecited by 56
  7. 2023Generating Synergistic Formulaic Alpha Collections via Reinforcement Learningcited by 37
  8. 2024In-Context Symbolic Regression: Leveraging Large Language Models for Function Discoverycited by 29
  9. 2025Llama-3.1-FoundationAI-SecurityLLM-Base-8B Technical Reportcited by 28
  10. 2019Fast, accurate, and transferable many-body interatomic potentials by symbolic regressioncited by 23
  11. 2022Taylor Genetic Programming for Symbolic Regressioncited by 18
  12. 2024Symbolic regression via MDLformer-guided search: from minimizing prediction error to minimizing description lengthcited by 16
  13. 2021Improving exploration in policy gradient search: Application to symbolic optimizationcited by 14
  14. 2023A Neural-Guided Dynamic Symbolic Network for Exploring Mathematical Expressions from Datacited by 14
  15. 2024CoEvo: Continual Evolution of Symbolic Solutions Using Large Language Modelscited by 6
  16. 2024PruneSymNet: A Symbolic Neural Network and Pruning Algorithm for Symbolic Regressioncited by 4
  17. 2022NIERT: Accurate Numerical Interpolation through Unifying Scattered Data Representations using Transformer Encodercited by 3
  18. 2024DisCo-DSO: Coupling Discrete and Continuous Optimization for Efficient Generative Design in Hybrid Spacescited by 3
  19. 2023MetaSymNet: A Tree-like Symbol Network with Adaptive Architecture and Activation Functionscited by 1
  20. 2024HRFT: Mining High-Frequency Risk Factor Collections End-to-End via Transformercited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 5; 2026: 15.

20 papers.

Sort:

By area:

  1. 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontierscited by 34
  2. 2025SR-Scientist: Scientific Equation Discovery With Agentic AIcited by 30
  3. 2025A Survey of Inductive Reasoning for Large Language Modelscited by 8
  4. 2025Can Large Language Models Adequately Perform Symbolic Reasoning Over Time Series?cited by 6
  5. 2026MATRIX: A Multimodal Benchmark and Post-Training Framework for Materials Sciencecited by 3
  6. 2026STRIDE: A Self-Reflective Agent Framework for Reliable Automatic Equation Discoverycited by 2
  7. 2026NSR-Boost: A Neuro-Symbolic Residual Boosting Framework for Industrial Legacy Modelscited by 1
  8. 2026Prior-Guided Symbolic Regression: Towards Scientific Consistency in Equation Discoverycited by 1
  9. 2026Discovery of Interpretable Surrogates via Agentic AI: Application to Gravitational Wavescited by 1
  10. 2025Bridging the Gap Between Scientific Laws Derived by AI Systems and Canonical Knowledge via Abductive Inference with AI-Noethercited by 0
  11. 2026PASM: Population Adaptive Symbolic Mixture-of-Experts Model for Cross-location Hurricane Evacuation Decision Predictioncited by 0
  12. 2026LLM-driven design of physics-constrained constitutive models: two agents are better than onecited by 0
8 more
  1. 2026SciText2Eq: Assessing LLMs for Explainable Equation Generation for Scientific Creativitycited by 0
  2. 2026Large language models for partial differential equation workflowscited by 0
  3. 2026What Should a Large Language Model See? Physical Invariants as a Data Representation for PDE Discoverycited by 0
  4. 2026LLMs as Post-hoc Auditors of Physiological Plausibility in Symbolic Regression: A Clinician-Evaluated Case Studycited by 0
  5. 2026TNLearn: An Open Source Python Package for Task-based Neuronscited by 0
  6. 2026SRHarness: A Harness for Agentic Symbolic Regressioncited by 0
  7. 2026EvoMO-SR: Multiobjective LLM-based Evolution of Symbolic Expressions with substructure guidancecited by 0
  8. 2026How AI Agents Discover Scientific Equations: From Hydrotope Rediscovery to New Water-Wave Amplitudescited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Probabilistic Regular Tree Priors for Scientific Symbolic Reasoning
  2. 2026Think like a Scientist: Physics-guided LLM Agent for Equation Discovery
  3. 2024In Context Learning and Reasoning for Symbolic Regression with Large Language Models
  4. 2025Iterated Agent for Symbolic Regression
  5. 2025Discovering Mathematical Equations with Diffusion Language Model
  6. 2026Automatic Ordinary Differential Equations Discovery For Biological Systems Using Large Language Model Powered Agentic System
  7. 2026In-Context Examples Suppress Scientific Knowledge Recall in LLMs
  8. 2025On LLM-Based Scientific Inductive Reasoning Beyond Equations