DrSR: LLM based Scientific Equation Discovery with Dual Reasoning from Data and Experience
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
Abstract (arXiv)
Symbolic regression is a fundamental tool for discovering interpretable mathematical expressions from data, with broad applications across scientific and engineering domains. Recently, large language models (LLMs) have demonstrated strong performance in this task, leveraging embedded scientific priors and reasoning capabilities to surpass traditional methods. However, existing LLM-based approaches, such as LLM-SR, often over-rely on internal priors, lacking explicit data understanding and systematic reflection during equation generation. To address these limitations, we propose DrSR (Dual Reasoning Symbolic Regression), a framework that combines data-driven insight with reflective learning to enhance both robustness and discovery capability. Specifically, DrSR guides LLMs to analyze structural relationships (e.g., monotonicity, nonlinearity, and correlation) within the data to generate structured descriptions. Simultaneously, it monitors equation performance and establishes a feedback loop to refine subsequent generations. By integrating data understanding and generation reflection in a closed loop, DrSR enables more efficient exploration of the symbolic expression space. Experiments across interdisciplinary datasets in physics, chemistry, biology, and materials science demonstrate that DrSR substantially improves the valid equation rate and consistently outperforms both classical and recent LLM-based methods in terms of accuracy, generalization, and search efficiency. These results underscore its potential for scientific equation discovery.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 49 references that are in the map. First posted on arXiv 4 Jun 2025.
Builds on
32 of 49 references.
References · 32
- 2024Mixtral of Expertscited by 1,785
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
- 2019Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradientscited by 294
- 2022End-to-end symbolic regression with transformerscited by 195
- 2021Neural Symbolic Regression that Scalescited by 185
- 2018Learning Equations for Extrapolation and Controlcited by 151
- 2023Language Model Crossover: Variation through Few-Shot Promptingcited by 119
- 2024LLM-SR: Scientific Equation Discovery via Programming with Large Language Modelscited by 117
- 2016Extrapolation and learning equationscited by 106
- 2022Interpretable Scientific Discovery with Symbolic Regression: A Reviewcited by 105
- 2021SymbolicGPT: A Generative Transformer Model for Symbolic Regressioncited by 101
- 2021Symbolic Regression via Neural-Guided Genetic Programming Population Seedingcited by 97
20 more
- 2019Integration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discoverycited by 93
- 2024Symbolic Regression with a Learned Concept Librarycited by 76
- 2022Rediscovering orbital mechanics with machine learningcited by 71
- 2022Symbolic Physics Learner: Discovering governing equations via Monte Carlo tree searchcited by 61
- 2025LLM-SRBench: A New Benchmark for Scientific Equation Discovery with Large Language Modelscited by 61
- 2022SymFormer: End-to-end symbolic regression using transformer-based architecturecited by 56
- 2023Generating Synergistic Formulaic Alpha Collections via Reinforcement Learningcited by 37
- 2024In-Context Symbolic Regression: Leveraging Large Language Models for Function Discoverycited by 29
- 2025Llama-3.1-FoundationAI-SecurityLLM-Base-8B Technical Reportcited by 28
- 2019Fast, accurate, and transferable many-body interatomic potentials by symbolic regressioncited by 23
- 2022Taylor Genetic Programming for Symbolic Regressioncited by 18
- 2024Symbolic regression via MDLformer-guided search: from minimizing prediction error to minimizing description lengthcited by 16
- 2021Improving exploration in policy gradient search: Application to symbolic optimizationcited by 14
- 2023A Neural-Guided Dynamic Symbolic Network for Exploring Mathematical Expressions from Datacited by 14
- 2024CoEvo: Continual Evolution of Symbolic Solutions Using Large Language Modelscited by 6
- 2024PruneSymNet: A Symbolic Neural Network and Pruning Algorithm for Symbolic Regressioncited by 4
- 2022NIERT: Accurate Numerical Interpolation through Unifying Scattered Data Representations using Transformer Encodercited by 3
- 2024DisCo-DSO: Coupling Discrete and Continuous Optimization for Efficient Generative Design in Hybrid Spacescited by 3
- 2023MetaSymNet: A Tree-like Symbol Network with Adaptive Architecture and Activation Functionscited by 1
- 2024HRFT: Mining High-Frequency Risk Factor Collections End-to-End via Transformercited by 1
Built on by
Citing papers per year: 2025: 5; 2026: 15.
20 papers.
Sort:
By area:
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontierscited by 34
- 2025SR-Scientist: Scientific Equation Discovery With Agentic AIcited by 30
- 2025A Survey of Inductive Reasoning for Large Language Modelscited by 8
- 2025Can Large Language Models Adequately Perform Symbolic Reasoning Over Time Series?cited by 6
- 2026MATRIX: A Multimodal Benchmark and Post-Training Framework for Materials Sciencecited by 3
- 2026STRIDE: A Self-Reflective Agent Framework for Reliable Automatic Equation Discoverycited by 2
- 2026NSR-Boost: A Neuro-Symbolic Residual Boosting Framework for Industrial Legacy Modelscited by 1
- 2026Prior-Guided Symbolic Regression: Towards Scientific Consistency in Equation Discoverycited by 1
- 2026Discovery of Interpretable Surrogates via Agentic AI: Application to Gravitational Wavescited by 1
- 2025Bridging the Gap Between Scientific Laws Derived by AI Systems and Canonical Knowledge via Abductive Inference with AI-Noethercited by 0
- 2026PASM: Population Adaptive Symbolic Mixture-of-Experts Model for Cross-location Hurricane Evacuation Decision Predictioncited by 0
- 2026LLM-driven design of physics-constrained constitutive models: two agents are better than onecited by 0
8 more
- 2026SciText2Eq: Assessing LLMs for Explainable Equation Generation for Scientific Creativitycited by 0
- 2026Large language models for partial differential equation workflowscited by 0
- 2026What Should a Large Language Model See? Physical Invariants as a Data Representation for PDE Discoverycited by 0
- 2026LLMs as Post-hoc Auditors of Physiological Plausibility in Symbolic Regression: A Clinician-Evaluated Case Studycited by 0
- 2026TNLearn: An Open Source Python Package for Task-based Neuronscited by 0
- 2026SRHarness: A Harness for Agentic Symbolic Regressioncited by 0
- 2026EvoMO-SR: Multiobjective LLM-based Evolution of Symbolic Expressions with substructure guidancecited by 0
- 2026How AI Agents Discover Scientific Equations: From Hydrotope Rediscovery to New Water-Wave Amplitudescited by 0
- 2026How AI Agents Discover Scientific Equations: From Hydrotope Rediscovery to New Water-Wave Amplitudes30 Sep 2026
- 2026EvoMO-SR: Multiobjective LLM-based Evolution of Symbolic Expressions with substructure guidance28 Sep 2026
- 2026SRHarness: A Harness for Agentic Symbolic Regression28 Sep 2026
- 2026TNLearn: An Open Source Python Package for Task-based Neurons23 Sep 2026
- 2026LLMs as Post-hoc Auditors of Physiological Plausibility in Symbolic Regression: A Clinician-Evaluated Case Study10 Sep 2026
- 2026What Should a Large Language Model See? Physical Invariants as a Data Representation for PDE Discovery25 Aug 2026
- 2026Large language models for partial differential equation workflows4 Aug 2026
- 2026SciText2Eq: Assessing LLMs for Explainable Equation Generation for Scientific Creativity14 Jun 2026
- 2026LLM-driven design of physics-constrained constitutive models: two agents are better than one22 May 2026
- 2026STRIDE: A Self-Reflective Agent Framework for Reliable Automatic Equation Discovery18 May 2026
- 2026Discovery of Interpretable Surrogates via Agentic AI: Application to Gravitational Waves11 May 2026
- 2026PASM: Population Adaptive Symbolic Mixture-of-Experts Model for Cross-location Hurricane Evacuation Decision Prediction31 Mar 2026
8 more
- 2026Prior-Guided Symbolic Regression: Towards Scientific Consistency in Equation Discovery13 Feb 2026
- 2026MATRIX: A Multimodal Benchmark and Post-Training Framework for Materials Science30 Jan 2026
- 2026NSR-Boost: A Neuro-Symbolic Residual Boosting Framework for Industrial Legacy Models15 Jan 2026
- 2025SR-Scientist: Scientific Equation Discovery With Agentic AI13 Oct 2025
- 2025A Survey of Inductive Reasoning for Large Language Models11 Oct 2025
- 2025Bridging the Gap Between Scientific Laws Derived by AI Systems and Canonical Knowledge via Abductive Inference with AI-Noether26 Sep 2025
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontiers28 Aug 2025
- 2025Can Large Language Models Adequately Perform Symbolic Reasoning Over Time Series?5 Aug 2025
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontierscited by 34
- 2025SR-Scientist: Scientific Equation Discovery With Agentic AIcited by 30
- 2026STRIDE: A Self-Reflective Agent Framework for Reliable Automatic Equation Discoverycited by 2
- 2026Discovery of Interpretable Surrogates via Agentic AI: Application to Gravitational Wavescited by 1
- 2026LLM-driven design of physics-constrained constitutive models: two agents are better than onecited by 0
- 2026SRHarness: A Harness for Agentic Symbolic Regressioncited by 0
- 2026How AI Agents Discover Scientific Equations: From Hydrotope Rediscovery to New Water-Wave Amplitudescited by 0
- 2026How AI Agents Discover Scientific Equations: From Hydrotope Rediscovery to New Water-Wave Amplitudes30 Sep 2026
- 2026SRHarness: A Harness for Agentic Symbolic Regression28 Sep 2026
- 2026LLM-driven design of physics-constrained constitutive models: two agents are better than one22 May 2026
- 2026STRIDE: A Self-Reflective Agent Framework for Reliable Automatic Equation Discovery18 May 2026
- 2026Discovery of Interpretable Surrogates via Agentic AI: Application to Gravitational Waves11 May 2026
- 2025SR-Scientist: Scientific Equation Discovery With Agentic AI13 Oct 2025
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontiers28 Aug 2025
- 2026NSR-Boost: A Neuro-Symbolic Residual Boosting Framework for Industrial Legacy Modelscited by 1
- 2026Prior-Guided Symbolic Regression: Towards Scientific Consistency in Equation Discoverycited by 1
- 2025Bridging the Gap Between Scientific Laws Derived by AI Systems and Canonical Knowledge via Abductive Inference with AI-Noethercited by 0
- 2026SciText2Eq: Assessing LLMs for Explainable Equation Generation for Scientific Creativitycited by 0
- 2026Large language models for partial differential equation workflowscited by 0
- 2026What Should a Large Language Model See? Physical Invariants as a Data Representation for PDE Discoverycited by 0
- 2026LLMs as Post-hoc Auditors of Physiological Plausibility in Symbolic Regression: A Clinician-Evaluated Case Studycited by 0
- 2026TNLearn: An Open Source Python Package for Task-based Neuronscited by 0
- 2026EvoMO-SR: Multiobjective LLM-based Evolution of Symbolic Expressions with substructure guidancecited by 0
- 2026EvoMO-SR: Multiobjective LLM-based Evolution of Symbolic Expressions with substructure guidance28 Sep 2026
- 2026TNLearn: An Open Source Python Package for Task-based Neurons23 Sep 2026
- 2026LLMs as Post-hoc Auditors of Physiological Plausibility in Symbolic Regression: A Clinician-Evaluated Case Study10 Sep 2026
- 2026What Should a Large Language Model See? Physical Invariants as a Data Representation for PDE Discovery25 Aug 2026
- 2026Large language models for partial differential equation workflows4 Aug 2026
- 2026SciText2Eq: Assessing LLMs for Explainable Equation Generation for Scientific Creativity14 Jun 2026
- 2026Prior-Guided Symbolic Regression: Towards Scientific Consistency in Equation Discovery13 Feb 2026
- 2026NSR-Boost: A Neuro-Symbolic Residual Boosting Framework for Industrial Legacy Models15 Jan 2026
- 2025Bridging the Gap Between Scientific Laws Derived by AI Systems and Canonical Knowledge via Abductive Inference with AI-Noether26 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2023Probabilistic Regular Tree Priors for Scientific Symbolic Reasoning
- 2026Think like a Scientist: Physics-guided LLM Agent for Equation Discovery
- 2024In Context Learning and Reasoning for Symbolic Regression with Large Language Models
- 2025Iterated Agent for Symbolic Regression
- 2025Discovering Mathematical Equations with Diffusion Language Model
- 2026Automatic Ordinary Differential Equations Discovery For Biological Systems Using Large Language Model Powered Agentic System
- 2026In-Context Examples Suppress Scientific Knowledge Recall in LLMs
- 2025On LLM-Based Scientific Inductive Reasoning Beyond Equations