LLM-PDESR: Robust PDE Discovery via Subdomain Weighted Residuals and LLM-Guided Symbolic Hypothesis Generation
Not on the map. Why?
Abstract (arXiv)
Discovering governing partial differential equations (PDEs) from noisy observational data is a fundamental challenge in scientific machine learning. Traditional symbolic regression (SR) methods often struggle to identify accurate equations within vast combinatorial search spaces, largely due to their inability to incorporate essential domain-specific prior knowledge. Furthermore, reliance on pointwise evaluations and discrete finite differences inherently amplifies high-frequency noise, creating deceptive fitness landscapes that derail the optimization process. To resolve these bottlenecks, we propose LLM-PDESR, a framework that integrates the structural hypothesis generation of Large Language Models (LLMs) with a mathematically rigorous evaluation environment. By employing C^4-continuous quintic splines for robust differentiation and subdomain weighted residuals as natural low-pass filters, our approach effectively mitigates the fitness landscape distortion that plagues existing methods. A Pareto-driven feedback loop then enables the LLM to iteratively refine candidate equations, balancing predictive accuracy with structural parsimony. We evaluate LLM-PDESR on 23 canonical PDEs and five structurally novel equations (including a multivariate system) specifically designed to preclude dataset memorization and test true discovery capabilities. Demonstrating real-world applicability, the framework successfully extracts a consistent structural skeleton for an interpretable 1D dynamical surrogate (1D-CACE) directly from noisy ERA5 reanalysis data. Extensive experiments and out-of-distribution testing confirm that LLM-PDESR significantly outperforms state-of-the-art methodologies in structural recovery, noise resilience, and the avoidance of spurious complexity and equation bloat.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 50 references that are in the map. First posted on arXiv 12 Jul 2026.
Builds on
18 of 50 references.
References · 18
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2017PDE-Net: Learning PDEs from Datacited by 311
- 2019Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradientscited by 309
- 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 179
- 2020Weak SINDy For Partial Differential Equationscited by 155
- 2024LLM-SR: Scientific Equation Discovery via Programming with Large Language Modelscited by 133
- 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4cited by 112
- 2022Interpretable Scientific Discovery with Symbolic Regression: A Reviewcited by 105
- 2023Transformer-based Planning for Symbolic Regressioncited by 79
- 2019DeepMoD: Deep learning for Model Discovery in noisy datacited by 71
- 2021Any equation is a forest: Symbolic genetic algorithm for discovering open-form partial differential equations (SGA-PDE)cited by 41
6 more
- 2020Automatic Differentiation to Simultaneously Identify Nonlinear Dynamics and Extract Noise Probability Distributions from Datacited by 37
- 2024RL-GPT: Integrating Reinforcement Learning and Code-as-policycited by 32
- 2025Pareto Set Learning for Multi-Objective Reinforcement Learningcited by 20
- 2022Asymptotic consistency of the WSINDy algorithm in the limit of continuum datacited by 14
- 2025Generative Discovery of Partial Differential Equations by Learning from Math Handbookscited by 12
- 2023A structured L-BFGS method and its application to inverse problemscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.