Estimating unknown parameters in differential equations with a reinforcement learning based PSO method
On the map: Deep reinforcement learning methods → RL theory and sample complexity
Abstract (arXiv)
Differential equations offer a foundational yet powerful framework for modeling interactions within complex dynamic systems and are widely applied across numerous scientific fields. One common challenge in this area is estimating the unknown parameters of these dynamic relationships. However, traditional numerical optimization methods rely on the selection of initial parameter values, making them prone to local optima. Meanwhile, deep learning and Bayesian methods require training models on specific differential equations, resulting in poor versatility. This paper reformulates the parameter estimation problem of differential equations as an optimization problem by introducing the concept of particles from the particle swarm optimization algorithm. Building on reinforcement learning-based particle swarm optimization (RLLPSO), this paper proposes a novel method, DERLPSO, for estimating unknown parameters of differential equations. We compared its performance on three typical ordinary differential equations with the state-of-the-art methods, including the RLLPSO algorithm, traditional numerical methods, deep learning approaches, and Bayesian methods. The experimental results demonstrate that our DERLPSO consistently outperforms other methods in terms of performance, achieving an average Mean Square Error of 1.13e-05, which reduces the error by approximately 4 orders of magnitude compared to other methods. Apart from ordinary differential equations, our DERLPSO also show great promise for estimating unknown parameters of partial differential equations. The DERLPSO method proposed in this paper has high accuracy, is independent of initial parameter values, and possesses strong versatility and stability. This work provides new insights into unknown parameter estimation for differential equations.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL theory and sample complexity, one of 15 directions in Deep reinforcement learning methods. Builds on 4 of its 24 references that are in the map. First posted on arXiv 13 Nov 2024.
Builds on
4 of 24 references.
References · 4
- 2018Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equationscited by 235
- 2017Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equationscited by 208
- 2020Parameter Estimation with Dense and Convolutional Neural Networks Applied to the FitzHugh-Nagumo ODEcited by 19
- 2020Revealing hidden dynamics from time-series data by ODENetcited by 17
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Identifying Ordinary Differential Equations for Data-efficient Model-based Reinforcement Learning
- 2026A Zeroth-Order Deep Learning Method for Fully Nonlinear Parabolic Partial Differential Equations with Unknown Coefficients
- 2024Closed-form Solutions: A New Perspective on Solving Differential Equations
- 2025Why Flow Matching is Particle Swarm Optimization?
- 2026Autoregression-Free Neural Operators for Time-Dependent PDEs
- 2025Model-Agnostic Knowledge Guided Correction for Improved Neural Surrogate Rollout
- 2025CFO: Learning Continuous-Time PDE Dynamics via Flow-Matched Neural Operators
- 2024A Differential and Pointwise Control Approach to Reinforcement Learning