mlsanityData to 14 Oct 2026

Verifier-Guided Model Discovery for Physical Dynamical Systems with Pretrained Symbolic Transformers

arXiv 2608.02662 ↗First posted 1 Aug 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Reliable forecasting of nonlinear physical systems underpins scientific discovery and engineering decision-making. Yet high-fidelity simulations are prohibitively costly, and machine-learning surrogates can be opaque and encode assumptions about system dynamics, limiting generalizability. Pretrained transformers mapping synthetic ODE trajectories to equations offer interpretable alternatives, promising transfer without system-specific equation knowledge. Transferring them reliably to high-dimensional physical data, however, remains an open challenge. We develop a verifier-guided (VG) workflow around ODEFormer as a symbolic backbone, using dynamical and physical-admissibility criteria to select from a multi-trajectory candidate equation pool, enabling transfer. On canonical Van der Pol oscillators, VG outperforms the original ODEFormer workflow across held-out initial conditions. We then address vortex shedding, a phenomenon occurring in atmospheric and plasma systems of societal relevance, through coordinate reduction and symbolic discovery at fixed and varying Reynolds numbers. VG discovers fixed-parameter reduced-order equations that recover the fundamental shedding oscillator and higher harmonics without a wake-specific candidate library or prescribed Navier-Stokes structure, while the cross-parameter model generalizes to withheld regimes. Reconstruction fidelity alone did not determine symbolic discoverability, highlighting the importance of compatibility between latent dynamics and the backbone's pretraining distribution. This work establishes a verifier-guided neural-to-symbolic methodology for interpretable and physically auditable forecasting in the natural sciences.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 42 references that are in the map. First posted on arXiv 1 Aug 2026.

Builds on

26 of 42 references.

References · 26

  1. 2018Neural Ordinary Differential Equationscited by 3,779
  2. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  3. 2019Hamiltonian Neural Networkscited by 712
  4. 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 548
  5. 2020Discovering Symbolic Models from Deep Learning with Inductive Biasescited by 344
  6. 2019Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradientscited by 309
  7. 2021Physics-informed neural networks with hard constraints for inverse designcited by 280
  8. 2022End-to-end symbolic regression with transformerscited by 203
  9. 2021Neural Symbolic Regression that Scalescited by 192
  10. 2020Weak SINDy For Partial Differential Equationscited by 155
  11. 2021Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise limit, with active learning and controlcited by 137
  12. 2021SymbolicGPT: A Generative Transformer Model for Symbolic Regressioncited by 105
14 more
  1. 2023Transformer-based Planning for Symbolic Regressioncited by 79
  2. 2021From Statistical Relational to Neurosymbolic Artificial Intelligence: a Surveycited by 72
  3. 2023ODEFormer: Symbolic Regression of Dynamical Systems with Transformerscited by 62
  4. 2020Probabilistic Grammars for Equation Discoverycited by 36
  5. 2024Rapid Bayesian identification of sparse nonlinear dynamics from scarce and noisy datacited by 15
  6. 2021Inferring the Structure of Ordinary Differential Equationscited by 7
  7. 2023Dynamic Mode Decomposition for data-driven analysis and reduced-order modelling of ExB plasmas: II. dynamics forecastingcited by 7
  8. 2025Knowledge Integration for Physics-informed Symbolic Regression Using Pre-trained Large Language Modelscited by 7
  9. 2024Machine Learning Applications to Computational Plasma Physics and Reduced-Order Plasma Modeling: A Perspectivecited by 4
  10. 2025Diffusion-Based Symbolic Regressioncited by 4
  11. 2025Predicting symbolic ODEs from multiple trajectoriescited by 2
  12. 2026Neuro-Symbolic ODE Discovery with Latent Grammar Flowcited by 2
  13. 2026Discovery of Nonlinear Dynamics with Automated Basis Function Generationcited by 2
  14. 2026Prior-Guided Symbolic Regression: Towards Scientific Consistency in Equation Discoverycited by 1

Built on by

Not cited yet.