NeuPDE: Neural Network Based Ordinary and Partial Differential Equations for Modeling Time-Dependent Data
Not on the map. Why?
Abstract (arXiv)
We propose a neural network based approach for extracting models from dynamic data using ordinary and partial differential equations. In particular, given a time-series or spatio-temporal dataset, we seek to identify an accurate governing system which respects the intrinsic differential structure. The unknown governing model is parameterized by using both (shallow) multilayer perceptrons and nonlinear differential terms, in order to incorporate relevant correlations between spatio-temporal samples. We demonstrate the approach on several examples where the data is sampled from various dynamical systems and give a comparison to recurrent networks and other data-discovery methods. In addition, we show that for MNIST and Fashion MNIST, our approach lowers the parameter cost as compared to other deep neural networks.
Key facts. Cited by 42 papers in the map (data through 14 Oct 2026). First posted on arXiv 8 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 8; 2023: 6; 2024: 7; 2025: 4; 2026: 2.
42 papers.
Sort:
By area:
- 2025A Survey of Sim-to-Real Methods in RL: Progress, Prospects and Challenges with Foundation Modelscited by 38
- 2024PROSE-FD: A Multimodal PDE Foundation Model for Learning Multiple Operators for Forecasting Fluid Dynamicscited by 34
- 2021Neural Delay Differential Equationscited by 26
- 2021Deep Neural Network Modeling of Unknown Partial Differential Equations in Nodal Spacecited by 25
- 2023Flow Map Learning for Unknown Dynamical Systems: Overview, Implementation, and Benchmarkscited by 18
- 2021Beyond Predictions in Neural ODEs: Identification and Interventionscited by 15
- 2021The Discovery of Dynamics via Linear Multistep Methods and Deep Learning: Error Estimationcited by 14
- 2024LeMON: Learning to Learn Multi-Operator Networkscited by 14
- 2022FINDE: Neural Differential Equations for Finding and Preserving Invariant Quantitiescited by 12
- 2023Deep-OSG: Deep Learning of Operators in Semigroupcited by 11
- 2022Deep Learning of Chaotic Systems from Partially-Observed Datacited by 9
- 2025DUE: A Deep Learning Framework and Library for Modeling Unknown Equationscited by 8
30 more
- 2021Conditioning of Random Feature Matrices: Double Descent and Generalization Errorcited by 7
- 2024Time-Series Forecasting, Knowledge Distillation, and Refinement within a Multimodal PDE Foundation Modelcited by 7
- 2021Learning orbital dynamics of binary black hole systems from gravitational wave measurementscited by 6
- 2021Neural Ordinary Differential Equations for Data-Driven Reduced Order Modeling of Environmental Hydrodynamicscited by 5
- 2022Robust Modeling of Unknown Dynamical Systems via Ensemble Averaged Learningcited by 5
- 2024AsCAN: Asymmetric Convolution-Attention Networks for Efficient Recognition and Generationcited by 5
- 2022Neural Piecewise-Constant Delay Differential Equationscited by 4
- 2022Modeling unknown dynamical systems with hidden parameterscited by 4
- 2023Learning PDE Solution Operator for Continuous Modeling of Time-Seriescited by 3
- 2021Neuro-Reachability of Networked Microgridscited by 2
- 2021A Swarm Variant for the Schr"odinger Solvercited by 2
- 2021Data-driven reduced order modeling of environmental hydrodynamics using deep autoencoders and neural ODEscited by 2
- 2021Adaptive Group Lasso Neural Network Models for Functions of Few Variables and Time-Dependent Datacited by 2
- 2023Graph Neural Stochastic Differential Equationscited by 2
- 2025Deep Neural Networks Inspired by Differential Equationscited by 2
- 2026Autoregression-Free Neural Operators for Time-Dependent PDEscited by 2
- 2021Signature-Graph Networkscited by 1
- 2021Characteristic Neural Ordinary Differential Equationscited by 1
- 2022Learning Fine Scale Dynamics from Coarse Observations via Inner Recurrencecited by 1
- 2022Symplectically Integrated Symbolic Regression of Hamiltonian Dynamical Systemscited by 1
- 2024DDE-Find: Learning Delay Differential Equations from Noisy, Limited Datacited by 1
- 2026MVNN: A Measure-Valued Neural Network for Learning McKean-Vlasov Dynamics from Particle Datacited by 1
- 2021Accuracy and Architecture Studies of Residual Neural Network solving Ordinary Differential Equationscited by 0
- 2021Modelling Neuronal Behaviour with Time Series Regression: Recurrent Neural Networks on C. Elegans Datacited by 0
- 2022E2V-SDE: From Asynchronous Events to Fast and Continuous Video Reconstruction via Neural Stochastic Differential Equationscited by 0
- 2023Neural Delay Differential Equations: System Reconstruction and Image Classificationcited by 0
- 2023Physics informed Neural Networks applied to the description of wave-particle resonance in kinetic simulations of fusion plasmascited by 0
- 2024Recent Trends in Modelling the Continuous Time Series using Deep Learning: A Surveycited by 0
- 2024Deep Trees for (Un)structured Data: Tractability, Performance, and Interpretabilitycited by 0
- 2025Multi-Task Neural Architecture Search Using Architecture Embedding and Transfer Rankcited by 0
- 2026Autoregression-Free Neural Operators for Time-Dependent PDEs25 May 2026
- 2026MVNN: A Measure-Valued Neural Network for Learning McKean-Vlasov Dynamics from Particle Data1 Apr 2026
- 2025Deep Neural Networks Inspired by Differential Equations9 Oct 2025
- 2025DUE: A Deep Learning Framework and Library for Modeling Unknown Equations14 Apr 2025
- 2025Multi-Task Neural Architecture Search Using Architecture Embedding and Transfer Rank1 Apr 2025
- 2025A Survey of Sim-to-Real Methods in RL: Progress, Prospects and Challenges with Foundation Models18 Feb 2025
- 2024AsCAN: Asymmetric Convolution-Attention Networks for Efficient Recognition and Generation7 Nov 2024
- 2024Deep Trees for (Un)structured Data: Tractability, Performance, and Interpretability28 Oct 2024
- 2024Time-Series Forecasting, Knowledge Distillation, and Refinement within a Multimodal PDE Foundation Model17 Sep 2024
- 2024PROSE-FD: A Multimodal PDE Foundation Model for Learning Multiple Operators for Forecasting Fluid Dynamics15 Sep 2024
- 2024Recent Trends in Modelling the Continuous Time Series using Deep Learning: A Survey13 Sep 2024
- 2024LeMON: Learning to Learn Multi-Operator Networks28 Aug 2024
30 more
- 2024DDE-Find: Learning Delay Differential Equations from Noisy, Limited Data4 May 2024
- 2023Graph Neural Stochastic Differential Equations23 Aug 2023
- 2023Physics informed Neural Networks applied to the description of wave-particle resonance in kinetic simulations of fusion plasmas23 Aug 2023
- 2023Flow Map Learning for Unknown Dynamical Systems: Overview, Implementation, and Benchmarks20 Jul 2023
- 2023Neural Delay Differential Equations: System Reconstruction and Image Classification11 Apr 2023
- 2023Deep-OSG: Deep Learning of Operators in Semigroup7 Feb 2023
- 2023Learning PDE Solution Operator for Continuous Modeling of Time-Series2 Feb 2023
- 2022FINDE: Neural Differential Equations for Finding and Preserving Invariant Quantities1 Oct 2022
- 2022Symplectically Integrated Symbolic Regression of Hamiltonian Dynamical Systems4 Sep 2022
- 2022E2V-SDE: From Asynchronous Events to Fast and Continuous Video Reconstruction via Neural Stochastic Differential Equations15 Jun 2022
- 2022Learning Fine Scale Dynamics from Coarse Observations via Inner Recurrence3 Jun 2022
- 2022Deep Learning of Chaotic Systems from Partially-Observed Data12 May 2022
- 2022Robust Modeling of Unknown Dynamical Systems via Ensemble Averaged Learning7 Mar 2022
- 2022Modeling unknown dynamical systems with hidden parameters3 Feb 2022
- 2022Neural Piecewise-Constant Delay Differential Equations4 Jan 2022
- 2021Characteristic Neural Ordinary Differential Equations25 Nov 2021
- 2021Signature-Graph Networks22 Oct 2021
- 2021Conditioning of Random Feature Matrices: Double Descent and Generalization Error21 Oct 2021
- 2021Adaptive Group Lasso Neural Network Models for Functions of Few Variables and Time-Dependent Data24 Aug 2021
- 2021Data-driven reduced order modeling of environmental hydrodynamics using deep autoencoders and neural ODEs6 Jul 2021
- 2021Modelling Neuronal Behaviour with Time Series Regression: Recurrent Neural Networks on C. Elegans Data1 Jul 2021
- 2021Beyond Predictions in Neural ODEs: Identification and Interventions23 Jun 2021
- 2021Deep Neural Network Modeling of Unknown Partial Differential Equations in Nodal Space7 Jun 2021
- 2021Neural Ordinary Differential Equations for Data-Driven Reduced Order Modeling of Environmental Hydrodynamics22 Apr 2021
- 2021A Swarm Variant for the Schr"odinger Solver10 Apr 2021
- 2021The Discovery of Dynamics via Linear Multistep Methods and Deep Learning: Error Estimation21 Mar 2021
- 2021Learning orbital dynamics of binary black hole systems from gravitational wave measurements25 Feb 2021
- 2021Neural Delay Differential Equations22 Feb 2021
- 2021Neuro-Reachability of Networked Microgrids13 Jan 2021
- 2021Accuracy and Architecture Studies of Residual Neural Network solving Ordinary Differential Equations10 Jan 2021
- 2024PROSE-FD: A Multimodal PDE Foundation Model for Learning Multiple Operators for Forecasting Fluid Dynamicscited by 34
- 2021Neural Delay Differential Equationscited by 26
- 2021Deep Neural Network Modeling of Unknown Partial Differential Equations in Nodal Spacecited by 25
- 2023Flow Map Learning for Unknown Dynamical Systems: Overview, Implementation, and Benchmarkscited by 18
- 2021Beyond Predictions in Neural ODEs: Identification and Interventionscited by 15
- 2021The Discovery of Dynamics via Linear Multistep Methods and Deep Learning: Error Estimationcited by 14
- 2024LeMON: Learning to Learn Multi-Operator Networkscited by 14
- 2022FINDE: Neural Differential Equations for Finding and Preserving Invariant Quantitiescited by 12
- 2023Deep-OSG: Deep Learning of Operators in Semigroupcited by 11
- 2022Deep Learning of Chaotic Systems from Partially-Observed Datacited by 9
- 2025DUE: A Deep Learning Framework and Library for Modeling Unknown Equationscited by 8
- 2021Conditioning of Random Feature Matrices: Double Descent and Generalization Errorcited by 7
12 most cited of 40 All 40 (JSON)
- 2026Autoregression-Free Neural Operators for Time-Dependent PDEs25 May 2026
- 2026MVNN: A Measure-Valued Neural Network for Learning McKean-Vlasov Dynamics from Particle Data1 Apr 2026
- 2025Deep Neural Networks Inspired by Differential Equations9 Oct 2025
- 2025DUE: A Deep Learning Framework and Library for Modeling Unknown Equations14 Apr 2025
- 2025Multi-Task Neural Architecture Search Using Architecture Embedding and Transfer Rank1 Apr 2025
- 2024AsCAN: Asymmetric Convolution-Attention Networks for Efficient Recognition and Generation7 Nov 2024
- 2024Deep Trees for (Un)structured Data: Tractability, Performance, and Interpretability28 Oct 2024
- 2024PROSE-FD: A Multimodal PDE Foundation Model for Learning Multiple Operators for Forecasting Fluid Dynamics15 Sep 2024
- 2024Recent Trends in Modelling the Continuous Time Series using Deep Learning: A Survey13 Sep 2024
- 2024LeMON: Learning to Learn Multi-Operator Networks28 Aug 2024
- 2024DDE-Find: Learning Delay Differential Equations from Noisy, Limited Data4 May 2024
- 2023Graph Neural Stochastic Differential Equations23 Aug 2023
12 newest of 40 All 40 (JSON)