Bounded nonlinear forecasts of partially observed geophysical systems with physics-constrained deep learning
Not on the map. Why?
Abstract (arXiv)
The complexity of real-world geophysical systems is often compounded by the fact that the observed measurements depend on hidden variables. These latent variables include unresolved small scales and/or rapidly evolving processes, partially observed couplings, or forcings in coupled systems. This is the case in ocean-atmosphere dynamics, for which unknown interior dynamics can affect surface observations. The identification of computationally-relevant representations of such partially-observed and highly nonlinear systems is thus challenging and often limited to short-term forecast applications. Here, we investigate the physics-constrained learning of implicit dynamical embeddings, leveraging neural ordinary differential equation (NODE) representations. A key objective is to constrain their boundedness, which promotes the generalization of the learned dynamics to arbitrary initial condition. The proposed architecture is implemented within a deep learning framework, and its relevance is demonstrated with respect to state-of-the-art schemes for different case-studies representative of geophysical dynamics.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 49 of its 117 references that are in the map. First posted on arXiv 11 Feb 2022.
Builds on
49 of 117 references.
References · 49
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2016Identity Mappings in Deep Residual Networkscited by 1,965
- 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 494
- 2020Time Series Forecasting With Deep Learning: A Surveycited by 459
- 2019Augmented Neural ODEscited by 397
- 2020B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Datacited by 335
- 2021Skillful Precipitation Nowcasting using Deep Generative Models of Radarcited by 311
- 2020hp-VPINNs: Variational Physics-Informed Neural Networks With Domain Decompositioncited by 236
- 2019Towards Physics-informed Deep Learning for Turbulent Flow Predictioncited by 204
- 2018Deep Neural Networks Motivated by Partial Differential Equationscited by 187
- 2016Structured Inference Networks for Nonlinear State Space Modelscited by 182
37 more
- 2017Learning Koopman Invariant Subspaces for Dynamic Mode Decompositioncited by 158
- 2017Sparse identification of nonlinear dynamics for model predictive control in the low-data limitcited by 140
- 2017Learning Deep Neural Network Representations for Koopman Operators of Nonlinear Dynamical Systemscited by 127
- 2020Incorporating Symmetry into Deep Dynamics Models for Improved Generalizationcited by 126
- 2016Sequential Neural Models with Stochastic Layerscited by 115
- 2020Forecasting Sequential Data using Consistent Koopman Autoencoderscited by 115
- 2020Learning Stable Deep Dynamics Modelscited by 111
- 2018Latent-space Physics: Towards Learning the Temporal Evolution of Fluid Flowcited by 97
- 2019Lift & Learn: Physics-informed machine learning for large-scale nonlinear dynamical systemscited by 96
- 2019ANODE: Unconditionally Accurate Memory-Efficient Gradients for Neural ODEscited by 84
- 2019On Robustness of Neural Ordinary Differential Equationscited by 83
- 2020Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: a case study with the Lorenz 96 modelcited by 74
- 2019Optimization for deep learning: theory and algorithmscited by 70
- 2019Physics-informed Autoencoders for Lyapunov-stable Fluid Flow Predictioncited by 67
- 2022Discovering Governing Equations from Partial Measurements with Deep Delay Autoencoderscited by 58
- 2020From Fourier to Koopman: Spectral Methods for Long-term Time Series Predictioncited by 50
- 2022LyaNet: A Lyapunov Framework for Training Neural ODEscited by 44
- 2020Learning Variational Data Assimilation Models and Solverscited by 36
- 2018Deep Neural Networks for Data-Driven Turbulence Modelscited by 35
- 2020Neural Closure Models for Dynamical Systemscited by 22
- 2019Episodic Learning with Control Lyapunov Functions for Uncertain Robotic Systemscited by 19
- 2019Learning Latent Dynamics for Partially-Observed Chaotic Systemscited by 18
- 2016Nonlinear Systems Identification Using Deep Dynamic Neural Networkscited by 14
- 2018Data-driven Discovery of Cyber-Physical Systemscited by 13
- 2020Constrained Neural Ordinary Differential Equations with Stability Guaranteescited by 13
- 2020Physical invariance in neural networks for subgrid-scale scalar flux modelingcited by 13
- 2019ANODEV2: A Coupled Neural ODE Evolution Frameworkcited by 12
- 2020Variational Deep Learning for the Identification and Reconstruction of Chaotic and Stochastic Dynamical Systems from Noisy and Partial Observationscited by 8
- 2020Stability Domains for Quadratic-Bilinear Reduced-Order Modelscited by 8
- 2020Analyzing Koopman approaches to physics-informed machine learning for long-term sea-surface temperature forecastingcited by 8
- 2017Bilinear residual Neural Network for the identification and forecasting of dynamical systemscited by 5
- 2020A Combined Data-driven and Physics-driven Method for Steady Heat Conduction Prediction using Deep Convolutional Neural Networkscited by 5
- 2020Joint learning of variational representations and solvers for inverse problems with partially-observed datacited by 4
- 2021Learning Runge-Kutta Integration Schemes for ODE Simulation and Identificationcited by 4
- 2017Sea Level Anomaly Prediction using Recurrent Neural Networkscited by 3
- 2018Sea surface temperature prediction and reconstruction using patch-level neural network representationscited by 3
- 2015Learning-based Reduced Order Model Stabilization for Partial Differential Equations: Application to the Coupled Burgers Equationcited by 1
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 1.
5 papers.
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a reviewcited by 75
- 2023Benchmarking sparse system identification with low-dimensional chaoscited by 19
- 2022Deep learning delay coordinate dynamics for chaotic attractors from partial observable datacited by 8
- 2024Dynamical system prediction from sparse observations using deep neural networks with Voronoi tessellation and physics constraintcited by 5
- 2023Autoregressive with Slack Time Series Model for Forecasting a Partially-Observed Dynamical Time Seriescited by 0
- 2024Dynamical system prediction from sparse observations using deep neural networks with Voronoi tessellation and physics constraint31 Aug 2024
- 2023Autoregressive with Slack Time Series Model for Forecasting a Partially-Observed Dynamical Time Series28 Jun 2023
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a review18 Mar 2023
- 2023Benchmarking sparse system identification with low-dimensional chaos4 Feb 2023
- 2022Deep learning delay coordinate dynamics for chaotic attractors from partial observable data20 Nov 2022