Smooth and Sparse Latent Dynamics in Operator Learning with Jerk Regularization
Not on the map. Why?
Abstract (arXiv)
Spatiotemporal modeling is critical for understanding complex systems across various scientific and engineering disciplines, but governing equations are often not fully known or computationally intractable due to inherent system complexity. Data-driven reduced-order models (ROMs) offer a promising approach for fast and accurate spatiotemporal forecasting by computing solutions in a compressed latent space. However, these models often neglect temporal correlations between consecutive snapshots when constructing the latent space, leading to suboptimal compression, jagged latent trajectories, and limited extrapolation ability over time. To address these issues, this paper introduces a continuous operator learning framework that incorporates jerk regularization into the learning of the compressed latent space. This jerk regularization promotes smoothness and sparsity of latent space dynamics, which not only yields enhanced accuracy and convergence speed but also helps identify intrinsic latent space coordinates. Consisting of an implicit neural representation (INR)-based autoencoder and a neural ODE latent dynamics model, the framework allows for inference at any desired spatial or temporal resolution. The effectiveness of this framework is demonstrated through a two-dimensional unsteady flow problem governed by the Navier-Stokes equations, highlighting its potential to expedite high-fidelity simulations in various scientific and engineering applications.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 36 of its 68 references that are in the map. First posted on arXiv 23 Feb 2024.
Builds on
36 of 68 references.
References · 36
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 935
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
- 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
24 more
- 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 470
- 2019Machine Learning for Fluid Mechanicscited by 380
- 2022Message Passing Neural PDE Solverscited by 368
- 2022Towards Multi-spatiotemporal-scale Generalized PDE Modelingcited by 190
- 2021Scalars are universal: Equivariant machine learning, structured like classical physicscited by 127
- 2022Physics-Informed Deep Neural Operator Networkscited by 110
- 2021PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEscited by 97
- 2022Learning Operators with Coupled Attentioncited by 88
- 2022NOMAD: Nonlinear Manifold Decoders for Operator Learningcited by 81
- 2023Operator Learning with Neural Fields: Tackling PDEs on General Geometriescited by 80
- 2022Continuous PDE Dynamics Forecasting with Implicit Neural Representationscited by 71
- 2021Encoding physics to learn reaction-diffusion processescited by 61
- 2023Learning Physical Models that Can Respect Conservation Lawscited by 58
- 2022CROM: Continuous Reduced-Order Modeling of PDEs Using Implicit Neural Representationscited by 56
- 2021Optimal control of PDEs using physics-informed neural networkscited by 51
- 2022Neural Implicit Flow: a mesh-agnostic dimensionality reduction paradigm of spatio-temporal datacited by 37
- 2021Physics-informed Convolutional Neural Networks for Temperature Field Prediction of Heat Source Layout without Labeled Datacited by 31
- 2022gLaSDI: Parametric Physics-informed Greedy Latent Space Dynamics Identificationcited by 30
- 2023Self-Supervised Learning with Lie Symmetries for Partial Differential Equationscited by 29
- 2023Physics informed WNOcited by 26
- 2023Learning Nonlinear Projections for Reduced-Order Modeling of Dynamical Systems using Constrained Autoencoderscited by 16
- 2023Evolve Smoothly, Fit Consistently: Learning Smooth Latent Dynamics For Advection-Dominated Systemscited by 14
- 2022An unsupervised latent/output physics-informed convolutional-LSTM network for solving partial differential equations using peridynamic differential operatorcited by 7
- 2023Learning Lie Group Symmetry Transformations with Neural Networkscited by 6
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.