# A comprehensive deep learning-based approach to reduced order modeling of nonlinear time-dependent parametrized PDEs

arXiv: https://arxiv.org/abs/2001.04001 · HTML: https://mlsanity.com/paper/2001.04001/

## Key facts

- Cited by 105 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 12 Jan 2020.

## Built on by (most cited first, 30 of 105)

- [POD-DL-ROM: enhancing deep learning-based reduced order models for nonlinear parametrized PDEs by proper orthogonal decomposition](https://mlsanity.com/paper/2101.11845/) (2021)
- [A graph convolutional autoencoder approach to model order reduction for parametrized PDEs](https://mlsanity.com/paper/2305.08573/) (2023)
- [Deep Learning for Reduced Order Modelling and Efficient Temporal Evolution of Fluid Simulations](https://mlsanity.com/paper/2107.04556/) (2021)
- [Deep Learning Methods for Partial Differential Equations and Related Parameter Identification Problems](https://mlsanity.com/paper/2212.03130/) (2022)
- [Multi-fidelity regression using artificial neural networks: efficient approximation of parameter-dependent output quantities](https://mlsanity.com/paper/2102.13403/) (2021)
- [Reduced order modeling of parametrized systems through autoencoders and SINDy approach: continuation of periodic solutions](https://mlsanity.com/paper/2211.06786/) (2022)
- [A Deep Learning approach to Reduced Order Modelling of Parameter Dependent Partial Differential Equations](https://mlsanity.com/paper/2103.06183/) (2021)
- [Physics vs Distributions: Pareto Optimal Flow Matching with Physics Constraints](https://mlsanity.com/paper/2506.08604/) (2025)
- [Aero-Nef: Neural Fields for Rapid Aircraft Aerodynamics Simulations](https://mlsanity.com/paper/2407.19916/) (2024)
- [Reduced Order Modeling with Shallow Recurrent Decoder Networks](https://mlsanity.com/paper/2502.10930/) (2025)
- [Non-intrusive reduced order modeling of natural convection in porous media using convolutional autoencoders: comparison with linear subspace techniques](https://mlsanity.com/paper/2107.11460/) (2021)
- [A Comparison of Neural Network Architectures for Data-Driven Reduced-Order Modeling](https://mlsanity.com/paper/2110.03442/) (2021)
- [Accelerated replica exchange stochastic gradient Langevin diffusion enhanced Bayesian DeepONet for solving noisy parametric PDEs](https://mlsanity.com/paper/2111.02484/) (2021)
- [Deep Learning in Deterministic Computational Mechanics](https://mlsanity.com/paper/2309.15421/) (2023)
- [Weak-Form Latent Space Dynamics Identification](https://mlsanity.com/paper/2311.12880/) (2023)
- [Multi-fidelity surrogate modeling using long short-term memory networks](https://mlsanity.com/paper/2208.03115/) (2022)
- [Multi-fidelity reduced-order surrogate modeling](https://mlsanity.com/paper/2309.00325/) (2023)
- [Deep Learning-based surrogate models for parametrized PDEs: handling geometric variability through graph neural networks](https://mlsanity.com/paper/2308.01602/) (2023)
- [Learning Nonlinear Projections for Reduced-Order Modeling of Dynamical Systems using Constrained Autoencoders](https://mlsanity.com/paper/2307.15288/) (2023)
- [Deciphering and integrating invariants for neural operator learning with various physical mechanisms](https://mlsanity.com/paper/2311.14361/) (2023)
- [On latent dynamics learning in nonlinear reduced order modeling](https://mlsanity.com/paper/2408.15183/) (2024)
- [Symplectic model reduction of Hamiltonian systems using data-driven quadratic manifolds](https://mlsanity.com/paper/2305.15490/) (2023)
- [Real-time simulation of parameter-dependent fluid flows through deep learning-based reduced order models](https://mlsanity.com/paper/2106.05722/) (2021)
- [Reduced order modeling for flow and transport problems with Barlow Twins self-supervised learning](https://mlsanity.com/paper/2202.05460/) (2022)
- [Generalization Error Guaranteed Auto-Encoder-Based Nonlinear Model Reduction for Operator Learning](https://mlsanity.com/paper/2401.10490/) (2024)
- [An artificial neural network approach to bifurcating phenomena in computational fluid dynamics](https://mlsanity.com/paper/2109.10765/) (2021)
- [Operator inference with roll outs for learning reduced models from scarce and low-quality data](https://mlsanity.com/paper/2212.01418/) (2022)
- [Monte Carlo Neural PDE Solver for Learning PDEs via Probabilistic Representation](https://mlsanity.com/paper/2302.05104/) (2023)
- [Interpretable learning of effective dynamics for multiscale systems](https://mlsanity.com/paper/2309.05812/) (2023)
- [Long-time prediction of nonlinear parametrized dynamical systems by deep learning-based reduced order models](https://mlsanity.com/paper/2201.10215/) (2022)

## Abstract (arXiv)

Traditional reduced order modeling techniques such as the reduced basis (RB) method (relying, e.g., on proper orthogonal decomposition (POD)) suffer from severe limitations when dealing with nonlinear time-dependent parametrized PDEs, because of the fundamental assumption of linear superimposition of modes they are based on. For this reason, in the case of problems featuring coherent structures that propagate over time such as transport, wave, or convection-dominated phenomena, the RB method usually yields inefficient reduced order models (ROMs) if one aims at obtaining reduced order approximations sufficiently accurate compared to the high-fidelity, full order model (FOM) solution. To overcome these limitations, in this work, we propose a new nonlinear approach to set reduced order models by exploiting deep learning (DL) algorithms. In the resulting nonlinear ROM, which we refer to as DL-ROM, both the nonlinear trial manifold (corresponding to the set of basis functions in a linear ROM) as well as the nonlinear reduced dynamics (corresponding to the projection stage in a linear ROM) are learned in a non-intrusive way by relying on DL algorithms; the latter are trained on a set of FOM solutions obtained for different parameter values. In this paper, we show how to construct a DL-ROM for both linear and nonlinear time-dependent parametrized PDEs; moreover, we assess its accuracy on test cases featuring different parametrized PDE problems. Numerical results indicate that DL-ROMs whose dimension is equal to the intrinsic dimensionality of the PDE solutions manifold are able to approximate the solution of parametrized PDEs in situations where a huge number of POD modes would be necessary to achieve the same degree of accuracy.
