mlsanityData to 14 Oct 2026

Multi-fidelity reduced-order surrogate modeling

arXiv 2309.00325 ↗First posted 1 Sep 2023cs.LG cs.NA math.NAcited by 18

Not on the map. Why?

Abstract (arXiv)

High-fidelity numerical simulations of partial differential equations (PDEs) given a restricted computational budget can significantly limit the number of parameter configurations considered and/or time window evaluated for modeling a given system. Multi-fidelity surrogate modeling aims to leverage less accurate, lower-fidelity models that are computationally inexpensive in order to enhance predictive accuracy when high-fidelity data are limited or scarce. However, low-fidelity models, while often displaying important qualitative spatio-temporal features, fail to accurately capture the onset of instability and critical transients observed in the high-fidelity models, making them impractical as surrogate models. To address this shortcoming, we present a new data-driven strategy that combines dimensionality reduction with multi-fidelity neural network surrogates. The key idea is to generate a spatial basis by applying the classical proper orthogonal decomposition (POD) to high-fidelity solution snapshots, and approximate the dynamics of the reduced states - time-parameter-dependent expansion coefficients of the POD basis - using a multi-fidelity long-short term memory (LSTM) network. By mapping low-fidelity reduced states to their high-fidelity counterpart, the proposed reduced-order surrogate model enables the efficient recovery of full solution fields over time and parameter variations in a non-intrusive manner. The generality and robustness of this method is demonstrated by a collection of parametrized, time-dependent PDE problems where the low-fidelity model can be defined by coarser meshes and/or time stepping, as well as by misspecified physical features. Importantly, the onset of instabilities and transients are well captured by this surrogate modeling technique.

Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 26 of its 86 references that are in the map. First posted on arXiv 1 Sep 2023.

Builds on

26 of 86 references.

References · 26

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2018Data-Driven Forecasting of High-Dimensional Chaotic Systems with Long Short-Term Memory Networkscited by 155
  4. 2017Linearly-Recurrent Autoencoder Networks for Learning Dynamicscited by 145
  5. 2018Survey of multifidelity methods in uncertainty propagation, inference, and optimizationcited by 142
  6. 2020A comprehensive deep learning-based approach to reduced order modeling of nonlinear time-dependent parametrized PDEscited by 105
  7. 2019Lift & Learn: Physics-informed machine learning for large-scale nonlinear dynamical systemscited by 96
  8. 2020Multiscale Simulations of Complex Systems by Learning their Effective Dynamicscited by 86
  9. 2021POD-DL-ROM: enhancing deep learning-based reduced order models for nonlinear parametrized PDEs by proper orthogonal decompositioncited by 79
  10. 2020Multi-fidelity Bayesian Neural Networks: Algorithms and Applicationscited by 59
  11. 2022Discovering Governing Equations from Partial Measurements with Deep Delay Autoencoderscited by 58
  12. 2015Learning Natural Language Inference with LSTMcited by 51
14 more
  1. 2016Inferring solutions of differential equations using noisy multi-fidelity datacited by 38
  2. 2021Multi-fidelity regression using artificial neural networks: efficient approximation of parameter-dependent output quantitiescited by 31
  3. 2023GPLaSDI: Gaussian Process-based Interpretable Latent Space Dynamics Identification through Deep Autoencodercited by 30
  4. 2022Reduced order modeling of parametrized systems through autoencoders and SINDy approach: continuation of periodic solutionscited by 29
  5. 2022Bayesian autoencoders for data-driven discovery of coordinates, governing equations and fundamental constantscited by 24
  6. 2020Multi-fidelity Generative Deep Learning Turbulent Flowscited by 21
  7. 2014Data-Driven Model Reduction for the Bayesian Solution of Inverse Problemscited by 20
  8. 2022Bayesian operator inference for data-driven reduced-order modelingcited by 19
  9. 2022Multi-fidelity surrogate modeling using long short-term memory networkscited by 18
  10. 2021Real-time simulation of parameter-dependent fluid flows through deep learning-based reduced order modelscited by 12
  11. 2014Preserving Lagrangian structure in nonlinear model reduction with application to structural dynamicscited by 10
  12. 2021Model Order Reduction based on Runge-Kutta Neural Networkcited by 9
  13. 2022Deep Kernel Learning of Dynamical Models from High-Dimensional Noisy Datacited by 6
  14. 2021Fast active thermal cloaking through PDE-constrained optimization and reduced-order modelingcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 4; 2025: 9; 2026: 5.

18 papers.

Sort:

By area:

  1. 2026RealPDEBench: A Benchmark for Complex Physical Systems with Real-World Datacited by 16
  2. 2024Multi-fidelity physics constrained neural networks for dynamical systemscited by 5
  3. 2025A Kernel-based Resource-efficient Neural Surrogate for Multi-fidelity Prediction of Aerodynamic Fieldcited by 3
  4. 2025SMRS: advocating a unified reporting standard for surrogate models in the artificial intelligence eracited by 2
  5. 2025Multi-fidelity Reinforcement Learning Control for Complex Dynamical Systemscited by 2
  6. 2025Progressive multi-fidelity learning with neural networks for physical system predictionscited by 2
  7. 2024Multi-Hierarchical Surrogate Learning for Structural Dynamical Crash Simulations Using Graph Convolutional Neural Networkscited by 1
  8. 2024Recurrent Deep Kernel Learning of Dynamical Systemscited by 1
  9. 2024Multifidelity digital twin for real-time monitoring of structural dynamics in aquaculture net cagescited by 1
  10. 2025Towards scientific machine learning for granular material simulations -- challenges and opportunitiescited by 1
  11. 2025Multi-Fidelity Delayed Acceptance: hierarchical MCMC sampling for Bayesian inverse problems combining multiple solvers through deep neural networkscited by 1
  12. 2026Multi-Fidelity SINDy: Sparse Discovery of Nonlinear Dynamical Systems with Fidelity-Weighted Measurementscited by 1
6 more
  1. 2025On Some Tunable Multi-fidelity Bayesian Optimization Frameworkscited by 0
  2. 2025Interpretable epistemic uncertainty decomposition in sequential generative models via polynomial chaos surrogatescited by 0
  3. 2025Multi-fidelity aerodynamic data fusion by autoencoder transfer learningcited by 0
  4. 2026Investigating Nonlinear Quenching Effects on Polar Field Buildup in the Sun Using Physics-Informed Neural Networkscited by 0
  5. 2026Multi-Fidelity Learning with Shallow Recurrent Decoders for Multi-Physics Applicationscited by 0
  6. 2026Cardiovascular Digital Twins from Physics Based to Data Driven Approachescited by 0