Generative AI-enhanced Probabilistic Multi-Fidelity Surrogate Modeling Via Transfer Learning
Not on the map. Why?
Abstract (arXiv)
The performance of machine learning surrogates is critically dependent on data quality and quantity. This presents a major challenge, as high-fidelity (HF) data is often scarce and computationally expensive to acquire, while low-fidelity (LF) data is abundant but less accurate. To address this data-scarcity problem, we propose a probabilistic multi-fidelity surrogate modeling framework that integrates transfer learning with generative modeling. We employ a normalizing flow (NF) generative model as the backbone, which is trained in two phases: (i) the NF is first pretrained on a large LF dataset to learn a probabilistic forward model; (ii) the pretrained model is then fine-tuned on a small HF dataset, allowing it to correct for LF--HF discrepancies via knowledge transfer. To relax the dimension-preserving constraint of standard bijective NFs, we integrate surjective (dimension-reducing) layers with standard coupling blocks. This architecture enables learned dimension reduction while preserving the ability to train with exact likelihoods. The resulting surrogate provides fast probabilistic predictions with quantified uncertainty and significantly outperforms LF-only baselines while using fewer HF evaluations. We validate the approach for two benchmark systems: a rail-sleeper-ballast and a reinforced concrete slab. For both applications, we combine many coarse-mesh (LF) simulations with a limited set of fine-mesh (HF) simulations. The proposed model achieves probabilistic predictions with HF accuracy, demonstrating a practical path toward data-efficient, generative AI-driven surrogates for complex engineering systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 35 references that are in the map. First posted on arXiv 20 Jan 2026.
Builds on
12 of 35 references.
References · 12
- 2016Density estimation using Real NVPcited by 2,029
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
- 2017Masked Autoregressive Flow for Density Estimationcited by 680
- 2016Tutorial on Variational Autoencoderscited by 404
- 2018Survey of multifidelity methods in uncertainty propagation, inference, and optimizationcited by 141
- 2020SurVAE Flows: Surjections to Bridge the Gap between VAEs and Flowscited by 71
- 2022Parallel Spatio-Temporal Attention-Based TCN for Multivariate Time Series Predictioncited by 12
- 2023Simulation-based Inference for High-dimensional Data using Surjective Sequential Neural Likelihood Estimationcited by 8
- 2024Randomized Physics-Informed Neural Networks for Bayesian Data Assimilationcited by 7
- 2025Data-Efficient Deep Operator Network for Unsteady Flow: A Multi-Fidelity Approach with Physics-Guided Subsamplingcited by 5
- 2021Funnels: Exact maximum likelihood with dimensionality reductioncited by 4
- 2024Solving High-dimensional Inverse Problems Using Amortized Likelihood-free Inference with Noisy and Incomplete Datacited by 3
Built on by
Not cited yet.