Diffusion-Generative Multi-Fidelity Learning for Physical Simulation
Not on the map. Why?
Abstract (arXiv)
Multi-fidelity surrogate learning is important for physical simulation related applications in that it avoids running numerical solvers from scratch, which is known to be costly, and it uses multi-fidelity examples for training and greatly reduces the cost of data collection. Despite the variety of existing methods, they all build a model to map the input parameters outright to the solution output. Inspired by the recent breakthrough in generative models, we take an alternative view and consider the solution output as generated from random noises. We develop a diffusion-generative multi-fidelity (DGMF) learning method based on stochastic differential equations (SDE), where the generation is a continuous denoising process. We propose a conditional score model to control the solution generation by the input parameters and the fidelity. By conditioning on additional inputs (temporal or spacial variables), our model can efficiently learn and predict multi-dimensional solution arrays. Our method naturally unifies discrete and continuous fidelity modeling. The advantage of our method in several typical applications shows a promising new direction for multi-fidelity learning.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 32 of its 62 references that are in the map. First posted on arXiv 9 Nov 2023.
Builds on
32 of 62 references.
References · 32
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Generative Adversarial Networkscited by 5,627
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2016Improved Techniques for Training GANscited by 2,970
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
20 more
- 2016Density estimation using Real NVPcited by 2,042
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
- 2014NICE: Non-linear Independent Components Estimationcited by 1,058
- 2022Diffusion Models in Vision: A Surveycited by 1,015
- 2016Pixel Recurrent Neural Networkscited by 816
- 2017Masked Autoregressive Flow for Density Estimationcited by 684
- 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 622
- 2015MADE: Masked Autoencoder for Distribution Estimationcited by 307
- 2021How to Train Your Energy-Based Modelscited by 274
- 2020Permutation Invariant Graph Generation via Score-Based Generative Modelingcited by 270
- 2016Learning in Implicit Generative Modelscited by 125
- 2019Deep Gaussian Processes for Multi-fidelity Modelingcited by 50
- 2020Deep Multi-Fidelity Active Learning of High-dimensional Outputscited by 22
- 2022Batch Multi-Fidelity Active Learning with Budget Constraintscited by 20
- 2022Multi-fidelity Hierarchical Neural Processescited by 15
- 2019Multi-resolution Multi-task Gaussian Processescited by 11
- 2018Non-linear process convolutions for multi-output Gaussian processescited by 10
- 2021Residual Gaussian Process: A Tractable Nonparametric Bayesian Emulator for Multi-fidelity Simulationscited by 8
- 2022Infinite-Fidelity Coregionalization for Physical Simulationcited by 7
Built on by
Citing papers per year: 2024: 2; 2025: 1.
3 papers.
- 2024Multi-Fidelity Residual Neural Processes for Scalable Surrogate Modelingcited by 13
- 2025Alignment Quality Index (AQI) : Beyond Refusals: AQI as an Intrinsic Alignment Diagnostic via Latent Geometry, Cluster Divergence, and Layer wise Pooled Representationscited by 8
- 2024Arbitrarily-Conditioned Multi-Functional Diffusion for Multi-Physics Emulationcited by 4
- 2025Alignment Quality Index (AQI) : Beyond Refusals: AQI as an Intrinsic Alignment Diagnostic via Latent Geometry, Cluster Divergence, and Layer wise Pooled Representations16 Jun 2025
- 2024Arbitrarily-Conditioned Multi-Functional Diffusion for Multi-Physics Emulation17 Oct 2024
- 2024Multi-Fidelity Residual Neural Processes for Scalable Surrogate Modeling29 Feb 2024