mlsanityData to 14 Oct 2026

Diffusion-Generative Multi-Fidelity Learning for Physical Simulation

arXiv 2311.05606 ↗First posted 9 Nov 2023cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Multi-fidelity surrogate learning is important for physical simulation related applications in that it avoids running numerical solvers from scratch, which is known to be costly, and it uses multi-fidelity examples for training and greatly reduces the cost of data collection. Despite the variety of existing methods, they all build a model to map the input parameters outright to the solution output. Inspired by the recent breakthrough in generative models, we take an alternative view and consider the solution output as generated from random noises. We develop a diffusion-generative multi-fidelity (DGMF) learning method based on stochastic differential equations (SDE), where the generation is a continuous denoising process. We propose a conditional score model to control the solution generation by the input parameters and the fidelity. By conditioning on additional inputs (temporal or spacial variables), our model can efficiently learn and predict multi-dimensional solution arrays. Our method naturally unifies discrete and continuous fidelity modeling. The advantage of our method in several typical applications shows a promising new direction for multi-fidelity learning.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 32 of its 62 references that are in the map. First posted on arXiv 9 Nov 2023.

Builds on

32 of 62 references.

References · 32

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  7. 2022Generative Adversarial Networkscited by 5,627
  8. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  9. 2013Auto-Encoding Variational Bayescited by 4,053
  10. 2018Neural Ordinary Differential Equationscited by 3,779
  11. 2016Improved Techniques for Training GANscited by 2,970
  12. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
20 more
  1. 2016Density estimation using Real NVPcited by 2,042
  2. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
  3. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
  4. 2014NICE: Non-linear Independent Components Estimationcited by 1,058
  5. 2022Diffusion Models in Vision: A Surveycited by 1,015
  6. 2016Pixel Recurrent Neural Networkscited by 816
  7. 2017Masked Autoregressive Flow for Density Estimationcited by 684
  8. 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 622
  9. 2015MADE: Masked Autoencoder for Distribution Estimationcited by 307
  10. 2021How to Train Your Energy-Based Modelscited by 274
  11. 2020Permutation Invariant Graph Generation via Score-Based Generative Modelingcited by 270
  12. 2016Learning in Implicit Generative Modelscited by 125
  13. 2019Deep Gaussian Processes for Multi-fidelity Modelingcited by 50
  14. 2020Deep Multi-Fidelity Active Learning of High-dimensional Outputscited by 22
  15. 2022Batch Multi-Fidelity Active Learning with Budget Constraintscited by 20
  16. 2022Multi-fidelity Hierarchical Neural Processescited by 15
  17. 2019Multi-resolution Multi-task Gaussian Processescited by 11
  18. 2018Non-linear process convolutions for multi-output Gaussian processescited by 10
  19. 2021Residual Gaussian Process: A Tractable Nonparametric Bayesian Emulator for Multi-fidelity Simulationscited by 8
  20. 2022Infinite-Fidelity Coregionalization for Physical Simulationcited by 7

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 1.

3 papers.