mlsanityData to 7 Oct 2026

Conditional score-based diffusion models for solving inverse problems in mechanics

arXiv 2406.13154 ↗First posted 19 Jun 2024stat.ML cs.AI cs.LGcited by 6

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

We propose a framework to perform Bayesian inference using conditional score-based diffusion models to solve a class of inverse problems in mechanics involving the inference of a specimen's spatially varying material properties from noisy measurements of its mechanical response to loading. Conditional score-based diffusion models are generative models that learn to approximate the score function of a conditional distribution using samples from the joint distribution. More specifically, the score functions corresponding to multiple realizations of the measurement are approximated using a single neural network, the so-called score network, which is subsequently used to sample the posterior distribution using an appropriate Markov chain Monte Carlo scheme based on Langevin dynamics. Training the score network only requires simulating the forward model. Hence, the proposed approach can accommodate black-box forward models and complex measurement noise. Moreover, once the score network has been trained, it can be re-used to solve the inverse problem for different realizations of the measurements. We demonstrate the efficacy of the proposed approach on a suite of high-dimensional inverse problems in mechanics that involve inferring heterogeneous material properties from noisy measurements. Some examples we consider involve synthetic data, while others include data collected from actual elastography experiments. Further, our applications demonstrate that the proposed approach can handle different measurement modalities, complex patterns in the inferred quantities, non-Gaussian and non-additive noise models, and nonlinear black-box forward models. The results show that the proposed framework can solve large-scale physics-based inverse problems efficiently.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 40 of its 86 references that are in the map. First posted on arXiv 19 Jun 2024.

Builds on

40 of 86 references.

Closest ancestors · 4

Same direction, newest first

  1. 2023A Variational Perspective on Solving Inverse Problems with Diffusion Models7 May
  2. 2022Diffusion Posterior Sampling for General Noisy Inverse Problems29 Sep
  3. 2022Improving Diffusion Models for Inverse Problems using Manifold Constraints2 Jun
  4. 2021Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contraction9 Dec

Other references · 36

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  7. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  8. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  9. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  10. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  11. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
  12. 2022Diffusion Models in Vision: A Surveycited by 1,008
24 more
  1. 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 514
  2. 2019The frontier of simulation-based inferencecited by 490
  3. 2016RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentationcited by 463
  4. 2020Deep Learning Techniques for Inverse Problems in Imagingcited by 290
  5. 2022Diffusion models as plug-and-play priorscited by 230
  6. 2021Conditional Image Generation with Score-Based Diffusion Modelscited by 195
  7. 2022A Physics-informed Diffusion Model for High-fidelity Flow Field Reconstructioncited by 150
  8. 2024Physics-Informed Diffusion Modelscited by 88
  9. 2022Diffusion Models Beat GANs on Topology Optimizationcited by 79
  10. 2018Deep Bayesian Inversioncited by 60
  11. 2020Deep Probabilistic Imaging: Uncertainty Quantification and Multi-modal Solution Characterization for Computational Imagingcited by 57
  12. 2023CoCoGen: Physically-Consistent and Conditioned Score-based Generative Models for Forward and Inverse Problemscited by 54
  13. 2020Composing Normalizing Flows for Inverse Problemscited by 48
  14. 2023Inverse-design of nonlinear mechanical metamaterials via video denoising diffusion modelscited by 48
  15. 2023Diffusion Models for Non-autoregressive Text Generation: A Surveycited by 43
  16. 2020Conditional Sampling with Monotone GANs: from Generative Models to Likelihood-Free Inferencecited by 40
  17. 2020Solving inverse problems using conditional invertible neural networkscited by 37
  18. 2021Solution of Physics-based Bayesian Inverse Problems with Deep Generative Priorscited by 29
  19. 2023Denoising diffusion algorithm for inverse design of microstructures with fine-tuned nonlinear material propertiescited by 23
  20. 2022The efficacy and generalizability of conditional GANs for posterior inference in physics-based inverse problemscited by 15
  21. 2023A dimension-reduced variational approach for solving physics-based inverse problems using generative adversarial network priors and normalizing flowscited by 12
  22. 2022Bayesian Inversion for Nonlinear Imaging Models using Deep Generative Priorscited by 9
  23. 2023Solution of physics-based inverse problems using conditional generative adversarial networks with full gradient penaltycited by 7
  24. 2021Uncertainty quantification for ptychography using normalizing flowscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 2.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Conditional score-based diffusion models for Bayesian inference in infinite dimensions
  2. 2024An Unconditional Representation of the Conditional Score in Infinite-Dimensional Linear Inverse Problems
  3. 2024Taming Score-Based Diffusion Priors for Infinite-Dimensional Nonlinear Inverse Problems
  4. 2025Exact Evaluation of the Accuracy of Diffusion Models for Inverse Problems with Gaussian Data Distributions
  5. 2023Monte Carlo guided Diffusion for Bayesian linear inverse problems
  6. 2024Bayesian Conditioned Diffusion Models for Inverse Problems
  7. 2023Score-based Diffusion Models for Bayesian Image Reconstruction
  8. 2023Generative Hyperelasticity with Physics-Informed Probabilistic Diffusion Fields