Conditional score-based diffusion models for solving inverse problems in mechanics
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
We propose a framework to perform Bayesian inference using conditional score-based diffusion models to solve a class of inverse problems in mechanics involving the inference of a specimen's spatially varying material properties from noisy measurements of its mechanical response to loading. Conditional score-based diffusion models are generative models that learn to approximate the score function of a conditional distribution using samples from the joint distribution. More specifically, the score functions corresponding to multiple realizations of the measurement are approximated using a single neural network, the so-called score network, which is subsequently used to sample the posterior distribution using an appropriate Markov chain Monte Carlo scheme based on Langevin dynamics. Training the score network only requires simulating the forward model. Hence, the proposed approach can accommodate black-box forward models and complex measurement noise. Moreover, once the score network has been trained, it can be re-used to solve the inverse problem for different realizations of the measurements. We demonstrate the efficacy of the proposed approach on a suite of high-dimensional inverse problems in mechanics that involve inferring heterogeneous material properties from noisy measurements. Some examples we consider involve synthetic data, while others include data collected from actual elastography experiments. Further, our applications demonstrate that the proposed approach can handle different measurement modalities, complex patterns in the inferred quantities, non-Gaussian and non-additive noise models, and nonlinear black-box forward models. The results show that the proposed framework can solve large-scale physics-based inverse problems efficiently.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 40 of its 86 references that are in the map. First posted on arXiv 19 Jun 2024.
Builds on
40 of 86 references.
Closest ancestors · 4
Same direction, newest first
- 2023A Variational Perspective on Solving Inverse Problems with Diffusion Models7 May
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problems29 Sep
- 2022Improving Diffusion Models for Inverse Problems using Manifold Constraints2 Jun
- 2021Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contraction9 Dec
Other references · 36
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2023GPT-4 Technical Reportcited by 18,132
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2021Image Super-Resolution via Iterative Refinementcited by 1,506
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
- 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
- 2022Diffusion Models in Vision: A Surveycited by 1,008
24 more
- 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 514
- 2019The frontier of simulation-based inferencecited by 490
- 2016RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentationcited by 463
- 2020Deep Learning Techniques for Inverse Problems in Imagingcited by 290
- 2022Diffusion models as plug-and-play priorscited by 230
- 2021Conditional Image Generation with Score-Based Diffusion Modelscited by 195
- 2022A Physics-informed Diffusion Model for High-fidelity Flow Field Reconstructioncited by 150
- 2024Physics-Informed Diffusion Modelscited by 88
- 2022Diffusion Models Beat GANs on Topology Optimizationcited by 79
- 2018Deep Bayesian Inversioncited by 60
- 2020Deep Probabilistic Imaging: Uncertainty Quantification and Multi-modal Solution Characterization for Computational Imagingcited by 57
- 2023CoCoGen: Physically-Consistent and Conditioned Score-based Generative Models for Forward and Inverse Problemscited by 54
- 2020Composing Normalizing Flows for Inverse Problemscited by 48
- 2023Inverse-design of nonlinear mechanical metamaterials via video denoising diffusion modelscited by 48
- 2023Diffusion Models for Non-autoregressive Text Generation: A Surveycited by 43
- 2020Conditional Sampling with Monotone GANs: from Generative Models to Likelihood-Free Inferencecited by 40
- 2020Solving inverse problems using conditional invertible neural networkscited by 37
- 2021Solution of Physics-based Bayesian Inverse Problems with Deep Generative Priorscited by 29
- 2023Denoising diffusion algorithm for inverse design of microstructures with fine-tuned nonlinear material propertiescited by 23
- 2022The efficacy and generalizability of conditional GANs for posterior inference in physics-based inverse problemscited by 15
- 2023A dimension-reduced variational approach for solving physics-based inverse problems using generative adversarial network priors and normalizing flowscited by 12
- 2022Bayesian Inversion for Nonlinear Imaging Models using Deep Generative Priorscited by 9
- 2023Solution of physics-based inverse problems using conditional generative adversarial networks with full gradient penaltycited by 7
- 2021Uncertainty quantification for ptychography using normalizing flowscited by 4
Built on by
Citing papers per year: 2024: 1; 2025: 3; 2026: 2.
6 papers.
- 2024Spatially-Aware Diffusion Models with Cross-Attention for Global Field Reconstruction with Sparse Observationscited by 13
- 2025Unifying and extending Diffusion Models through PDEs for solving Inverse Problemscited by 7
- 2025Autoregressive regularized score-based diffusion models for multi-scenarios fluid flow predictioncited by 2
- 2026Synergizing Transport-Based Generative Models and Latent Geometry for Stochastic Closure Modelingcited by 1
- 2025The Illusion of Fit: Spatially Resolved Assessment of Constitutive Model Validity in Elastography and Physics-Based Inverse Problemscited by 0
- 2026GenPANIS: A Latent-Variable Generative Framework for Forward and Inverse PDE Problems in Multiphase Mediacited by 0
- 2026Synergizing Transport-Based Generative Models and Latent Geometry for Stochastic Closure Modeling19 Feb 2026
- 2026GenPANIS: A Latent-Variable Generative Framework for Forward and Inverse PDE Problems in Multiphase Media16 Feb 2026
- 2025Autoregressive regularized score-based diffusion models for multi-scenarios fluid flow prediction30 May 2025
- 2025Unifying and extending Diffusion Models through PDEs for solving Inverse Problems10 Apr 2025
- 2025The Illusion of Fit: Spatially Resolved Assessment of Constitutive Model Validity in Elastography and Physics-Based Inverse Problems11 Feb 2025
- 2024Spatially-Aware Diffusion Models with Cross-Attention for Global Field Reconstruction with Sparse Observations30 Aug 2024
Similar, not cited
Close in wording, no citation either way
- 2023Conditional score-based diffusion models for Bayesian inference in infinite dimensions
- 2024An Unconditional Representation of the Conditional Score in Infinite-Dimensional Linear Inverse Problems
- 2024Taming Score-Based Diffusion Priors for Infinite-Dimensional Nonlinear Inverse Problems
- 2025Exact Evaluation of the Accuracy of Diffusion Models for Inverse Problems with Gaussian Data Distributions
- 2023Monte Carlo guided Diffusion for Bayesian linear inverse problems
- 2024Bayesian Conditioned Diffusion Models for Inverse Problems
- 2023Score-based Diffusion Models for Bayesian Image Reconstruction
- 2023Generative Hyperelasticity with Physics-Informed Probabilistic Diffusion Fields