On the role of memorization in learned priors for geophysical inverse problems
Not on the map. Why?
Abstract (arXiv)
Learned priors based on deep generative models offer data-driven regularization for seismic inversion, but training them requires a dataset of representative subsurface models -- a resource that is inherently scarce in geoscience applications. Since the training objective of most generative models can be cast as maximum likelihood on a finite dataset, any such model risks converging to the empirical distribution -- effectively memorizing the training examples rather than learning the underlying geological distribution. We show that the posterior under such a memorized prior reduces to a reweighted empirical distribution -- i.e., a likelihood-weighted lookup among the stored training examples. For diffusion models specifically, memorization yields a Gaussian mixture prior in closed form, and linearizing the forward operator around each training example gives a Gaussian mixture posterior whose components have widths and shifts governed by the local Jacobian. We validate these predictions on a stylized inverse problem and demonstrate the consequences of memorization through diffusion posterior sampling for full waveform inversion.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 31 references that are in the map. First posted on arXiv 20 Mar 2026.
Builds on
18 of 31 references.
References · 18
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2015Variational Inference with Normalizing Flowscited by 2,170
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
- 2023Self-Consuming Generative Models Go MADcited by 250
- 2024Detecting, Explaining, and Mitigating Memorization in Diffusion Modelscited by 95
- 2025Why Diffusion Models Don't Memorize: The Role of Implicit Dynamical Regularization in Trainingcited by 81
- 2018Stochastic seismic waveform inversion using generative adversarial networks as a geological priorcited by 48
- 2025Memorization and Regularization in Generative Diffusion Modelscited by 40
- 2023Conditional score-based diffusion models for Bayesian inference in infinite dimensionscited by 38
- 2022Reliable amortized variational inference with physics-based latent distribution correctioncited by 25
6 more
- 2021Deep Bayesian inference for seismic imaging with taskscited by 12
- 2023WISE: full-Waveform variational Inference via Subsurface Extensionscited by 10
- 2024WISER: multimodal variational inference for full-waveform inversion without dimensionality reductioncited by 6
- 2025Geophysical inverse problems with measurement-guided diffusion modelscited by 6
- 2026Error Analysis of Bayesian Inverse Problems with Generative Priorscited by 2
- 2026Dual-space posterior sampling for Bayesian inference in constrained inverse problemscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Diffusion models for multivariate subsurface generation and efficient probabilistic inversion
- 2023A prior regularized full waveform inversion using generative diffusion models
- 2024Controllable seismic velocity synthesis using generative diffusion models
- 2024Geological and Well prior assisted full waveform inversion using conditional diffusion models
- 2026Decoupled Latent Optimization of Diffusion Models for Full Waveform Inversion
- 2026Structure-aware Bayesian full waveform inversion via diffusion-regularized Stein variational gradient descent
- 2025Diffusion prior as a direct regularization term for FWI
- 2024Propagating the prior from shallow to deep with a pre-trained velocity-model Generative Transformer network