mlsanityData to 14 Oct 2026

Deep Adaptive Dimension Reduction for Bayesian Inference in Inverse Problems

arXiv 2605.29373 ↗First posted 28 May 2026cs.LG cs.NA math.NAcited by 0

Not on the map. Why?

Abstract (arXiv)

Solving high-dimensional PDE-governed inverse problems is often challenging due to complex non-Gaussian posterior distributions, expensive forward model evaluations, and misspecified prior information. To address these issues, we propose a deep adaptive dimension-reduction Bayesian inference framework based on the Variational Flow (VF) model. Since standard normalizing flows are restricted by bijective mappings and cannot directly reduce dimensions, VF overcomes this limitation by integrating VAE-based nonlinear dimension reduction with dual normalizing flows for the latent prior and encoder. This design provides a strictly higher evidence lower bound than VAE and allows more flexible approximation of complex posterior distributions. We further introduce an iterative prior updating strategy that gradually moves the prior mean toward high-probability posterior regions, avoiding manual prior tuning. These components form a closed adaptive loop together with an adaptively fine-tuned Fourier Neural Operator (FNO) surrogate: VF generates posterior-concentrated samples to refine the surrogate, while the updated surrogate further improves posterior inference. Numerical experiments on a 100-dimensional Rosenbrock problem and three standard PDE-governed inverse problems show that our method delivers competitive or superior accuracy compared with MCMC, UKI, and SVGD baselines across all tested configurations, with the most pronounced advantages emerging in challenging scenarios such as high-noise observations and high-dimensional parameter spaces.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 44 references that are in the map. First posted on arXiv 28 May 2026.

Builds on

30 of 44 references.

References · 30

  1. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  2. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  3. 2015Variational Inference with Normalizing Flowscited by 2,170
  4. 2016Density estimation using Real NVPcited by 2,042
  5. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  6. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
  7. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,323
  8. 2014NICE: Non-linear Independent Components Estimationcited by 1,058
  9. 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 640
  10. 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 540
  11. 2016Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithmcited by 507
  12. 2019Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Datacited by 262
18 more
  1. 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 252
  2. 2020Stochastic Normalizing Flowscited by 157
  3. 2017Stein Variational Gradient Descent as Gradient Flowcited by 152
  4. 2020Coupling-based Invertible Neural Networks Are Universal Diffeomorphism Approximatorscited by 85
  5. 2021DAS-PINNs: A deep adaptive sampling method for solving high-dimensional partial differential equationscited by 66
  6. 2024Protein Conformation Generation via Force-Guided SE(3) Diffusion Modelscited by 45
  7. 2020The Expressive Power of a Class of Normalizing Flow Modelscited by 35
  8. 2019Solving Bayesian Inverse Problems via Variational Autoencoderscited by 32
  9. 2021Adaptive deep density approximation for Fokker-Planck equationscited by 28
  10. 2022Residual-based error correction for neural operator accelerated infinite-dimensional Bayesian inverse problemscited by 21
  11. 2023Learning in latent spaces improves the predictive accuracy of deep neural operatorscited by 19
  12. 2021Bayesian multiscale deep generative model for the solution of high-dimensional inverse problemscited by 12
  13. 2023Adaptive operator learning for infinite-dimensional Bayesian inverse problemscited by 11
  14. 2016Hierarchical Bayesian Level Set Inversioncited by 6
  15. 2024Deep adaptive sampling for surrogate modeling without labeled datacited by 5
  16. 2023VI-DGP: A variational inference method with deep generative prior for solving high-dimensional inverse problemscited by 4
  17. 2025Estimating Committor Functions via Deep Adaptive Sampling on Rare Transition Pathscited by 4
  18. 2025Stable Derivative Free Gaussian Mixture Variational Inference for Bayesian Inverse Problemscited by 3

Built on by

Not cited yet.