Stochastic Normalizing Flows for Inverse Problems: a Markov Chains Viewpoint
Not on the map. Why?
Abstract (arXiv)
To overcome topological constraints and improve the expressiveness of normalizing flow architectures, Wu, K"ohler and No'e introduced stochastic normalizing flows which combine deterministic, learnable flow transformations with stochastic sampling methods. In this paper, we consider stochastic normalizing flows from a Markov chain point of view. In particular, we replace transition densities by general Markov kernels and establish proofs via Radon-Nikodym derivatives which allows to incorporate distributions without densities in a sound way. Further, we generalize the results for sampling from posterior distributions as required in inverse problems. The performance of the proposed conditional stochastic normalizing flow is demonstrated by numerical examples.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 32 of its 55 references that are in the map. First posted on arXiv 23 Sep 2021.
Builds on
32 of 55 references.
References · 32
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2016Density estimation using Real NVPcited by 2,029
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
- 2017Masked Autoregressive Flow for Density Estimationcited by 680
- 2019Neural Spline Flowscited by 590
- 2018Invertible Residual Networkscited by 364
- 2020Deep Learning Techniques for Inverse Problems in Imagingcited by 290
- 2019Residual Flows for Invertible Generative Modelingcited by 256
- 2018cGANs with Projection Discriminatorcited by 253
20 more
- 2018Analyzing Inverse Problems with Invertible Neural Networkscited by 239
- 2018Neural Autoregressive Flowscited by 207
- 2020Stochastic Normalizing Flowscited by 156
- 2018Neural Importance Samplingcited by 154
- 2019Guided Image Generation with Conditional Invertible Neural Networkscited by 147
- 2021An Introduction to Deep Generative Modelingcited by 104
- 2021Annealed Flow Transport Monte Carlocited by 90
- 2020Understanding and Mitigating Exploding Inverses in Invertible Neural Networkscited by 71
- 2020SurVAE Flows: Surjections to Bridge the Gap between VAEs and Flowscited by 71
- 2018Explorations in Homeomorphic Variational Auto-Encodingcited by 65
- 2019Block Neural Autoregressive Flowcited by 62
- 2020Composing Normalizing Flows for Inverse Problemscited by 48
- 2017A-NICE-MC: Adversarial Training for MCMCcited by 36
- 2021Monte Carlo Variational Auto-Encoderscited by 36
- 2019HINT: Hierarchical Invertible Neural Transport for Density Estimation and Bayesian Inferencecited by 31
- 2020Stabilizing Invertible Neural Networks Using Mixture Modelscited by 30
- 2021Conditional Invertible Neural Networks for Diverse Image-to-Image Translationcited by 24
- 2017Continuous-Time Flows for Efficient Inference and Density Estimationcited by 21
- 2021Invertible Neural Networks versus MCMC for Posterior Reconstruction in Grazing Incidence X-Ray Fluorescencecited by 12
- 2021Multiscale Invertible Generative Networks for High-Dimensional Bayesian Inferencecited by 4
Built on by
Citing papers per year: 2021: 1; 2022: 4; 2023: 11; 2024: 6; 2025: 7; 2026: 3.
32 papers.
Sort:
By area:
- 2023A theory of continuous generative flow networkscited by 98
- 2023Multilevel Diffusion: Infinite Dimensional Score-Based Diffusion Models for Image Generationcited by 37
- 2024Conditional Wasserstein Distances with Applications in Bayesian OT Flow Matchingcited by 34
- 2023Posterior Sampling Based on Gradient Flows of the MMD with Negative Distance Kernelcited by 25
- 2021Generalized Normalizing Flows via Markov Chainscited by 23
- 2025Flower: A Flow-Matching Solver for Inverse Problemscited by 23
- 2022PatchNR: Learning from Very Few Images by Patch Normalizing Flow Regularizationcited by 22
- 2025Solving Inverse Problems via Diffusion-Based Priors: An Approximation-Free Ensemble Sampling Approachcited by 18
- 2023Manifold Learning by Mixture Models of VAEs for Inverse Problemscited by 16
- 2025On the Relation between Rectified Flows and Optimal Transportcited by 15
- 2023Conditional Generative Models are Provably Robust: Pointwise Guarantees for Bayesian Inverse Problemscited by 12
- 2023A Review of Change of Variable Formulas for Generative Modelingcited by 12
20 more
- 2024Annealing Flow Generative Models Towards Sampling High-Dimensional and Multi-Modal Distributionscited by 11
- 2022WPPNets and WPPFlows: The Power of Wasserstein Patch Priors for Superresolutioncited by 10
- 2023Neural Wasserstein Gradient Flows for Maximum Mean Discrepancies with Riesz Kernelscited by 9
- 2023Learning from small data sets: Patch-based regularizers in inverse problems for image reconstructioncited by 9
- 2024Importance Corrected Neural JKO Samplingcited by 7
- 2022Continuous Generative Neural Networks: A Wavelet-Based Architecture in Function Spacescited by 6
- 2022Proximal Residual Flows for Bayesian Inverse Problemscited by 5
- 2024Stability of Data-Dependent Ridge-Regularization for Inverse Problemscited by 5
- 2023NF-ULA: Langevin Monte Carlo with Normalizing Flow Prior for Imaging Inverse Problemscited by 4
- 2023Y-Diagonal Couplings: Approximating Posteriors with Conditional Wasserstein Distancescited by 3
- 2025Diffusion Models with Double Guidance: Generate with aggregated datasetscited by 2
- 2025A Mathematical Explanation of Transformerscited by 2
- 2026Conditional flow matching for physics-constrained inverse problems with finite training datacited by 2
- 2024Mixed Noise and Posterior Estimation with Conditional DeepGEMcited by 1
- 2025A Constraint-Preserving Neural Network Approach for Solving Mean-Field Games Equilibriumcited by 1
- 2025An invertible generative model for forward and inverse problemscited by 1
- 2023Learning variational autoencoders via MCMC speed measurescited by 0
- 2024Sampling from Boltzmann densities with physics informed low-rank formatscited by 0
- 2026Sampling via Stochastic Interpolants by Langevin-based Velocity and Initialization Estimation in Flow ODEscited by 0
- 2026Deep unfolding of MCMC kernels: scalable, modular & explainable GANs for high-dimensional posterior samplingcited by 0
- 2026Conditional flow matching for physics-constrained inverse problems with finite training data14 Mar 2026
- 2026Deep unfolding of MCMC kernels: scalable, modular & explainable GANs for high-dimensional posterior sampling24 Feb 2026
- 2026Sampling via Stochastic Interpolants by Langevin-based Velocity and Initialization Estimation in Flow ODEs13 Jan 2026
- 2025A Mathematical Explanation of Transformers5 Oct 2025
- 2025Flower: A Flow-Matching Solver for Inverse Problems30 Sep 2025
- 2025An invertible generative model for forward and inverse problems4 Sep 2025
- 2025Solving Inverse Problems via Diffusion-Based Priors: An Approximation-Free Ensemble Sampling Approach4 Jun 2025
- 2025On the Relation between Rectified Flows and Optimal Transport26 May 2025
- 2025Diffusion Models with Double Guidance: Generate with aggregated datasets19 May 2025
- 2025A Constraint-Preserving Neural Network Approach for Solving Mean-Field Games Equilibrium29 Jan 2025
- 2024Sampling from Boltzmann densities with physics informed low-rank formats10 Dec 2024
- 2024Annealing Flow Generative Models Towards Sampling High-Dimensional and Multi-Modal Distributions30 Sep 2024
20 more
- 2024Importance Corrected Neural JKO Sampling29 Jul 2024
- 2024Stability of Data-Dependent Ridge-Regularization for Inverse Problems18 Jun 2024
- 2024Conditional Wasserstein Distances with Applications in Bayesian OT Flow Matching27 Mar 2024
- 2024Mixed Noise and Posterior Estimation with Conditional DeepGEM5 Feb 2024
- 2023Learning from small data sets: Patch-based regularizers in inverse problems for image reconstruction27 Dec 2023
- 2023Y-Diagonal Couplings: Approximating Posteriors with Conditional Wasserstein Distances20 Oct 2023
- 2023Posterior Sampling Based on Gradient Flows of the MMD with Negative Distance Kernel4 Oct 2023
- 2023Learning variational autoencoders via MCMC speed measures26 Aug 2023
- 2023A Review of Change of Variable Formulas for Generative Modeling4 Aug 2023
- 2023NF-ULA: Langevin Monte Carlo with Normalizing Flow Prior for Imaging Inverse Problems17 Apr 2023
- 2023Conditional Generative Models are Provably Robust: Pointwise Guarantees for Bayesian Inverse Problems28 Mar 2023
- 2023Manifold Learning by Mixture Models of VAEs for Inverse Problems27 Mar 2023
- 2023Multilevel Diffusion: Infinite Dimensional Score-Based Diffusion Models for Image Generation8 Mar 2023
- 2023A theory of continuous generative flow networks30 Jan 2023
- 2023Neural Wasserstein Gradient Flows for Maximum Mean Discrepancies with Riesz Kernels27 Jan 2023
- 2022Proximal Residual Flows for Bayesian Inverse Problems30 Nov 2022
- 2022Continuous Generative Neural Networks: A Wavelet-Based Architecture in Function Spaces29 May 2022
- 2022PatchNR: Learning from Very Few Images by Patch Normalizing Flow Regularization24 May 2022
- 2022WPPNets and WPPFlows: The Power of Wasserstein Patch Priors for Superresolution20 Jan 2022
- 2021Generalized Normalizing Flows via Markov Chains24 Nov 2021
- 2023Multilevel Diffusion: Infinite Dimensional Score-Based Diffusion Models for Image Generationcited by 37
- 2024Conditional Wasserstein Distances with Applications in Bayesian OT Flow Matchingcited by 34
- 2025Flower: A Flow-Matching Solver for Inverse Problemscited by 23
- 2025Solving Inverse Problems via Diffusion-Based Priors: An Approximation-Free Ensemble Sampling Approachcited by 18
- 2025On the Relation between Rectified Flows and Optimal Transportcited by 15
- 2025Diffusion Models with Double Guidance: Generate with aggregated datasetscited by 2
- 2026Conditional flow matching for physics-constrained inverse problems with finite training datacited by 2
- 2026Conditional flow matching for physics-constrained inverse problems with finite training data14 Mar 2026
- 2025Flower: A Flow-Matching Solver for Inverse Problems30 Sep 2025
- 2025Solving Inverse Problems via Diffusion-Based Priors: An Approximation-Free Ensemble Sampling Approach4 Jun 2025
- 2025On the Relation between Rectified Flows and Optimal Transport26 May 2025
- 2025Diffusion Models with Double Guidance: Generate with aggregated datasets19 May 2025
- 2024Conditional Wasserstein Distances with Applications in Bayesian OT Flow Matching27 Mar 2024
- 2023Multilevel Diffusion: Infinite Dimensional Score-Based Diffusion Models for Image Generation8 Mar 2023
- 2023A theory of continuous generative flow networkscited by 98
- 2023Posterior Sampling Based on Gradient Flows of the MMD with Negative Distance Kernelcited by 25
- 2021Generalized Normalizing Flows via Markov Chainscited by 23
- 2022PatchNR: Learning from Very Few Images by Patch Normalizing Flow Regularizationcited by 22
- 2023Manifold Learning by Mixture Models of VAEs for Inverse Problemscited by 16
- 2023Conditional Generative Models are Provably Robust: Pointwise Guarantees for Bayesian Inverse Problemscited by 12
- 2023A Review of Change of Variable Formulas for Generative Modelingcited by 12
- 2024Annealing Flow Generative Models Towards Sampling High-Dimensional and Multi-Modal Distributionscited by 11
- 2022WPPNets and WPPFlows: The Power of Wasserstein Patch Priors for Superresolutioncited by 10
- 2023Neural Wasserstein Gradient Flows for Maximum Mean Discrepancies with Riesz Kernelscited by 9
- 2023Learning from small data sets: Patch-based regularizers in inverse problems for image reconstructioncited by 9
- 2024Importance Corrected Neural JKO Samplingcited by 7
12 most cited of 25 All 25 (JSON)
- 2026Deep unfolding of MCMC kernels: scalable, modular & explainable GANs for high-dimensional posterior sampling24 Feb 2026
- 2026Sampling via Stochastic Interpolants by Langevin-based Velocity and Initialization Estimation in Flow ODEs13 Jan 2026
- 2025A Mathematical Explanation of Transformers5 Oct 2025
- 2025An invertible generative model for forward and inverse problems4 Sep 2025
- 2025A Constraint-Preserving Neural Network Approach for Solving Mean-Field Games Equilibrium29 Jan 2025
- 2024Sampling from Boltzmann densities with physics informed low-rank formats10 Dec 2024
- 2024Annealing Flow Generative Models Towards Sampling High-Dimensional and Multi-Modal Distributions30 Sep 2024
- 2024Importance Corrected Neural JKO Sampling29 Jul 2024
- 2024Stability of Data-Dependent Ridge-Regularization for Inverse Problems18 Jun 2024
- 2024Mixed Noise and Posterior Estimation with Conditional DeepGEM5 Feb 2024
- 2023Learning from small data sets: Patch-based regularizers in inverse problems for image reconstruction27 Dec 2023
- 2023Y-Diagonal Couplings: Approximating Posteriors with Conditional Wasserstein Distances20 Oct 2023
12 newest of 25 All 25 (JSON)