Variational Implicit Processes
Not on the map. Why?
Abstract (arXiv)
We introduce the implicit processes (IPs), a stochastic process that places implicitly defined multivariate distributions over any finite collections of random variables. IPs are therefore highly flexible implicit priors over functions, with examples including data simulators, Bayesian neural networks and non-linear transformations of stochastic processes. A novel and efficient approximate inference algorithm for IPs, namely the variational implicit processes (VIPs), is derived using generalised wake-sleep updates. This method returns simple update equations and allows scalable hyper-parameter learning with stochastic optimization. Experiments show that VIPs return better uncertainty estimates and lower errors over existing inference methods for challenging models such as Bayesian neural networks, and Gaussian processes.
Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 7; 2023: 9; 2024: 7; 2025: 5; 2026: 4.
41 papers.
Sort:
By area:
- 2021Bayesian Neural Network Priors Revisitedcited by 121
- 2021Priors in Bayesian Deep Learning: A Reviewcited by 101
- 2022Do Bayesian Neural Networks Need To Be Fully Stochastic?cited by 63
- 2023Tractable Function-Space Variational Inference in Bayesian Neural Networkscited by 41
- 2021The Gaussian Neural Processcited by 34
- 2023BayesDAG: Gradient-Based Posterior Inference for Causal Discoverycited by 33
- 2023A Rigorous Link between Deep Ensembles and (Variational) Bayesian Methodscited by 31
- 2021Meta-Learning Reliable Priors in the Function Spacecited by 23
- 2021The Internet of Federated Things (IoFT): A Vision for the Future and In-depth Survey of Data-driven Approaches for Federated Learningcited by 23
- 2022The Neural Process Family: Survey, Applications and Perspectivescited by 23
- 2022Generalized Variational Inference in Function Spaces: Gaussian Measures meet Bayesian Deep Learningcited by 20
- 2023Function-Space Regularization in Neural Networks: A Probabilistic Perspectivecited by 20
29 more
- 2021Sparse Uncertainty Representation in Deep Learning with Inducing Weightscited by 16
- 2024Sparse Inducing Points in Deep Gaussian Processes: Enhancing Modeling with Denoising Diffusion Variational Inferencecited by 16
- 2021Function-space Inference with Sparse Implicit Processescited by 13
- 2022Deep Variational Implicit Processescited by 8
- 2022On the detrimental effect of invariances in the likelihood for variational inferencecited by 8
- 2021A variational approximate posterior for the deep Wishart processcited by 6
- 2023Neural Operator Variational Inference based on Regularized Stein Discrepancy for Deep Gaussian Processescited by 6
- 2022Energy-Based Models for Functional Data using Path Measure Tiltingcited by 5
- 2024Spectral Convolutional Conditional Neural Processescited by 4
- 2023Adaptive Conditional Quantile Neural Processescited by 3
- 2024Nonparametric Automatic Differentiation Variational Inference with Spline Approximationcited by 3
- 2024On Uncertainty Quantification for Near-Bayes Optimal Algorithmscited by 3
- 2024Regularized KL-Divergence for Well-Defined Function-Space Variational Inference in Bayesian neural networkscited by 3
- 2023Function Space Bayesian Pseudocoreset for Bayesian Neural Networkscited by 2
- 2025Efficient Transformed Gaussian Process State-Space Models for Non-Stationary High-Dimensional Dynamical Systemscited by 2
- 2021Conditional Deep Gaussian Processes: empirical Bayes hyperdata learningcited by 1
- 2022Correcting Model Bias with Sparse Implicit Processescited by 1
- 2023Variational Elliptical Processescited by 1
- 2024R'enyi Neural Processescited by 1
- 2024Flexible Bayesian Last Layer Models Using Implicit Priors and Diffusion Posterior Samplingcited by 1
- 2025Bayesian Computation in Deep Learningcited by 1
- 2025Unlearning in Diffusion models under Data Constraints: A Variational Inference Approachcited by 1
- 2026LatentFlow: A General Framework for Conditioning Stochastic Processescited by 1
- 2023Function-Space Regularization for Deep Bayesian Classificationcited by 0
- 2025Revisiting Unbiased Implicit Variational Inferencecited by 0
- 2025Active Learning for Manifold Gaussian Process Regressioncited by 0
- 2026Function-Space Empirical Bayes Regularisation with Large Vision-Language Model Priorscited by 0
- 2026Function-Space Empirical Bayes Regularisation with Student's t Priorscited by 0
- 2026Flow-Transformed Implicit Processes for Function-Space Variational Inferencecited by 0
- 2026LatentFlow: A General Framework for Conditioning Stochastic Processes14 Jul 2026
- 2026Flow-Transformed Implicit Processes for Function-Space Variational Inference1 Jun 2026
- 2026Function-Space Empirical Bayes Regularisation with Student's t Priors25 Feb 2026
- 2026Function-Space Empirical Bayes Regularisation with Large Vision-Language Model Priors3 Feb 2026
- 2025Unlearning in Diffusion models under Data Constraints: A Variational Inference Approach5 Oct 2025
- 2025Active Learning for Manifold Gaussian Process Regression26 Jun 2025
- 2025Revisiting Unbiased Implicit Variational Inference4 Jun 2025
- 2025Efficient Transformed Gaussian Process State-Space Models for Non-Stationary High-Dimensional Dynamical Systems24 Mar 2025
- 2025Bayesian Computation in Deep Learning25 Feb 2025
- 2024Flexible Bayesian Last Layer Models Using Implicit Priors and Diffusion Posterior Sampling7 Aug 2024
- 2024Sparse Inducing Points in Deep Gaussian Processes: Enhancing Modeling with Denoising Diffusion Variational Inference24 Jul 2024
- 2024Regularized KL-Divergence for Well-Defined Function-Space Variational Inference in Bayesian neural networks6 Jun 2024
29 more
- 2024R'enyi Neural Processes25 May 2024
- 2024Spectral Convolutional Conditional Neural Processes19 Apr 2024
- 2024On Uncertainty Quantification for Near-Bayes Optimal Algorithms28 Mar 2024
- 2024Nonparametric Automatic Differentiation Variational Inference with Spline Approximation10 Mar 2024
- 2023Tractable Function-Space Variational Inference in Bayesian Neural Networks28 Dec 2023
- 2023Function-Space Regularization in Neural Networks: A Probabilistic Perspective28 Dec 2023
- 2023Variational Elliptical Processes21 Nov 2023
- 2023Function Space Bayesian Pseudocoreset for Bayesian Neural Networks27 Oct 2023
- 2023Neural Operator Variational Inference based on Regularized Stein Discrepancy for Deep Gaussian Processes22 Sep 2023
- 2023BayesDAG: Gradient-Based Posterior Inference for Causal Discovery26 Jul 2023
- 2023Function-Space Regularization for Deep Bayesian Classification12 Jul 2023
- 2023Adaptive Conditional Quantile Neural Processes30 May 2023
- 2023A Rigorous Link between Deep Ensembles and (Variational) Bayesian Methods24 May 2023
- 2022Do Bayesian Neural Networks Need To Be Fully Stochastic?11 Nov 2022
- 2022On the detrimental effect of invariances in the likelihood for variational inference15 Sep 2022
- 2022The Neural Process Family: Survey, Applications and Perspectives1 Sep 2022
- 2022Correcting Model Bias with Sparse Implicit Processes21 Jul 2022
- 2022Deep Variational Implicit Processes14 Jun 2022
- 2022Generalized Variational Inference in Function Spaces: Gaussian Measures meet Bayesian Deep Learning12 May 2022
- 2022Energy-Based Models for Functional Data using Path Measure Tilting4 Feb 2022
- 2021The Internet of Federated Things (IoFT): A Vision for the Future and In-depth Survey of Data-driven Approaches for Federated Learning9 Nov 2021
- 2021Function-space Inference with Sparse Implicit Processes14 Oct 2021
- 2021Conditional Deep Gaussian Processes: empirical Bayes hyperdata learning1 Oct 2021
- 2021A variational approximate posterior for the deep Wishart process21 Jul 2021
- 2021Meta-Learning Reliable Priors in the Function Space6 Jun 2021
- 2021Sparse Uncertainty Representation in Deep Learning with Inducing Weights30 May 2021
- 2021Priors in Bayesian Deep Learning: A Review14 May 2021
- 2021Bayesian Neural Network Priors Revisited12 Feb 2021
- 2021The Gaussian Neural Process10 Jan 2021
- 2021Bayesian Neural Network Priors Revisitedcited by 121
- 2021Priors in Bayesian Deep Learning: A Reviewcited by 101
- 2022Do Bayesian Neural Networks Need To Be Fully Stochastic?cited by 63
- 2023Tractable Function-Space Variational Inference in Bayesian Neural Networkscited by 41
- 2021The Gaussian Neural Processcited by 34
- 2023BayesDAG: Gradient-Based Posterior Inference for Causal Discoverycited by 33
- 2023A Rigorous Link between Deep Ensembles and (Variational) Bayesian Methodscited by 31
- 2021Meta-Learning Reliable Priors in the Function Spacecited by 23
- 2021The Internet of Federated Things (IoFT): A Vision for the Future and In-depth Survey of Data-driven Approaches for Federated Learningcited by 23
- 2022The Neural Process Family: Survey, Applications and Perspectivescited by 23
- 2022Generalized Variational Inference in Function Spaces: Gaussian Measures meet Bayesian Deep Learningcited by 20
- 2023Function-Space Regularization in Neural Networks: A Probabilistic Perspectivecited by 20
12 most cited of 38 All 38 (JSON)
- 2026LatentFlow: A General Framework for Conditioning Stochastic Processes14 Jul 2026
- 2026Flow-Transformed Implicit Processes for Function-Space Variational Inference1 Jun 2026
- 2026Function-Space Empirical Bayes Regularisation with Student's t Priors25 Feb 2026
- 2025Active Learning for Manifold Gaussian Process Regression26 Jun 2025
- 2025Revisiting Unbiased Implicit Variational Inference4 Jun 2025
- 2025Efficient Transformed Gaussian Process State-Space Models for Non-Stationary High-Dimensional Dynamical Systems24 Mar 2025
- 2025Bayesian Computation in Deep Learning25 Feb 2025
- 2024Flexible Bayesian Last Layer Models Using Implicit Priors and Diffusion Posterior Sampling7 Aug 2024
- 2024Regularized KL-Divergence for Well-Defined Function-Space Variational Inference in Bayesian neural networks6 Jun 2024
- 2024R'enyi Neural Processes25 May 2024
- 2024Spectral Convolutional Conditional Neural Processes19 Apr 2024
- 2024On Uncertainty Quantification for Near-Bayes Optimal Algorithms28 Mar 2024
12 newest of 38 All 38 (JSON)