Resampled Priors for Variational Autoencoders
Not on the map. Why?
Abstract (arXiv)
We propose Learned Accept/Reject Sampling (LARS), a method for constructing richer priors using rejection sampling with a learned acceptance function. This work is motivated by recent analyses of the VAE objective, which pointed out that commonly used simple priors can lead to underfitting. As the distribution induced by LARS involves an intractable normalizing constant, we show how to estimate it and its gradients efficiently. We demonstrate that LARS priors improve VAE performance on several standard datasets both when they are learned jointly with the rest of the model and when they are fitted to a pretrained model. Finally, we show that LARS can be combined with existing methods for defining flexible priors for an additional boost in performance.
Key facts. Cited by 57 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 17; 2023: 10; 2024: 5; 2025: 7; 2026: 2.
57 papers.
Sort:
By area:
- 2021Score-based Generative Modeling in Latent Spacecited by 636
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 553
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 252
- 2022DiffuseVAE: Efficient, Controllable and High-Fidelity Generation from Low-Dimensional Latentscited by 104
- 2021Priors in Bayesian Deep Learning: A Reviewcited by 101
- 2022Refining Generative Process with Discriminator Guidance in Score-based Diffusion Modelscited by 100
- 2021Resampling Base Distributions of Normalizing Flowscited by 42
- 2022VAEL: Bridging Variational Autoencoders and Probabilistic Logic Programmingcited by 31
- 2022Universal approximation property of invertible neural networkscited by 30
- 2021Data Augmentation in High Dimensional Low Sample Size Setting Using a Geometry-Based Variational Autoencodercited by 27
- 2022Particle algorithms for maximum likelihood training of latent variable modelscited by 26
- 2022Pythae: Unifying Generative Autoencoders in Python -- A Benchmarking Use Casecited by 26
38 more
- 2024You Only Sample Once: Taming One-Step Text-to-Image Synthesis by Self-Cooperative Diffusion GANscited by 26
- 2022A Geometric Perspective on Variational Autoencoderscited by 24
- 2021A survey on Variational Autoencoders from a GreenAI perspectivecited by 22
- 2021Regularising Inverse Problems with Generative Machine Learning Modelscited by 22
- 2023Learning Manifold Dimensions with Conditional Variational Autoencoderscited by 20
- 2022Adaptive Multi-stage Density Ratio Estimation for Learning Latent Space Energy-based Modelcited by 18
- 2021Local Disentanglement in Variational Auto-Encoders Using Jacobian L1 Regularizationcited by 17
- 2023The Sample Complexity of Approximate Rejection Sampling with Applications to Smoothed Online Learningcited by 13
- 2022Multiple Importance Sampling ELBO and Deep Ensembles of Variational Approximationscited by 12
- 2022Bottlenecks CLUB: Unifying Information-Theoretic Trade-offs Among Complexity, Leakage, and Utilitycited by 12
- 2022Comparing the latent space of generative modelscited by 12
- 2021A prior-based approximate latent Riemannian metriccited by 11
- 2021On Incorporating Inductive Biases into VAEscited by 11
- 2021Model Selection for Bayesian Autoencoderscited by 10
- 2023Fully Bayesian Autoencoders with Latent Sparse Gaussian Processescited by 9
- 2024Monotone, Bi-Lipschitz, and Polyak-Lojasiewicz Networkscited by 9
- 2021Distantly Supervised Relation Extraction with Sentence Reconstruction and Knowledge Base Priorscited by 8
- 2024Hierarchical VAE with a Diffusion-based VampPriorcited by 8
- 2023Diffusion Models with Deterministic Normalizing Flow Priorscited by 7
- 2023Topology-Matching Normalizing Flows for Out-of-Distribution Detection in Robot Learningcited by 7
- 2024Counterfactual Concept Bottleneck Modelscited by 7
- 2021Variational Leakage: The Role of Information Complexity in Privacy Leakagecited by 6
- 2022Variational Sparse Coding with Learned Thresholdingcited by 6
- 2022Cooperation in the Latent Space: The Benefits of Adding Mixture Components in Variational Autoencoderscited by 6
- 2022Latent Space Diffusion Models of Cryo-EM Structurescited by 6
- 2023Matching aggregate posteriors in the variational autoencodercited by 6
- 2024Learning Latent Space Hierarchical EBM Diffusion Modelscited by 6
- 2025Distribution Matching Variational AutoEncodercited by 6
- 2023Deep Probabilistic Movement Primitives with a Bayesian Aggregatorcited by 4
- 2022Improving Variational Autoencoders with Density Gap-based Regularizationcited by 3
- 2021ByPE-VAE: Bayesian Pseudocoresets Exemplar VAEcited by 2
- 2023Unscented Autoencodercited by 2
- 2023On the Approximation of Bi-Lipschitz Maps by Invertible Neural Networkscited by 2
- 2023Reparameterized Variational Rejection Samplingcited by 2
- 2025Learning Energy-based Variational Latent Prior for VAEscited by 2
- 2021Momentum Contrastive Autoencoder: Using Contrastive Learning for Latent Space Distribution Matching in WAEcited by 1
- 2022Local Distance Preserving Auto-encoders using Continuous k-Nearest Neighbours Graphscited by 1
- 2025Studying Classifier(-Free) Guidance From a Classifier-Centric Perspectivecited by 1
50 most cited of 57 All 57 (JSON)
- 2026Perfect Reconstruction Cannot Show Whether Two Codebooks on a VAE's Latent Space Agree29 Sep 2026
- 2026Implicit Variational Rejection Sampling12 Jun 2026
- 2025Distribution Matching Variational AutoEncoder8 Dec 2025
- 2025LSRS: Latent Scale Rejection Sampling for Visual Autoregressive Modeling3 Dec 2025
- 2025Adapting Noise to Data: Generative Flows from 1D Processes14 Oct 2025
- 2025Learning Energy-based Variational Latent Prior for VAEs30 Sep 2025
- 2025Deep Generative Methods and Tire Architecture Design15 Jul 2025
- 2025Unsupervised Anomaly Detection in Multivariate Time Series across Heterogeneous Domains29 Mar 2025
- 2025Studying Classifier(-Free) Guidance From a Classifier-Centric Perspective13 Mar 2025
- 2024Hierarchical VAE with a Diffusion-based VampPrior2 Dec 2024
- 2024Learning Latent Space Hierarchical EBM Diffusion Models22 May 2024
- 2024You Only Sample Once: Taming One-Step Text-to-Image Synthesis by Self-Cooperative Diffusion GANs19 Mar 2024
38 more
- 2024Counterfactual Concept Bottleneck Models2 Feb 2024
- 2024Monotone, Bi-Lipschitz, and Polyak-Lojasiewicz Networks2 Feb 2024
- 2023Matching aggregate posteriors in the variational autoencoder13 Nov 2023
- 2023Topology-Matching Normalizing Flows for Out-of-Distribution Detection in Robot Learning11 Nov 2023
- 2023Reparameterized Variational Rejection Sampling26 Sep 2023
- 2023Diffusion Models with Deterministic Normalizing Flow Priors3 Sep 2023
- 2023On the Approximation of Bi-Lipschitz Maps by Invertible Neural Networks18 Aug 2023
- 2023Deep Probabilistic Movement Primitives with a Bayesian Aggregator11 Jul 2023
- 2023Unscented Autoencoder8 Jun 2023
- 2023Learning Manifold Dimensions with Conditional Variational Autoencoders23 Feb 2023
- 2023The Sample Complexity of Approximate Rejection Sampling with Applications to Smoothed Online Learning9 Feb 2023
- 2023Fully Bayesian Autoencoders with Latent Sparse Gaussian Processes9 Feb 2023
- 2022Refining Generative Process with Discriminator Guidance in Score-based Diffusion Models28 Nov 2022
- 2022Latent Space Diffusion Models of Cryo-EM Structures25 Nov 2022
- 2022Improving Variational Autoencoders with Density Gap-based Regularization1 Nov 2022
- 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct 2022
- 2022Cooperation in the Latent Space: The Benefits of Adding Mixture Components in Variational Autoencoders30 Sep 2022
- 2022Adaptive Multi-stage Density Ratio Estimation for Learning Latent Space Energy-based Model19 Sep 2022
- 2022A Geometric Perspective on Variational Autoencoders15 Sep 2022
- 2022Comparing the latent space of generative models14 Jul 2022
- 2022Bottlenecks CLUB: Unifying Information-Theoretic Trade-offs Among Complexity, Leakage, and Utility11 Jul 2022
- 2022Pythae: Unifying Generative Autoencoders in Python -- A Benchmarking Use Case16 Jun 2022
- 2022Local Distance Preserving Auto-encoders using Continuous k-Nearest Neighbours Graphs13 Jun 2022
- 2022Variational Sparse Coding with Learned Thresholding7 May 2022
- 2022Particle algorithms for maximum likelihood training of latent variable models27 Apr 2022
- 2022Universal approximation property of invertible neural networks15 Apr 2022
- 2022Multiple Importance Sampling ELBO and Deep Ensembles of Variational Approximations22 Feb 2022
- 2022VAEL: Bridging Variational Autoencoders and Probabilistic Logic Programming7 Feb 2022
- 2022DiffuseVAE: Efficient, Controllable and High-Fidelity Generation from Low-Dimensional Latents2 Jan 2022
- 2021Resampling Base Distributions of Normalizing Flows29 Oct 2021
- 2021Momentum Contrastive Autoencoder: Using Contrastive Learning for Latent Space Distribution Matching in WAE19 Oct 2021
- 2021Regularising Inverse Problems with Generative Machine Learning Models22 Jul 2021
- 2021ByPE-VAE: Bayesian Pseudocoresets Exemplar VAE20 Jul 2021
- 2021On Incorporating Inductive Biases into VAEs25 Jun 2021
- 2021Model Selection for Bayesian Autoencoders11 Jun 2021
- 2021Score-based Generative Modeling in Latent Space10 Jun 2021
- 2021Local Disentanglement in Variational Auto-Encoders Using Jacobian L1 Regularization5 Jun 2021
- 2021Variational Leakage: The Role of Information Complexity in Privacy Leakage5 Jun 2021
50 newest of 57 All 57 (JSON)
- 2021Score-based Generative Modeling in Latent Spacecited by 636
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 553
- 2022DiffuseVAE: Efficient, Controllable and High-Fidelity Generation from Low-Dimensional Latentscited by 104
- 2022Refining Generative Process with Discriminator Guidance in Score-based Diffusion Modelscited by 100
- 2024You Only Sample Once: Taming One-Step Text-to-Image Synthesis by Self-Cooperative Diffusion GANscited by 26
- 2023Diffusion Models with Deterministic Normalizing Flow Priorscited by 7
- 2022Latent Space Diffusion Models of Cryo-EM Structurescited by 6
- 2024Learning Latent Space Hierarchical EBM Diffusion Modelscited by 6
- 2025Studying Classifier(-Free) Guidance From a Classifier-Centric Perspectivecited by 1
- 2025Deep Generative Methods and Tire Architecture Designcited by 0
- 2025Deep Generative Methods and Tire Architecture Design15 Jul 2025
- 2025Studying Classifier(-Free) Guidance From a Classifier-Centric Perspective13 Mar 2025
- 2024Learning Latent Space Hierarchical EBM Diffusion Models22 May 2024
- 2024You Only Sample Once: Taming One-Step Text-to-Image Synthesis by Self-Cooperative Diffusion GANs19 Mar 2024
- 2023Diffusion Models with Deterministic Normalizing Flow Priors3 Sep 2023
- 2022Refining Generative Process with Discriminator Guidance in Score-based Diffusion Models28 Nov 2022
- 2022Latent Space Diffusion Models of Cryo-EM Structures25 Nov 2022
- 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct 2022
- 2022DiffuseVAE: Efficient, Controllable and High-Fidelity Generation from Low-Dimensional Latents2 Jan 2022
- 2021Score-based Generative Modeling in Latent Space10 Jun 2021
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 252
- 2021Priors in Bayesian Deep Learning: A Reviewcited by 101
- 2021Resampling Base Distributions of Normalizing Flowscited by 42
- 2022Universal approximation property of invertible neural networkscited by 30
- 2021Data Augmentation in High Dimensional Low Sample Size Setting Using a Geometry-Based Variational Autoencodercited by 27
- 2022Particle algorithms for maximum likelihood training of latent variable modelscited by 26
- 2022Pythae: Unifying Generative Autoencoders in Python -- A Benchmarking Use Casecited by 26
- 2022A Geometric Perspective on Variational Autoencoderscited by 24
- 2021A survey on Variational Autoencoders from a GreenAI perspectivecited by 22
- 2021Regularising Inverse Problems with Generative Machine Learning Modelscited by 22
- 2023Learning Manifold Dimensions with Conditional Variational Autoencoderscited by 20
- 2022Adaptive Multi-stage Density Ratio Estimation for Learning Latent Space Energy-based Modelcited by 18
12 most cited of 46 All 46 (JSON)
- 2026Perfect Reconstruction Cannot Show Whether Two Codebooks on a VAE's Latent Space Agree29 Sep 2026
- 2026Implicit Variational Rejection Sampling12 Jun 2026
- 2025Distribution Matching Variational AutoEncoder8 Dec 2025
- 2025LSRS: Latent Scale Rejection Sampling for Visual Autoregressive Modeling3 Dec 2025
- 2025Adapting Noise to Data: Generative Flows from 1D Processes14 Oct 2025
- 2025Learning Energy-based Variational Latent Prior for VAEs30 Sep 2025
- 2025Unsupervised Anomaly Detection in Multivariate Time Series across Heterogeneous Domains29 Mar 2025
- 2024Hierarchical VAE with a Diffusion-based VampPrior2 Dec 2024
- 2024Counterfactual Concept Bottleneck Models2 Feb 2024
- 2024Monotone, Bi-Lipschitz, and Polyak-Lojasiewicz Networks2 Feb 2024
- 2023Matching aggregate posteriors in the variational autoencoder13 Nov 2023
- 2023Topology-Matching Normalizing Flows for Out-of-Distribution Detection in Robot Learning11 Nov 2023
12 newest of 46 All 46 (JSON)