mlsanityData to 7 Oct 2026

Diffusion bridges vector quantized Variational AutoEncoders

arXiv 2202.04895 ↗First posted 10 Feb 2022stat.MLcited by 16

Not on the map. Why?

Abstract (arXiv)

Vector Quantized-Variational AutoEncoders (VQ-VAE) are generative models based on discrete latent representations of the data, where inputs are mapped to a finite set of learned embeddings.To generate new samples, an autoregressive prior distribution over the discrete states must be trained separately. This prior is generally very complex and leads to slow generation. In this work, we propose a new model to train the prior and the encoder/decoder networks simultaneously. We build a diffusion bridge between a continuous coded vector and a non-informative prior distribution. The latent discrete states are then given as random functions of these continuous vectors. We show that our model is competitive with the autoregressive prior on the mini-Imagenet and CIFAR dataset and is efficient in both optimization and sampling. Our framework also extends the standard VQ-VAE and enables end-to-end training.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 22 of its 26 references that are in the map. First posted on arXiv 10 Feb 2022.

Builds on

22 of 26 references.

References · 22

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2020Denoising Diffusion Implicit Modelscited by 9,655
  3. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  4. 2017Neural Discrete Representation Learningcited by 4,650
  5. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  6. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  7. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  8. 2016Matching Networks for One Shot Learningcited by 2,246
  9. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  10. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
  11. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
  12. 2016Conditional Image Generation with PixelCNN Decoderscited by 859
10 more
  1. 2016Pixel Recurrent Neural Networkscited by 814
  2. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
  3. 2021Score-based Generative Modeling in Latent Spacecited by 634
  4. 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributionscited by 566
  5. 2017PixelCNN++: Improving the PixelCNN with Discretized Logistic Mixture Likelihood and Other Modificationscited by 415
  6. 2021Symbolic Music Generation with Diffusion Modelscited by 152
  7. 2017PixelSNAIL: An Improved Autoregressive Generative Modelcited by 137
  8. 2021Simulating Diffusion Bridges with Score Matchingcited by 51
  9. 2014Simulation of multivariate diffusion bridgecited by 7
  10. 2020Relaxed-Responsibility Hierarchical Discrete VAEscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 4; 2023: 4; 2024: 3; 2025: 3; 2026: 2.

16 papers.

Sort:

By area:

  1. 2022A Continuous Time Framework for Discrete Denoising Modelscited by 437
  2. 2022A Survey on Generative Diffusion Modelcited by 238
  3. 2022Convergence of denoising diffusion models under the manifold hypothesiscited by 237
  4. 2022Score-based Continuous-time Discrete Diffusion Modelscited by 167
  5. 2023Stochastic Segmentation with Conditional Categorical Diffusion Modelscited by 38
  6. 2024A Complexity-Based Theory of Compositionalitycited by 13
  7. 2023Formulating Discrete Probability Flow Through Optimal Transportcited by 12
  8. 2025SketchDNN: Joint Continuous-Discrete Diffusion for CAD Sketch Generationcited by 5
  9. 2025Training Latent Diffusion Models with Interacting Particle Algorithmscited by 4
  10. 2023Variational latent discrete representation for time series modellingcited by 2
  11. 2023Variational excess risk bound for general state space modelscited by 2
  12. 2024Denoising Diffusion Variational Inference: Diffusion Models as Expressive Variational Posteriorscited by 2
4 more
  1. 2024Rate-Adaptive Quantization: A Multi-Rate Codebook Adaptation for Vector Quantization-based Generative Modelscited by 2
  2. 2025Align Beyond Prompts: Evaluating World Knowledge Alignment in Text-to-Image Generationcited by 1
  3. 2026PAC-Bayesian Reconstruction Guarantees for Time Series Variational Autoencoderscited by 1
  4. 2026Spectral Consistent Flow for One-step 3D Medical Image Translationcited by 0