DVAE#: Discrete Variational Autoencoders with Relaxed Boltzmann Priors
Not on the map. Why?
Abstract (arXiv)
Boltzmann machines are powerful distributions that have been shown to be an effective prior over binary latent variables in variational autoencoders (VAEs). However, previous methods for training discrete VAEs have used the evidence lower bound and not the tighter importance-weighted bound. We propose two approaches for relaxing Boltzmann machines to continuous distributions that permit training with importance-weighted bounds. These relaxations are based on generalized overlapping transformations and the Gaussian integral trick. Experiments on the MNIST and OMNIGLOT datasets show that these relaxations outperform previous discrete VAEs with Boltzmann priors. An implementation which reproduces these results is available at https://github.com/QuadrantAI/dvae .
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 1; 2023: 4; 2024: 4; 2025: 4; 2026: 1.
19 papers.
Sort:
By area:
- 2021Score-based Generative Modeling in Latent Spacecited by 634
- 2023GIVT: Generative Infinite-Vocabulary Transformerscited by 80
- 2021Controllable and Compositional Generation with Latent-Space Energy-Based Modelscited by 64
- 2021Discrete Representations Strengthen Vision Transformer Robustnesscited by 34
- 2022Lossy Image Compression with Quantized Hierarchical VAEscited by 32
- 2021Classical Planning in Deep Latent Spacecited by 21
- 2024DisCo-Diff: Enhancing Continuous Diffusion Models with Discrete Latentscited by 20
- 2023Lewis's Signaling Game as beta-VAE For Natural Word Lengths and Segmentscited by 11
- 2024On the Role of Discrete Tokenization in Visual Representation Learningcited by 7
- 2025MoFM: A Large-Scale Human Motion Foundation Modelcited by 5
- 2024Diffusion Beats Autoregressive: An Evaluation of Compositional Generation in Text-to-Image Modelscited by 4
- 2021Discrete Auto-regressive Variational Attention Models for Text Modelingcited by 2
7 more
- 2023Medical supervised masked autoencoders: Crafting a better masking strategy and efficient fine-tuning schedule for medical image classificationcited by 2
- 2025VTD-CLIP: Video-to-Text Discretization via Prompting CLIPcited by 2
- 2023Anomaly Detection in Aeronautics Data with Quantum-compatible Discrete Deep Generative Modelcited by 1
- 2025Zero-Variance Gradients for Variational Autoencoderscited by 1
- 2026EXCODER: EXplainable Classification Of DiscretE time series Representationscited by 1
- 2024Improved Variational Inference in Discrete VAEs using Error Correcting Codescited by 0
- 2025Point Cloud Quantization through Multimodal Prompting for 3D Understandingcited by 0
- 2026EXCODER: EXplainable Classification Of DiscretE time series Representations13 Feb 2026
- 2025Point Cloud Quantization through Multimodal Prompting for 3D Understanding15 Nov 2025
- 2025Zero-Variance Gradients for Variational Autoencoders5 Aug 2025
- 2025VTD-CLIP: Video-to-Text Discretization via Prompting CLIP24 Mar 2025
- 2025MoFM: A Large-Scale Human Motion Foundation Model8 Feb 2025
- 2024Diffusion Beats Autoregressive: An Evaluation of Compositional Generation in Text-to-Image Models30 Oct 2024
- 2024Improved Variational Inference in Discrete VAEs using Error Correcting Codes10 Oct 2024
- 2024On the Role of Discrete Tokenization in Visual Representation Learning12 Jul 2024
- 2024DisCo-Diff: Enhancing Continuous Diffusion Models with Discrete Latents3 Jul 2024
- 2023GIVT: Generative Infinite-Vocabulary Transformers4 Dec 2023
- 2023Lewis's Signaling Game as beta-VAE For Natural Word Lengths and Segments8 Nov 2023
- 2023Medical supervised masked autoencoders: Crafting a better masking strategy and efficient fine-tuning schedule for medical image classification10 May 2023
7 more
- 2023Anomaly Detection in Aeronautics Data with Quantum-compatible Discrete Deep Generative Model22 Mar 2023
- 2022Lossy Image Compression with Quantized Hierarchical VAEs27 Aug 2022
- 2021Discrete Representations Strengthen Vision Transformer Robustness20 Nov 2021
- 2021Controllable and Compositional Generation with Latent-Space Energy-Based Models21 Oct 2021
- 2021Classical Planning in Deep Latent Space30 Jun 2021
- 2021Discrete Auto-regressive Variational Attention Models for Text Modeling16 Jun 2021
- 2021Score-based Generative Modeling in Latent Space10 Jun 2021
- 2025VTD-CLIP: Video-to-Text Discretization via Prompting CLIP24 Mar 2025
- 2023GIVT: Generative Infinite-Vocabulary Transformerscited by 80
- 2021Controllable and Compositional Generation with Latent-Space Energy-Based Modelscited by 64
- 2021Discrete Representations Strengthen Vision Transformer Robustnesscited by 34
- 2022Lossy Image Compression with Quantized Hierarchical VAEscited by 32
- 2021Classical Planning in Deep Latent Spacecited by 21
- 2023Lewis's Signaling Game as beta-VAE For Natural Word Lengths and Segmentscited by 11
- 2024On the Role of Discrete Tokenization in Visual Representation Learningcited by 7
- 2025MoFM: A Large-Scale Human Motion Foundation Modelcited by 5
- 2021Discrete Auto-regressive Variational Attention Models for Text Modelingcited by 2
- 2023Medical supervised masked autoencoders: Crafting a better masking strategy and efficient fine-tuning schedule for medical image classificationcited by 2
- 2023Anomaly Detection in Aeronautics Data with Quantum-compatible Discrete Deep Generative Modelcited by 1
- 2025Zero-Variance Gradients for Variational Autoencoderscited by 1
12 most cited of 15 All 15 (JSON)
- 2026EXCODER: EXplainable Classification Of DiscretE time series Representations13 Feb 2026
- 2025Point Cloud Quantization through Multimodal Prompting for 3D Understanding15 Nov 2025
- 2025Zero-Variance Gradients for Variational Autoencoders5 Aug 2025
- 2025MoFM: A Large-Scale Human Motion Foundation Model8 Feb 2025
- 2024Improved Variational Inference in Discrete VAEs using Error Correcting Codes10 Oct 2024
- 2024On the Role of Discrete Tokenization in Visual Representation Learning12 Jul 2024
- 2023GIVT: Generative Infinite-Vocabulary Transformers4 Dec 2023
- 2023Lewis's Signaling Game as beta-VAE For Natural Word Lengths and Segments8 Nov 2023
- 2023Medical supervised masked autoencoders: Crafting a better masking strategy and efficient fine-tuning schedule for medical image classification10 May 2023
- 2023Anomaly Detection in Aeronautics Data with Quantum-compatible Discrete Deep Generative Model22 Mar 2023
- 2022Lossy Image Compression with Quantized Hierarchical VAEs27 Aug 2022
- 2021Discrete Representations Strengthen Vision Transformer Robustness20 Nov 2021
12 newest of 15 All 15 (JSON)