Denoising Criterion for Variational Auto-Encoding Framework
Not on the map. Why?
Abstract (arXiv)
Denoising autoencoders (DAE) are trained to reconstruct their clean inputs with noise injected at the input level, while variational autoencoders (VAE) are trained with noise injected in their stochastic hidden layer, with a regularizer that encourages this noise injection. In this paper, we show that injecting noise both in input and in the stochastic hidden layer can be advantageous and we propose a modified variational lower bound as an improved objective function in this setup. When input is corrupted, then the standard VAE lower bound involves marginalizing the encoder conditional distribution over the input noise, which makes the training criterion intractable. Instead, we propose a modified training criterion which corresponds to a tractable bound when input is corrupted. Experimentally, we find that the proposed denoising variational autoencoder (DVAE) yields better average log-likelihood than the VAE and the importance weighted autoencoder on the MNIST and Frey Face datasets.
Key facts. Cited by 43 papers in the map (data through 14 Oct 2026). First posted on arXiv 19 Nov 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 3; 2023: 11; 2024: 12; 2025: 2; 2026: 3.
43 papers.
Sort:
By area:
- 2021Illiterate DALL-E Learns to Composecited by 147
- 2023Plug-and-Play split Gibbs sampler: embedding deep generative priors in Bayesian inferencecited by 42
- 2021Adversarial and Contrastive Variational Autoencoder for Sequential Recommendationcited by 28
- 2021My House, My Rules: Learning Tidying Preferences with Graph Neural Networkscited by 27
- 2021Solving Inverse Problems by Joint Posterior Maximization with Autoencoding Priorcited by 24
- 2022Amortized Variational Inference: A Systematic Reviewcited by 16
- 2023Object-Centric Learning with Slot Mixture Modulecited by 11
- 2025Vector-Quantized Vision Foundation Models for Object-Centric Learningcited by 11
- 2023VTAE: Variational Transformer Autoencoder with Manifolds Learningcited by 10
- 2024Length-Aware Motion Synthesis via Latent Diffusioncited by 10
- 2021Mask-GVAE: Blind Denoising Graphs via Partitioncited by 9
- 2024Reasoning-Enhanced Object-Centric Learning for Videoscited by 7
31 more
- 2024Multi-Scale Fusion for Object Representationcited by 7
- 2021Exploring Versatile Prior for Human Motion via Motion Frequency Guidancecited by 5
- 2023Latent Space Bayesian Optimization with Latent Data Augmentation for Enhanced Explorationcited by 5
- 2023Implicit Variational Inference for High-Dimensional Posteriorscited by 5
- 2024Grouped Discrete Representation for Object-Centric Learningcited by 5
- 2022Latent Variable Models in the Era of Industrial Big Data: Extension and Beyondcited by 4
- 2024SQUWA: Signal Quality Aware DNN Architecture for Enhanced Accuracy in Atrial Fibrillation Detection from Noisy PPG Signalscited by 4
- 2021Blind Image Denoising and Inpainting Using Robust Hadamard Autoencoderscited by 2
- 2021PicTalky: Augmentative and Alternative Communication Software for Language Developmental Disabilitiescited by 2
- 2021Hybrid BYOL-ViT: Efficient approach to deal with small datasetscited by 2
- 2022Training β-VAE by Aggregating a Learned Gaussian Posterior with a Decoupled Decodercited by 2
- 2023Graph Harmony: Denoising and Nuclear-Norm Wasserstein Adaptation for Enhanced Domain Transfer in Graph-Structured Datacited by 2
- 2023Leveraging Image Augmentation for Object Manipulation: Towards Interpretable Controllability in Object-Centric Learningcited by 2
- 2024Survey on Visual Signal Coding and Processing with Generative Models: Technologies, Standards and Optimizationcited by 2
- 2024SGW-based Multi-Task Learning in Vision Taskscited by 2
- 2021AASAE: Augmentation-Augmented Stochastic Autoencoderscited by 1
- 2023A Bayesian Non-parametric Approach to Generative Models: Integrating Variational Autoencoder and Generative Adversarial Networks using Wasserstein and Maximum Mean Discrepancycited by 1
- 2023inkn'hue: Enhancing Manga Colorization from Multiple Priors with Alignment Multi-Encoder VAEcited by 1
- 2024DiffuseDef: Improved Robustness to Adversarial Attacks via Iterative Denoisingcited by 1
- 2024Novel Hybrid Integrated Pix2Pix and WGAN Model with Gradient Penalty for Binary Images Denoisingcited by 1
- 2024Counterfactuals and Uncertainty-Based Explainable Paradigm for the Automated Detection and Segmentation of Renal Cysts in Computed Tomography Images: A Multi-Center Studycited by 1
- 2025Self-supervised Latent Space Optimization with Nebula Variational Codingcited by 1
- 2026MUFASA: A Multi-Layer Framework for Slot Attentioncited by 1
- 2021Deep Contrastive Patch-Based Subspace Learning for Camera Image Signal Processingcited by 0
- 2021Window-Level is a Strong Denoising Surrogatecited by 0
- 2023Indeterminate Probability Theorycited by 0
- 2023Continuous Indeterminate Probability Neural Networkcited by 0
- 2024Quantifying User Coherence: A Unified Framework for Analyzing Recommender Systems Across Domainscited by 0
- 2024Diffusion Model from Scratchcited by 0
- 2026Learning-based Statistical Refinement for Denoisingcited by 0
- 2026A Multi-stage Constrained Optimization Framework for Data-driven Problemscited by 0
- 2026A Multi-stage Constrained Optimization Framework for Data-driven Problems26 Jul 2026
- 2026Learning-based Statistical Refinement for Denoising5 May 2026
- 2026MUFASA: A Multi-Layer Framework for Slot Attention7 Feb 2026
- 2025Self-supervised Latent Space Optimization with Nebula Variational Coding2 Jun 2025
- 2025Vector-Quantized Vision Foundation Models for Object-Centric Learning27 Feb 2025
- 2024Diffusion Model from Scratch14 Dec 2024
- 2024Grouped Discrete Representation for Object-Centric Learning4 Nov 2024
- 2024SGW-based Multi-Task Learning in Vision Tasks3 Oct 2024
- 2024Quantifying User Coherence: A Unified Framework for Analyzing Recommender Systems Across Domains3 Oct 2024
- 2024Multi-Scale Fusion for Object Representation2 Oct 2024
- 2024Counterfactuals and Uncertainty-Based Explainable Paradigm for the Automated Detection and Segmentation of Renal Cysts in Computed Tomography Images: A Multi-Center Study7 Aug 2024
- 2024Novel Hybrid Integrated Pix2Pix and WGAN Model with Gradient Penalty for Binary Images Denoising16 Jul 2024
31 more
- 2024Length-Aware Motion Synthesis via Latent Diffusion16 Jul 2024
- 2024DiffuseDef: Improved Robustness to Adversarial Attacks via Iterative Denoising28 Jun 2024
- 2024Survey on Visual Signal Coding and Processing with Generative Models: Technologies, Standards and Optimization23 May 2024
- 2024SQUWA: Signal Quality Aware DNN Architecture for Enhanced Accuracy in Atrial Fibrillation Detection from Noisy PPG Signals15 Apr 2024
- 2024Reasoning-Enhanced Object-Centric Learning for Videos22 Mar 2024
- 2023Object-Centric Learning with Slot Mixture Module8 Nov 2023
- 2023inkn'hue: Enhancing Manga Colorization from Multiple Priors with Alignment Multi-Encoder VAE3 Nov 2023
- 2023Leveraging Image Augmentation for Object Manipulation: Towards Interpretable Controllability in Object-Centric Learning13 Oct 2023
- 2023Implicit Variational Inference for High-Dimensional Posteriors10 Oct 2023
- 2023A Bayesian Non-parametric Approach to Generative Models: Integrating Variational Autoencoder and Generative Adversarial Networks using Wasserstein and Maximum Mean Discrepancy27 Aug 2023
- 2023Plug-and-Play split Gibbs sampler: embedding deep generative priors in Bayesian inference21 Apr 2023
- 2023VTAE: Variational Transformer Autoencoder with Manifolds Learning3 Apr 2023
- 2023Continuous Indeterminate Probability Neural Network23 Mar 2023
- 2023Indeterminate Probability Theory21 Mar 2023
- 2023Latent Space Bayesian Optimization with Latent Data Augmentation for Enhanced Exploration5 Feb 2023
- 2023Graph Harmony: Denoising and Nuclear-Norm Wasserstein Adaptation for Enhanced Domain Transfer in Graph-Structured Data29 Jan 2023
- 2022Training β-VAE by Aggregating a Learned Gaussian Posterior with a Decoupled Decoder29 Sep 2022
- 2022Amortized Variational Inference: A Systematic Review22 Sep 2022
- 2022Latent Variable Models in the Era of Industrial Big Data: Extension and Beyond23 Aug 2022
- 2021Exploring Versatile Prior for Human Motion via Motion Frequency Guidance25 Nov 2021
- 2021Hybrid BYOL-ViT: Efficient approach to deal with small datasets8 Nov 2021
- 2021My House, My Rules: Learning Tidying Preferences with Graph Neural Networks4 Nov 2021
- 2021Illiterate DALL-E Learns to Compose17 Oct 2021
- 2021PicTalky: Augmentative and Alternative Communication Software for Language Developmental Disabilities27 Sep 2021
- 2021AASAE: Augmentation-Augmented Stochastic Autoencoders26 Jul 2021
- 2021Window-Level is a Strong Denoising Surrogate15 May 2021
- 2021Deep Contrastive Patch-Based Subspace Learning for Camera Image Signal Processing1 Apr 2021
- 2021Adversarial and Contrastive Variational Autoencoder for Sequential Recommendation19 Mar 2021
- 2021Solving Inverse Problems by Joint Posterior Maximization with Autoencoding Prior2 Mar 2021
- 2021Mask-GVAE: Blind Denoising Graphs via Partition8 Feb 2021
- 2021Blind Image Denoising and Inpainting Using Robust Hadamard Autoencoders26 Jan 2021
- 2024Length-Aware Motion Synthesis via Latent Diffusioncited by 10
- 2024Diffusion Model from Scratchcited by 0
- 2024Diffusion Model from Scratch14 Dec 2024
- 2024Length-Aware Motion Synthesis via Latent Diffusion16 Jul 2024
- 2024Reasoning-Enhanced Object-Centric Learning for Videoscited by 7
- 2024Reasoning-Enhanced Object-Centric Learning for Videos22 Mar 2024
- 2021Illiterate DALL-E Learns to Composecited by 147
- 2023Plug-and-Play split Gibbs sampler: embedding deep generative priors in Bayesian inferencecited by 42
- 2021Adversarial and Contrastive Variational Autoencoder for Sequential Recommendationcited by 28
- 2021My House, My Rules: Learning Tidying Preferences with Graph Neural Networkscited by 27
- 2021Solving Inverse Problems by Joint Posterior Maximization with Autoencoding Priorcited by 24
- 2022Amortized Variational Inference: A Systematic Reviewcited by 16
- 2023Object-Centric Learning with Slot Mixture Modulecited by 11
- 2025Vector-Quantized Vision Foundation Models for Object-Centric Learningcited by 11
- 2023VTAE: Variational Transformer Autoencoder with Manifolds Learningcited by 10
- 2021Mask-GVAE: Blind Denoising Graphs via Partitioncited by 9
- 2024Multi-Scale Fusion for Object Representationcited by 7
- 2021Exploring Versatile Prior for Human Motion via Motion Frequency Guidancecited by 5
12 most cited of 40 All 40 (JSON)
- 2026A Multi-stage Constrained Optimization Framework for Data-driven Problems26 Jul 2026
- 2026Learning-based Statistical Refinement for Denoising5 May 2026
- 2026MUFASA: A Multi-Layer Framework for Slot Attention7 Feb 2026
- 2025Self-supervised Latent Space Optimization with Nebula Variational Coding2 Jun 2025
- 2025Vector-Quantized Vision Foundation Models for Object-Centric Learning27 Feb 2025
- 2024Grouped Discrete Representation for Object-Centric Learning4 Nov 2024
- 2024SGW-based Multi-Task Learning in Vision Tasks3 Oct 2024
- 2024Quantifying User Coherence: A Unified Framework for Analyzing Recommender Systems Across Domains3 Oct 2024
- 2024Multi-Scale Fusion for Object Representation2 Oct 2024
- 2024Counterfactuals and Uncertainty-Based Explainable Paradigm for the Automated Detection and Segmentation of Renal Cysts in Computed Tomography Images: A Multi-Center Study7 Aug 2024
- 2024Novel Hybrid Integrated Pix2Pix and WGAN Model with Gradient Penalty for Binary Images Denoising16 Jul 2024
- 2024DiffuseDef: Improved Robustness to Adversarial Attacks via Iterative Denoising28 Jun 2024
12 newest of 40 All 40 (JSON)