RNADE: The real-valued neural autoregressive density-estimator
Not on the map. Why?
Abstract (arXiv)
We introduce RNADE, a new model for joint density estimation of real-valued vectors. Our model calculates the density of a datapoint as the product of one-dimensional conditionals modeled using mixture density networks with shared parameters. RNADE learns a distributed representation of the data, while having a tractable expression for the calculation of densities. A tractable likelihood allows direct comparison with other methods and training by standard gradient-based optimizers. We compare the performance of RNADE on several datasets of heterogeneous and perceptual data, finding it outperforms mixture models in all but one case.
Key facts. Cited by 65 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Jun 2013.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 16; 2023: 15; 2024: 10; 2025: 4.
65 papers.
Sort:
By area:
- 2023Consistency Modelscited by 1,778
- 2021Maximum Likelihood Training of Score-Based Diffusion Modelscited by 670
- 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributionscited by 566
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
- 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
- 2021Neural Temporal Point Processes: A Reviewcited by 113
- 2022Let us Build Bridges: Understanding and Extending Diffusion Generative Modelscited by 102
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?cited by 84
- 2021SceneGen: Learning to Generate Realistic Traffic Scenescited by 83
- 2022An Introduction to Neural Data Compressioncited by 78
- 2021On Memorization in Probabilistic Deep Generative Modelscited by 60
- 2023One Small Step for Generative AI, One Giant Leap for AGI: A Complete Survey on ChatGPT in AIGC Eracited by 55
38 more
- 2023Improved Techniques for Maximum Likelihood Estimation for Diffusion ODEscited by 54
- 2023Diffusion Models With Learned Adaptive Noisecited by 50
- 2023Autoregressive Conditional Neural Processescited by 32
- 2022Diagnosing and Fixing Manifold Overfitting in Deep Generative Modelscited by 28
- 2022CaloMan: Fast generation of calorimeter showers with density estimation on learned manifoldscited by 28
- 2021Parallel and Flexible Sampling from Autoregressive Models via Langevin Dynamicscited by 19
- 2022Multivariate Quantile Function Forecastercited by 19
- 2021Improved Autoregressive Modeling with Distribution Smoothingcited by 18
- 2022First Hitting Diffusion Models for Generating Manifold, Graph and Categorical Datacited by 18
- 2022Personalized Public Policy Analysis in Social Sciences using Causal-Graphical Normalizing Flowscited by 16
- 2024Data-efficient Large Vision Models through Sequential Autoregressioncited by 14
- 2023Learning Stackable and Skippable LEGO Bricks for Efficient, Reconfigurable, and Variable-Resolution Diffusion Modelingcited by 13
- 2021Model-based micro-data reinforcement learning: what are the crucial model properties and which model to choose?cited by 11
- 2022Semi-Discrete Normalizing Flows through Differentiable Tessellationcited by 11
- 2022Neural Graphical Modelscited by 11
- 2021Insights from Generative Modeling for Neural Video Compressioncited by 9
- 2021Low-rank Characteristic Tensor Density Estimation Part II: Compression and Latent Density Estimationcited by 8
- 2023LU-Net: Invertible Neural Networks Based on Matrix Factorizationcited by 8
- 2023Anomaly Detection with Variance Stabilized Density Estimationcited by 8
- 2021Sampling in Combinatorial Spaces with SurVAE Flow Augmented MCMCcited by 7
- 2024Deep Learning With DAGscited by 7
- 2022Denoising Deep Generative Modelscited by 6
- 2024Generative Assignment Flows for Representing and Learning Joint Distributions of Discrete Datacited by 6
- 2022Flowification: Everything is a Normalizing Flowcited by 5
- 2021Manifold Density Estimation via Generalized Dequantizationcited by 4
- 2021CDCGen: Cross-Domain Conditional Generation via Normalizing Flows and Adversarial Trainingcited by 4
- 2021Spread Flows for Manifold Modellingcited by 4
- 2023Diffusing Gaussian Mixtures for Generating Categorical Datacited by 4
- 2023One-Line-of-Code Data Mollification Improves Optimization of Likelihood-based Generative Modelscited by 4
- 2021Deconvolutional Density Network: Modeling Free-Form Conditional Distributionscited by 3
- 2023Curvature-Sensitive Predictive Coding with Approximate Laplace Monte Carlocited by 3
- 2024ContextFlow++: Generalist-Specialist Flow-based Generative Models with Mixed-Variable Context Encodingcited by 3
- 2021Marginally calibrated response distributions for end-to-end learning in autonomous drivingcited by 2
- 2022Neural Inverse Transform Samplercited by 2
- 2023Mixed Variational Flows for Discrete Variablescited by 2
- 2024Back to Bayesics: Uncovering Human Mobility Distributions and Anomalies with an Integrated Statistical and Neural Frameworkcited by 2
- 2025Dataset Distillation as Data Compression: A Rate-Utility Perspectivecited by 2
- 2023AQuaMaM: An Autoregressive, Quaternion Manifold Model for Rapidly Estimating Complex SO(3) Distributionscited by 1
50 most cited of 65 All 65 (JSON)
- 2025Adaptive Symmetrization of the KL Divergence14 Nov 2025
- 2025Dataset Distillation as Data Compression: A Rate-Utility Perspective23 Jul 2025
- 2025Causal Mediation Analysis with Multiple Mediators: A Simulation Approach16 Jun 2025
- 2025Enhancing Neural Autoregressive Distribution Estimators for Image Reconstruction3 Jun 2025
- 2024Local Curvature Smoothing with Stein's Identity for Efficient Score Matching5 Dec 2024
- 2024Back to Bayesics: Uncovering Human Mobility Distributions and Anomalies with an Integrated Statistical and Neural Framework1 Oct 2024
- 2024ViIK: Flow-based Vision Inverse Kinematics Solver with Fusing Collision Checking21 Aug 2024
- 2024Generative Assignment Flows for Representing and Learning Joint Distributions of Discrete Data6 Jun 2024
- 2024ContextFlow++: Generalist-Specialist Flow-based Generative Models with Mixed-Variable Context Encoding2 Jun 2024
- 2024PaddingFlow: Improving Normalizing Flows with Padding-Dimensional Noise13 Mar 2024
- 2024Sequential transport maps using SoS density estimation and α-divergences27 Feb 2024
- 2024Data-efficient Large Vision Models through Sequential Autoregression7 Feb 2024
38 more
- 2024Deep autoregressive density nets vs neural ensembles for model-based offline reinforcement learning5 Feb 2024
- 2024Deep Learning With DAGs12 Jan 2024
- 2023C2FAR: Coarse-to-Fine Autoregressive Networks for Precise Probabilistic Forecasting22 Dec 2023
- 2023Diffusion Models With Learned Adaptive Noise20 Dec 2023
- 2023Learning Stackable and Skippable LEGO Bricks for Efficient, Reconfigurable, and Variable-Resolution Diffusion Modeling10 Oct 2023
- 2023Mixed Variational Flows for Discrete Variables29 Aug 2023
- 2023Anomaly Detection with Variance Stabilized Density Estimation1 Jun 2023
- 2023One-Line-of-Code Data Mollification Improves Optimization of Likelihood-based Generative Models30 May 2023
- 2023Improved Techniques for Maximum Likelihood Estimation for Diffusion ODEs6 May 2023
- 2023One Small Step for Generative AI, One Giant Leap for AGI: A Complete Survey on ChatGPT in AIGC Era4 Apr 2023
- 2023Autoregressive Conditional Neural Processes25 Mar 2023
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?21 Mar 2023
- 2023Curvature-Sensitive Predictive Coding with Approximate Laplace Monte Carlo9 Mar 2023
- 2023Diffusing Gaussian Mixtures for Generating Categorical Data8 Mar 2023
- 2023Consistency Models2 Mar 2023
- 2023LU-Net: Invertible Neural Networks Based on Matrix Factorization21 Feb 2023
- 2023AQuaMaM: An Autoregressive, Quaternion Manifold Model for Rapidly Estimating Complex SO(3) Distributions21 Jan 2023
- 2022Denoising Deep Generative Models30 Nov 2022
- 2022CaloMan: Fast generation of calorimeter showers with density estimation on learned manifolds23 Nov 2022
- 2022On the importance of data collection for training general goal-reaching policies7 Nov 2022
- 2022Neural Graphical Models2 Oct 2022
- 2022First Hitting Diffusion Models for Generating Manifold, Graph and Categorical Data2 Sep 2022
- 2022Let us Build Bridges: Understanding and Extending Diffusion Generative Models31 Aug 2022
- 2022Maximum Likelihood on the Joint (Data, Condition) Distribution for Solving Ill-Posed Problems with Conditional Flow Models24 Aug 2022
- 2022Neural PCA for Flow-Based Representation Learning23 Aug 2022
- 2022Neural Inverse Transform Sampler22 Jun 2022
- 2022Flowification: Everything is a Normalizing Flow30 May 2022
- 2022Diagnosing and Fixing Manifold Overfitting in Deep Generative Models14 Apr 2022
- 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generation17 Mar 2022
- 2022Semi-Discrete Normalizing Flows through Differentiable Tessellation14 Mar 2022
- 2022Multivariate Quantile Function Forecaster23 Feb 2022
- 2022An Introduction to Neural Data Compression14 Feb 2022
- 2022Personalized Public Policy Analysis in Social Sciences using Causal-Graphical Normalizing Flows7 Feb 2022
- 2021OSOA: One-Shot Online Adaptation of Deep Generative Models for Lossless Compression2 Nov 2021
- 2021Knothe-Rosenblatt transport for Unsupervised Domain Adaptation6 Oct 2021
- 2021Marginally calibrated response distributions for end-to-end learning in autonomous driving3 Oct 2021
- 2021Spread Flows for Manifold Modelling29 Sep 2021
- 2021CDCGen: Cross-Domain Conditional Generation via Normalizing Flows and Adversarial Training25 Aug 2021
50 newest of 65 All 65 (JSON)
- 2023Consistency Modelscited by 1,778
- 2021Maximum Likelihood Training of Score-Based Diffusion Modelscited by 670
- 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributionscited by 566
- 2022Let us Build Bridges: Understanding and Extending Diffusion Generative Modelscited by 102
- 2023Improved Techniques for Maximum Likelihood Estimation for Diffusion ODEscited by 54
- 2023Diffusion Models With Learned Adaptive Noisecited by 50
- 2022First Hitting Diffusion Models for Generating Manifold, Graph and Categorical Datacited by 18
- 2023Learning Stackable and Skippable LEGO Bricks for Efficient, Reconfigurable, and Variable-Resolution Diffusion Modelingcited by 13
- 2023Diffusing Gaussian Mixtures for Generating Categorical Datacited by 4
- 2024Local Curvature Smoothing with Stein's Identity for Efficient Score Matchingcited by 0
- 2024Local Curvature Smoothing with Stein's Identity for Efficient Score Matching5 Dec 2024
- 2023Diffusion Models With Learned Adaptive Noise20 Dec 2023
- 2023Learning Stackable and Skippable LEGO Bricks for Efficient, Reconfigurable, and Variable-Resolution Diffusion Modeling10 Oct 2023
- 2023Improved Techniques for Maximum Likelihood Estimation for Diffusion ODEs6 May 2023
- 2023Diffusing Gaussian Mixtures for Generating Categorical Data8 Mar 2023
- 2023Consistency Models2 Mar 2023
- 2022First Hitting Diffusion Models for Generating Manifold, Graph and Categorical Data2 Sep 2022
- 2022Let us Build Bridges: Understanding and Extending Diffusion Generative Models31 Aug 2022
- 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributions10 Feb 2021
- 2021Maximum Likelihood Training of Score-Based Diffusion Models22 Jan 2021
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
- 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
- 2021Neural Temporal Point Processes: A Reviewcited by 113
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?cited by 84
- 2021SceneGen: Learning to Generate Realistic Traffic Scenescited by 83
- 2022An Introduction to Neural Data Compressioncited by 78
- 2021On Memorization in Probabilistic Deep Generative Modelscited by 60
- 2023One Small Step for Generative AI, One Giant Leap for AGI: A Complete Survey on ChatGPT in AIGC Eracited by 55
- 2023Autoregressive Conditional Neural Processescited by 32
- 2022Diagnosing and Fixing Manifold Overfitting in Deep Generative Modelscited by 28
- 2022CaloMan: Fast generation of calorimeter showers with density estimation on learned manifoldscited by 28
- 2021Parallel and Flexible Sampling from Autoregressive Models via Langevin Dynamicscited by 19
12 most cited of 53 All 53 (JSON)
- 2025Adaptive Symmetrization of the KL Divergence14 Nov 2025
- 2025Dataset Distillation as Data Compression: A Rate-Utility Perspective23 Jul 2025
- 2025Causal Mediation Analysis with Multiple Mediators: A Simulation Approach16 Jun 2025
- 2025Enhancing Neural Autoregressive Distribution Estimators for Image Reconstruction3 Jun 2025
- 2024Back to Bayesics: Uncovering Human Mobility Distributions and Anomalies with an Integrated Statistical and Neural Framework1 Oct 2024
- 2024ViIK: Flow-based Vision Inverse Kinematics Solver with Fusing Collision Checking21 Aug 2024
- 2024Generative Assignment Flows for Representing and Learning Joint Distributions of Discrete Data6 Jun 2024
- 2024ContextFlow++: Generalist-Specialist Flow-based Generative Models with Mixed-Variable Context Encoding2 Jun 2024
- 2024PaddingFlow: Improving Normalizing Flows with Padding-Dimensional Noise13 Mar 2024
- 2024Sequential transport maps using SoS density estimation and α-divergences27 Feb 2024
- 2024Data-efficient Large Vision Models through Sequential Autoregression7 Feb 2024
- 2024Deep Learning With DAGs12 Jan 2024
12 newest of 53 All 53 (JSON)