Deep AutoRegressive Networks
Not on the map. Why?
Abstract (arXiv)
We introduce a deep, generative autoencoder capable of learning hierarchies of distributed representations from data. Successive deep stochastic hidden layers are equipped with autoregressive connections, which enable the model to be sampled from quickly and exactly via ancestral sampling. We derive an efficient approximate parameter estimation method based on the minimum description length (MDL) principle, which can be seen as maximising a variational lower bound on the log-likelihood, with a feedforward neural network implementing approximate inference. We demonstrate state-of-the-art generative performance on a number of classic data sets: several UCI data sets, MNIST and Atari 2600 games.
Key facts. Cited by 60 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 Oct 2013.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 5; 2023: 15; 2024: 14; 2025: 16; 2026: 2.
60 papers.
Sort:
By area:
- 2024Autoregressive Image Generation without Vector Quantizationcited by 644
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
- 2024Fluid: Scaling Autoregressive Text-to-image Generative Models with Continuous Tokenscited by 147
- 2021UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Modelscited by 133
- 2024Randomized Autoregressive Visual Generationcited by 125
- 2021Multimodal Image Synthesis and Editing: The Generative AI Eracited by 52
- 2025Unified Autoregressive Visual Generation and Understanding with Continuous Tokenscited by 51
- 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 50
- 2024Community Forensics: Using Thousands of Generators to Train Fake Image Detectorscited by 50
- 2025Democratizing Text-to-Image Masked Generative Models with Compact Text-Aware One-Dimensional Tokenscited by 48
- 2023Regularized Vector Quantization for Tokenized Image Synthesiscited by 46
- 2021HDMapGen: A Hierarchical Graph Generative Model of High Definition Mapscited by 40
38 more
- 2023Bridging Discrete and Backpropagation: Straight-Through and Beyondcited by 31
- 2024Counting Ability of Large Language Models and Impact of Tokenizationcited by 29
- 2021Probabilistic Mixture-of-Experts for Efficient Deep Reinforcement Learningcited by 26
- 2023Sampling with flows, diffusion and autoregressive neural networks: A spin-glass perspectivecited by 26
- 2021Feature Shift Detection: Localizing Which Features Have Shifted via Conditional Distribution Testscited by 24
- 2023MedDiff: Generating Electronic Health Records using Accelerated Denoising Diffusion Modelcited by 22
- 2023Catch Missing Details: Image Reconstruction with Frequency Augmented Variational Autoencodercited by 18
- 2023Towards Long-Term Time-Series Forecasting: Feature, Pattern, and Distributioncited by 15
- 2024APEX: An Extensible and Dynamism-Aware Simulator for Automated Parallel Execution in LLM Servingcited by 15
- 2021Tensor networks and efficient descriptions of classical datacited by 13
- 2023Differentiable Sampling of Categorical Distributions Using the CatLog-Derivative Trickcited by 13
- 2024Denoising with a Joint-Embedding Predictive Architecturecited by 12
- 2023Learning from Predictions: Fusing Training and Autoregressive Inference for Long-Term Spatiotemporal Forecastscited by 11
- 2025LazyMAR: Accelerating Masked Autoregressive Models via Feature Cachingcited by 11
- 2025Continuous Visual Autoregressive Generation via Score Maximizationcited by 9
- 2023The autoregressive neural network architecture of the Boltzmann distribution of pairwise interacting spins systemscited by 8
- 2024Bridging the Training-Inference Gap in LLMs by Leveraging Self-Generated Tokenscited by 7
- 2025REAR: Rethinking Visual Autoregressive Models via Generator-Tokenizer Consistency Regularizationcited by 6
- 2025VA-π: Variational Policy Alignment for Pixel-Aware Autoregressive Generationcited by 6
- 2024Message Passing Variational Autoregressive Network for Solving Intractable Ising Modelscited by 5
- 2025The Alpha-Alternator: Dynamic Adaptation To Varying Noise Levels In Sequences Using The Vendi Score For Improved Robustness and Performancecited by 5
- 2025Direction-Aware Diagonal Autoregressive Image Generationcited by 5
- 2025DiffNMR: Diffusion Models for Nuclear Magnetic Resonance Spectra Elucidationcited by 5
- 2021Bias-Variance Tradeoffs in Single-Sample Binary Gradient Estimatorscited by 4
- 20223D Brain and Heart Volume Generative Models: A Surveycited by 4
- 2024E-CAR: Efficient Continuous Autoregressive Image Generation via Multistage Modelingcited by 4
- 2025Vision-Language Model Guided Image Restorationcited by 4
- 2022NeuralFMU: Presenting a workflow for integrating hybrid NeuralODEs into real world applicationscited by 3
- 2023Symmetric Equilibrium Learning of VAEscited by 3
- 2024Alternators For Sequence Modelingcited by 3
- 2025Towards Harmonized Uncertainty Estimation for Large Language Modelscited by 3
- 2023Statistical Parameterized Physics-Based Machine Learning Digital Twin Models for Laser Powder Bed Fusion Processcited by 2
- 2025Generation then Reconstruction: Accelerating Masked Autoregressive Models via Two-Stage Samplingcited by 2
- 2023A Survey of Blockchain, Artificial Intelligence, and Edge Computing for Web 3.0cited by 1
- 2024Model-Based Counterfactual Explanations Incorporating Feature Space Attributes for Tabular Datacited by 1
- 2024TrajLearn: Trajectory Prediction Learning using Deep Generative Modelscited by 1
- 2025Poly-Autoregressive Prediction for Modeling Interactionscited by 1
- 2025AutoCas: Autoregressive Cascade Predictor in Social Networks via Large Language Modelscited by 1
50 most cited of 60 All 60 (JSON)
- 2026Post-training Quantization for Hybrid Iterative Generative Models14 Aug 2026
- 2026VPG: Visual Prefix Guidance for Autoregressive Image and Video Generation28 May 2026
- 2025VA-π: Variational Policy Alignment for Pixel-Aware Autoregressive Generation22 Dec 2025
- 2025Vision-Language Model Guided Image Restoration19 Dec 2025
- 2025ShapeGen: Towards High-Quality 3D Shape Synthesis25 Nov 2025
- 2025Generation then Reconstruction: Accelerating Masked Autoregressive Models via Two-Stage Sampling20 Oct 2025
- 2025REAR: Rethinking Visual Autoregressive Models via Generator-Tokenizer Consistency Regularization6 Oct 2025
- 2025DiffNMR: Diffusion Models for Nuclear Magnetic Resonance Spectra Elucidation9 Jul 2025
- 2025Towards Harmonized Uncertainty Estimation for Large Language Models25 May 2025
- 2025Continuous Visual Autoregressive Generation via Score Maximization12 May 2025
- 2025Unified Autoregressive Visual Generation and Understanding with Continuous Tokens17 Mar 2025
- 2025LazyMAR: Accelerating Masked Autoregressive Models via Feature Caching16 Mar 2025
38 more
- 2025Direction-Aware Diagonal Autoregressive Image Generation14 Mar 2025
- 2025AutoCas: Autoregressive Cascade Predictor in Social Networks via Large Language Models25 Feb 2025
- 2025Poly-Autoregressive Prediction for Modeling Interactions12 Feb 2025
- 2025The Alpha-Alternator: Dynamic Adaptation To Varying Noise Levels In Sequences Using The Vendi Score For Improved Robustness and Performance7 Feb 2025
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generation21 Jan 2025
- 2025Democratizing Text-to-Image Masked Generative Models with Compact Text-Aware One-Dimensional Tokens13 Jan 2025
- 2024TrajLearn: Trajectory Prediction Learning using Deep Generative Models30 Dec 2024
- 2024E-CAR: Efficient Continuous Autoregressive Image Generation via Multistage Modeling18 Dec 2024
- 2024APEX: An Extensible and Dynamism-Aware Simulator for Automated Parallel Execution in LLM Serving26 Nov 2024
- 2024Community Forensics: Using Thousands of Generators to Train Fake Image Detectors6 Nov 2024
- 2024Randomized Autoregressive Visual Generation1 Nov 2024
- 2024Counting Ability of Large Language Models and Impact of Tokenization25 Oct 2024
- 2024Bridging the Training-Inference Gap in LLMs by Leveraging Self-Generated Tokens18 Oct 2024
- 2024Fluid: Scaling Autoregressive Text-to-image Generative Models with Continuous Tokens17 Oct 2024
- 2024Denoising with a Joint-Embedding Predictive Architecture2 Oct 2024
- 2024Autoregressive Image Generation without Vector Quantization17 Jun 2024
- 2024Alternators For Sequence Modeling20 May 2024
- 2024Model-Based Counterfactual Explanations Incorporating Feature Space Attributes for Tabular Data20 Apr 2024
- 2024Hardware-aware training of models with synaptic delays for digital event-driven neuromorphic processors16 Apr 2024
- 2024Message Passing Variational Autoregressive Network for Solving Intractable Ising Models9 Apr 2024
- 2023A Survey of Blockchain, Artificial Intelligence, and Edge Computing for Web 3.022 Nov 2023
- 2023Differentiable Sampling of Categorical Distributions Using the CatLog-Derivative Trick21 Nov 2023
- 2023Statistical Parameterized Physics-Based Machine Learning Digital Twin Models for Laser Powder Bed Fusion Process14 Nov 2023
- 2023Sampling with flows, diffusion and autoregressive neural networks: A spin-glass perspective27 Aug 2023
- 2023Symmetric Equilibrium Learning of VAEs19 Jul 2023
- 2023Catch Missing Details: Image Reconstruction with Frequency Augmented Variational Autoencoder4 May 2023
- 2023Bridging Discrete and Backpropagation: Straight-Through and Beyond17 Apr 2023
- 2023Learning Sparsity of Representations with Discrete Latent Variables3 Apr 2023
- 2023Continuous Indeterminate Probability Neural Network23 Mar 2023
- 2023Indeterminate Probability Theory21 Mar 2023
- 2023Regularized Vector Quantization for Tokenized Image Synthesis11 Mar 2023
- 2023Learning from Predictions: Fusing Training and Autoregressive Inference for Long-Term Spatiotemporal Forecasts22 Feb 2023
- 2023The autoregressive neural network architecture of the Boltzmann distribution of pairwise interacting spins systems16 Feb 2023
- 2023MedDiff: Generating Electronic Health Records using Accelerated Denoising Diffusion Model8 Feb 2023
- 2023Towards Long-Term Time-Series Forecasting: Feature, Pattern, and Distribution5 Jan 2023
- 2022β-Multivariational Autoencoder for Entangled Representation Learning in Video Frames22 Nov 2022
- 20223D Brain and Heart Volume Generative Models: A Survey12 Oct 2022
- 2022Tighter Variational Bounds are Not Necessarily Better. A Research Report on Implementation, Ablation Study, and Extensions23 Sep 2022
50 newest of 60 All 60 (JSON)
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
- 2021UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Modelscited by 133
- 2023MedDiff: Generating Electronic Health Records using Accelerated Denoising Diffusion Modelcited by 22
- 2024Denoising with a Joint-Embedding Predictive Architecturecited by 12
- 2025DiffNMR: Diffusion Models for Nuclear Magnetic Resonance Spectra Elucidationcited by 5
- 2025DiffNMR: Diffusion Models for Nuclear Magnetic Resonance Spectra Elucidation9 Jul 2025
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generation21 Jan 2025
- 2024Denoising with a Joint-Embedding Predictive Architecture2 Oct 2024
- 2023MedDiff: Generating Electronic Health Records using Accelerated Denoising Diffusion Model8 Feb 2023
- 2021UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Models12 Apr 2021
- 2025Vision-Language Model Guided Image Restorationcited by 4
- 2025Vision-Language Model Guided Image Restoration19 Dec 2025
- 2024Autoregressive Image Generation without Vector Quantizationcited by 644
- 2024Fluid: Scaling Autoregressive Text-to-image Generative Models with Continuous Tokenscited by 147
- 2024Randomized Autoregressive Visual Generationcited by 125
- 2021Multimodal Image Synthesis and Editing: The Generative AI Eracited by 52
- 2025Unified Autoregressive Visual Generation and Understanding with Continuous Tokenscited by 51
- 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 50
- 2024Community Forensics: Using Thousands of Generators to Train Fake Image Detectorscited by 50
- 2025Democratizing Text-to-Image Masked Generative Models with Compact Text-Aware One-Dimensional Tokenscited by 48
- 2023Regularized Vector Quantization for Tokenized Image Synthesiscited by 46
- 2021HDMapGen: A Hierarchical Graph Generative Model of High Definition Mapscited by 40
- 2023Bridging Discrete and Backpropagation: Straight-Through and Beyondcited by 31
- 2023Sampling with flows, diffusion and autoregressive neural networks: A spin-glass perspectivecited by 26
12 most cited of 45 All 45 (JSON)
- 2026VPG: Visual Prefix Guidance for Autoregressive Image and Video Generation28 May 2026
- 2025ShapeGen: Towards High-Quality 3D Shape Synthesis25 Nov 2025
- 2025Generation then Reconstruction: Accelerating Masked Autoregressive Models via Two-Stage Sampling20 Oct 2025
- 2025Towards Harmonized Uncertainty Estimation for Large Language Models25 May 2025
- 2025Continuous Visual Autoregressive Generation via Score Maximization12 May 2025
- 2025Unified Autoregressive Visual Generation and Understanding with Continuous Tokens17 Mar 2025
- 2025Direction-Aware Diagonal Autoregressive Image Generation14 Mar 2025
- 2025AutoCas: Autoregressive Cascade Predictor in Social Networks via Large Language Models25 Feb 2025
- 2025Poly-Autoregressive Prediction for Modeling Interactions12 Feb 2025
- 2025Democratizing Text-to-Image Masked Generative Models with Compact Text-Aware One-Dimensional Tokens13 Jan 2025
- 2024TrajLearn: Trajectory Prediction Learning using Deep Generative Models30 Dec 2024
- 2024E-CAR: Efficient Continuous Autoregressive Image Generation via Multistage Modeling18 Dec 2024
12 newest of 45 All 45 (JSON)