Generative Image Modeling Using Spatial LSTMs
Not on the map. Why?
Abstract (arXiv)
Modeling the distribution of natural images is challenging, partly because of strong statistical dependencies which can extend over hundreds of pixels. Recurrent neural networks have been successful in capturing long-range dependencies in a number of problems but only recently have found their way into generative image models. We here introduce a recurrent image model based on multi-dimensional long short-term memory units which are particularly suited for image modeling due to their spatial structure. Our model scales to images of arbitrary size and its likelihood is computationally tractable. We find that it outperforms the state of the art in quantitative comparisons on several image datasets and produces promising results when used for texture synthesis and inpainting.
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Jun 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2017: 2; 2018: 1; 2019: 0; 2020: 0; 2021: 6; 2022: 9; 2023: 4; 2024: 6; 2025: 5; 2026: 2.
35 papers.
Sort:
By area:
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
- 2022An Introduction to Neural Data Compressioncited by 78
- 2022Residual Mixture of Expertscited by 39
- 2025MoEQuant: Enhancing Quantization for Mixture-of-Experts Large Language Models via Expert-Balanced Sampling and Affinity Guidancecited by 32
- 2022Regression as Classification: Influence of Task Formulation on Neural Network Featurescited by 29
- 2022Diagnosing and Fixing Manifold Overfitting in Deep Generative Modelscited by 28
- 2023Lossless Point Cloud Geometry and Attribute Compression Using a Learned Conditional Probability Modelcited by 25
- 2021Parallel and Flexible Sampling from Autoregressive Models via Langevin Dynamicscited by 19
- 2018Breaking the gridlock in Mixture-of-Experts: Consistent and Efficient Algorithmscited by 13
- 2025Mixture of Lookup Expertscited by 11
- 2021Lossless Coding of Point Cloud Geometry using a Deep Generative Modelcited by 10
23 more
- 2024Training-efficient density quantum machine learningcited by 10
- 2024Neural Experts: Mixture of Experts for Implicit Neural Representationscited by 9
- 2023SutraNets: Sub-series Autoregressive Networks for Long-Sequence, Probabilistic Forecastingcited by 7
- 2024Designing Large Foundation Models for Efficient Training and Inference: A Surveycited by 7
- 2025MoLAE: Mixture of Latent Experts for Parameter-Efficient Language Modelscited by 7
- 2022Denoising Deep Generative Modelscited by 6
- 2021Spatial Dependency Networks: Neural Layers for Improved Generative Image Modelingcited by 5
- 2024No Need to Talk: Asynchronous Mixture of Language Modelscited by 5
- 2022Short term prediction of demand for ride hailing services: A deep learning approachcited by 4
- 2025SPRINT: Robust Model Attribution of Generated Images via Secret Pixel Reconstructioncited by 4
- 2021CAGAN: Text-To-Image Generation with Combined Attention GANscited by 2
- 2022Neural Inverse Transform Samplercited by 2
- 2017An Introduction to the Practical and Theoretical Aspects of Mixture-of-Experts Modelingcited by 1
- 2021PixelPyramids: Exact Inference Models from Lossless Image Pyramidscited by 1
- 2023Compression of GPS Trajectories using Autoencoderscited by 1
- 2023Adversarial Likelihood Estimation With One-Way Flowscited by 1
- 2024Self-Supervised Learning Based Handwriting Verificationcited by 1
- 2025Poly-Autoregressive Prediction for Modeling Interactionscited by 1
- 2022LED: Latent Variable-based Estimation of Densitycited by 0
- 2022R-MelNet: Reduced Mel-Spectral Modeling for Neural TTScited by 0
- 2024HiMoE: Heterogeneity-Informed Mixture-of-Experts for Fair Spatial-Temporal Forecastingcited by 0
- 2026A Semiparametric Framework for Stochastic Fundamental Diagram Modelingcited by 0
- 2026Logit Refiner: Improving Visual Autoregressive Models via Intra-Scale Dependency Modelingcited by 0
- 2026Logit Refiner: Improving Visual Autoregressive Models via Intra-Scale Dependency Modeling10 Sep 2026
- 2026A Semiparametric Framework for Stochastic Fundamental Diagram Modeling17 Jul 2026
- 2025SPRINT: Robust Model Attribution of Generated Images via Secret Pixel Reconstruction6 Aug 2025
- 2025MoEQuant: Enhancing Quantization for Mixture-of-Experts Large Language Models via Expert-Balanced Sampling and Affinity Guidance2 May 2025
- 2025MoLAE: Mixture of Latent Experts for Parameter-Efficient Language Models29 Mar 2025
- 2025Mixture of Lookup Experts20 Mar 2025
- 2025Poly-Autoregressive Prediction for Modeling Interactions12 Feb 2025
- 2024HiMoE: Heterogeneity-Informed Mixture-of-Experts for Fair Spatial-Temporal Forecasting30 Nov 2024
- 2024Neural Experts: Mixture of Experts for Implicit Neural Representations29 Oct 2024
- 2024No Need to Talk: Asynchronous Mixture of Language Models4 Oct 2024
- 2024Designing Large Foundation Models for Efficient Training and Inference: A Survey3 Sep 2024
- 2024Training-efficient density quantum machine learning30 May 2024
23 more
- 2024Self-Supervised Learning Based Handwriting Verification28 May 2024
- 2023SutraNets: Sub-series Autoregressive Networks for Long-Sequence, Probabilistic Forecasting22 Dec 2023
- 2023Adversarial Likelihood Estimation With One-Way Flows19 Jul 2023
- 2023Lossless Point Cloud Geometry and Attribute Compression Using a Learned Conditional Probability Model11 Mar 2023
- 2023Compression of GPS Trajectories using Autoencoders18 Jan 2023
- 2022Short term prediction of demand for ride hailing services: A deep learning approach7 Dec 2022
- 2022Denoising Deep Generative Models30 Nov 2022
- 2022Regression as Classification: Influence of Task Formulation on Neural Network Features10 Nov 2022
- 2022R-MelNet: Reduced Mel-Spectral Modeling for Neural TTS30 Jun 2022
- 2022LED: Latent Variable-based Estimation of Density23 Jun 2022
- 2022Neural Inverse Transform Sampler22 Jun 2022
- 2022Residual Mixture of Experts20 Apr 2022
- 2022Diagnosing and Fixing Manifold Overfitting in Deep Generative Models14 Apr 2022
- 2022An Introduction to Neural Data Compression14 Feb 2022
- 2021PixelPyramids: Exact Inference Models from Lossless Image Pyramids17 Oct 2021
- 2021Lossless Coding of Point Cloud Geometry using a Deep Generative Model1 Jul 2021
- 2021Parallel and Flexible Sampling from Autoregressive Models via Langevin Dynamics17 May 2021
- 2021CAGAN: Text-To-Image Generation with Combined Attention GANs26 Apr 2021
- 2021Spatial Dependency Networks: Neural Layers for Improved Generative Image Modeling16 Mar 2021
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Models8 Mar 2021
- 2018Breaking the gridlock in Mixture-of-Experts: Consistent and Efficient Algorithms21 Feb 2018
- 2017An Introduction to the Practical and Theoretical Aspects of Mixture-of-Experts Modeling12 Jul 2017
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer23 Jan 2017
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2022Residual Mixture of Expertscited by 39
- 2025MoEQuant: Enhancing Quantization for Mixture-of-Experts Large Language Models via Expert-Balanced Sampling and Affinity Guidancecited by 32
- 2018Breaking the gridlock in Mixture-of-Experts: Consistent and Efficient Algorithmscited by 13
- 2025Mixture of Lookup Expertscited by 11
- 2024Neural Experts: Mixture of Experts for Implicit Neural Representationscited by 9
- 2025MoLAE: Mixture of Latent Experts for Parameter-Efficient Language Modelscited by 7
- 2017An Introduction to the Practical and Theoretical Aspects of Mixture-of-Experts Modelingcited by 1
- 2024HiMoE: Heterogeneity-Informed Mixture-of-Experts for Fair Spatial-Temporal Forecastingcited by 0
- 2025MoEQuant: Enhancing Quantization for Mixture-of-Experts Large Language Models via Expert-Balanced Sampling and Affinity Guidance2 May 2025
- 2025MoLAE: Mixture of Latent Experts for Parameter-Efficient Language Models29 Mar 2025
- 2025Mixture of Lookup Experts20 Mar 2025
- 2024HiMoE: Heterogeneity-Informed Mixture-of-Experts for Fair Spatial-Temporal Forecasting30 Nov 2024
- 2024Neural Experts: Mixture of Experts for Implicit Neural Representations29 Oct 2024
- 2022Residual Mixture of Experts20 Apr 2022
- 2018Breaking the gridlock in Mixture-of-Experts: Consistent and Efficient Algorithms21 Feb 2018
- 2017An Introduction to the Practical and Theoretical Aspects of Mixture-of-Experts Modeling12 Jul 2017
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer23 Jan 2017
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
- 2022An Introduction to Neural Data Compressioncited by 78
- 2022Regression as Classification: Influence of Task Formulation on Neural Network Featurescited by 29
- 2022Diagnosing and Fixing Manifold Overfitting in Deep Generative Modelscited by 28
- 2023Lossless Point Cloud Geometry and Attribute Compression Using a Learned Conditional Probability Modelcited by 25
- 2021Parallel and Flexible Sampling from Autoregressive Models via Langevin Dynamicscited by 19
- 2021Lossless Coding of Point Cloud Geometry using a Deep Generative Modelcited by 10
- 2024Training-efficient density quantum machine learningcited by 10
- 2023SutraNets: Sub-series Autoregressive Networks for Long-Sequence, Probabilistic Forecastingcited by 7
- 2024Designing Large Foundation Models for Efficient Training and Inference: A Surveycited by 7
- 2022Denoising Deep Generative Modelscited by 6
- 2021Spatial Dependency Networks: Neural Layers for Improved Generative Image Modelingcited by 5
12 most cited of 26 All 26 (JSON)
- 2026Logit Refiner: Improving Visual Autoregressive Models via Intra-Scale Dependency Modeling10 Sep 2026
- 2026A Semiparametric Framework for Stochastic Fundamental Diagram Modeling17 Jul 2026
- 2025SPRINT: Robust Model Attribution of Generated Images via Secret Pixel Reconstruction6 Aug 2025
- 2025Poly-Autoregressive Prediction for Modeling Interactions12 Feb 2025
- 2024No Need to Talk: Asynchronous Mixture of Language Models4 Oct 2024
- 2024Designing Large Foundation Models for Efficient Training and Inference: A Survey3 Sep 2024
- 2024Training-efficient density quantum machine learning30 May 2024
- 2024Self-Supervised Learning Based Handwriting Verification28 May 2024
- 2023SutraNets: Sub-series Autoregressive Networks for Long-Sequence, Probabilistic Forecasting22 Dec 2023
- 2023Adversarial Likelihood Estimation With One-Way Flows19 Jul 2023
- 2023Lossless Point Cloud Geometry and Attribute Compression Using a Learned Conditional Probability Model11 Mar 2023
- 2023Compression of GPS Trajectories using Autoencoders18 Jan 2023
12 newest of 26 All 26 (JSON)