DRAW: A Recurrent Neural Network For Image Generation
Not on the map. Why?
Abstract (arXiv)
This paper introduces the Deep Recurrent Attentive Writer (DRAW) neural network architecture for image generation. DRAW networks combine a novel spatial attention mechanism that mimics the foveation of the human eye, with a sequential variational auto-encoding framework that allows for the iterative construction of complex images. The system substantially improves on the state of the art for generative models on MNIST, and, when trained on the Street View House Numbers dataset, it generates images that cannot be distinguished from real data with the naked eye.
Key facts. Cited by 190 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Feb 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 67; 2022: 43; 2023: 31; 2024: 26; 2025: 13; 2026: 10.
190 papers.
Sort:
By area:
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 691
- 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
- 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 284
- 2021Cross-Modal Contrastive Learning for Text-to-Image Generationcited by 259
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
- 2021Attention Mechanisms in Computer Vision: A Surveycited by 232
- 2023JourneyDB: A Benchmark for Generative Image Understandingcited by 203
- 2022Scalable Adaptive Computation for Iterative Generationcited by 190
- 2021Fast Convergence of DETR with Spatially Modulated Co-Attentioncited by 176
- 2021Paint by Wordcited by 107
- 2021Generalization and Robustness Implications in Object-Centric Learningcited by 81
38 more
- 2022Frido: Feature Pyramid Diffusion for Complex Scene Image Synthesiscited by 75
- 2021Learning to Compose Visual Relationscited by 72
- 2022Synthetic Data -- what, why and how?cited by 66
- 2024PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinementcited by 61
- 2022Improving Object-centric Learning with Query Optimizationcited by 60
- 2021SemanticStyleGAN: Learning Compositional Generative Priors for Controllable Image Synthesis and Editingcited by 58
- 2024Any-Resolution AI-Generated Image Detection by Spectral Learningcited by 56
- 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 50
- 2021Consistency Regularization for Variational Auto-Encoderscited by 50
- 2023TEDi: Temporally-Entangled Diffusion for Long-Term Motion Synthesiscited by 48
- 2021Generating Synthetic Mixed-type Longitudinal Electronic Health Records for Artificial Intelligent Applicationscited by 47
- 2021DAE-GAN: Dynamic Aspect-aware GAN for Text-to-Image Synthesiscited by 45
- 2021Modern Evolution Strategies for Creativity: Fitting Concrete Images and Abstract Conceptscited by 40
- 2022Recent Advances for Quantum Neural Networks in Generative Learningcited by 39
- 2021Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AIcited by 38
- 2022Few-Shot Diffusion Modelscited by 37
- 2022Content and Style Aware Generation of Text-line Images for Handwriting Recognitioncited by 35
- 2021Multimodal Dialogue Response Generationcited by 32
- 2022VAEL: Bridging Variational Autoencoders and Probabilistic Logic Programmingcited by 31
- 2021Copyright in Generative Deep Learningcited by 29
- 2021Unsupervised Object Learning via Common Fatecited by 29
- 2022Attention Mechanism in Neural Networks: Where it Comes and Where it Goescited by 29
- 2023UniGS: Unified Representation for Image Generation and Segmentationcited by 29
- 2023Principal Uncertainty Quantification with Spatial Correlation for Image Restoration Problemscited by 28
- 2023Differential Diffusion: Giving Each Pixel Its Strengthcited by 27
- 2021Position, Padding and Predictions: A Deeper Look at Position Information in CNNscited by 26
- 2021Sign Language Production: A Reviewcited by 26
- 2021FoveaTer: Foveated Transformer for Image Classificationcited by 26
- 2021Unsupervised Foreground Extraction via Deep Region Competitioncited by 26
- 2021Conditional Image Generation by Conditioning Variational Auto-Encoderscited by 25
- 2023AI-Generated Content (AIGC) for Various Data Modalities: A Surveycited by 25
- 2021Compositional Transformers for Scene Generationcited by 24
- 2023Catastrophic Forgetting in Deep Learning: A Comprehensive Taxonomycited by 24
- 2021A survey on Variational Autoencoders from a GreenAI perspectivecited by 22
- 2024Procedural Content Generation in Games: A Survey with Insights on Emerging LLM Integrationcited by 22
- 2021Creativity and Machine Learning: A Surveycited by 21
- 2021Cascaded Cross MLP-Mixer GANs for Cross-View Image Translationcited by 21
- 2022Controllable Data Generation by Deep Learning: A Reviewcited by 20
50 most cited of 190 All 190 (JSON)
- 2026ODE-Based Transformer Decoders for Iterative Sign Language Translation11 Aug 2026
- 2026Active Spiking Perception: The Membrane Potential as a Belief State for Anytime 3D Point Cloud Recognition4 Aug 2026
- 2026Implicit Variational Rejection Sampling12 Jun 2026
- 2026Stability Enhanced Gaussian Process Variational Autoencoders10 Apr 2026
- 2026ReLU Networks for Exact Generation of Similar Graphs7 Apr 2026
- 2026Harnessing Synthetic Data from Generative AI for Statistical Inference5 Mar 2026
- 2026EyeLayer: Integrating Human Attention Patterns into LLM-Based Code Summarization25 Feb 2026
- 2026Stroke of Surprise: Progressive Semantic Illusions in Vector Sketching12 Feb 2026
- 2026Tuning the burn-in phase in training recurrent neural networks improves their performance11 Feb 2026
- 2026ResTok: Learning Hierarchical Residuals in 1D Visual Tokenizers for Autoregressive Image Generation7 Jan 2026
- 2025Hierarchical Vector-Quantized Latents for Perceptual Low-Resolution Video Compression31 Dec 2025
- 2025Ksurf-Drone: Attention Kalman Filter for Contextual Bandit Optimization in Cloud Resource Allocation12 Nov 2025
38 more
- 2025Generative AI in Depth: A Survey of Recent Advances, Model Variants, and Real-World Applications23 Oct 2025
- 2025Designing ReLU Generative Networks to Enumerate Trees with a Given Tree Edit Distance12 Oct 2025
- 2025An overview of neural architectures for self-supervised audio representation learning from masked spectrograms23 Sep 2025
- 2025AttZoom: Attention Zoom for Better Visual Features5 Aug 2025
- 2025Continuous Semi-Implicit Models7 Jun 2025
- 2025Maximum Likelihood Learning of Latent Dynamics Without Reconstruction29 May 2025
- 2025Long-Term Individual Causal Effect Estimation via Identifiable Latent Representation Learning8 May 2025
- 2025Wavelet-based Variational Autoencoders for High-Resolution Image Generation16 Apr 2025
- 2025Mechanisms of Projective Composition of Diffusion Models6 Feb 2025
- 2025Text-to-Image Generation for Vocabulary Learning Using the Keyword Method28 Jan 2025
- 2025Synthesising Activity Participations and Scheduling with Deep Generative Machine Learning17 Jan 2025
- 2024HTR-JAND: Handwritten Text Recognition with Joint Attention Network and Knowledge Distillation24 Dec 2024
- 2024Contextual Feedback Loops: Amplifying Deep Reasoning with Iterative Top-Down Feedback23 Dec 2024
- 2024A Decade of Deep Learning: A Survey on The Magnificent Seven13 Dec 2024
- 2024Any-Resolution AI-Generated Image Detection by Spectral Learning28 Nov 2024
- 2024A Review of Bayesian Uncertainty Quantification in Deep Probabilistic Image Segmentation25 Nov 2024
- 2024Procedural Content Generation in Games: A Survey with Insights on Emerging LLM Integration21 Oct 2024
- 2024Level of agreement between emotions generated by Artificial Intelligence and human evaluation: a methodological proposal10 Oct 2024
- 2024Face Mask Removal with Region-attentive Face Inpainting10 Sep 2024
- 2024Evolution of Detection Performance throughout the Online Lifespan of Synthetic Images21 Aug 2024
- 2024Exploring the Effectiveness of Object-Centric Representations in Visual Question Answering: Comparative Insights with Foundation Models22 Jul 2024
- 2024Progressive Pretext Task Learning for Human Trajectory Prediction16 Jul 2024
- 2024Synthetic Test Data Generation Using Recurrent Neural Networks: A Position Paper7 Jul 2024
- 2024TRIP: Trainable Region-of-Interest Prediction for Hardware-Efficient Neuromorphic Processing on Event-based Vision25 Jun 2024
- 2024Guided Score identity Distillation for Data-Free One-Step Text-to-Image Generation3 Jun 2024
- 2024BRACTIVE: A Brain Activation Approach to Human Visual Brain Learning29 May 2024
- 2024Bridging the Intent Gap: Knowledge-Enhanced Visual Generation21 May 2024
- 2024SwipeGANSpace: Swipe-to-Compare Image Generation via Efficient Latent Space Exploration30 Apr 2024
- 2024DSDRNet: Disentangling Representation and Reconstruct Network for Domain Generalization22 Apr 2024
- 2024StreakNet-Arch: An Anti-scattering Network-based Architecture for Underwater Carrier LiDAR-Radar Imaging14 Apr 2024
- 2024A Mutual Inclusion Mechanism for Precise Boundary Segmentation in Medical Images12 Apr 2024
- 2024Generative AI Models for Different Steps in Architectural Design: A Literature Review30 Mar 2024
- 2024PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinement6 Mar 2024
- 2024MCA: Moment Channel Attention Networks4 Mar 2024
- 2024A Statistical Analysis of Wasserstein Autoencoders for Intrinsically Low-dimensional Data24 Feb 2024
- 2024Text2Street: Controllable Text-to-image Generation for Street Views7 Feb 2024
- 2024Integrative Variational Autoencoders for Generative Modeling of an Image Outcome with Multiple Input Images5 Feb 2024
- 2023Catastrophic Forgetting in Deep Learning: A Comprehensive Taxonomy16 Dec 2023
50 newest of 190 All 190 (JSON)
- 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 284
- 2022Scalable Adaptive Computation for Iterative Generationcited by 190
- 2022Frido: Feature Pyramid Diffusion for Complex Scene Image Synthesiscited by 75
- 2024PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinementcited by 61
- 2023TEDi: Temporally-Entangled Diffusion for Long-Term Motion Synthesiscited by 48
- 2022Few-Shot Diffusion Modelscited by 37
- 2023UniGS: Unified Representation for Image Generation and Segmentationcited by 29
- 2023Differential Diffusion: Giving Each Pixel Its Strengthcited by 27
- 2024Text2Street: Controllable Text-to-image Generation for Street Viewscited by 13
- 2025Mechanisms of Projective Composition of Diffusion Modelscited by 13
- 2024Generative AI Models for Different Steps in Architectural Design: A Literature Reviewcited by 12
- 2024Guided Score identity Distillation for Data-Free One-Step Text-to-Image Generationcited by 10
12 most cited of 15 All 15 (JSON)
- 2025Generative AI in Depth: A Survey of Recent Advances, Model Variants, and Real-World Applications23 Oct 2025
- 2025Continuous Semi-Implicit Models7 Jun 2025
- 2025Mechanisms of Projective Composition of Diffusion Models6 Feb 2025
- 2024Guided Score identity Distillation for Data-Free One-Step Text-to-Image Generation3 Jun 2024
- 2024Generative AI Models for Different Steps in Architectural Design: A Literature Review30 Mar 2024
- 2024PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinement6 Mar 2024
- 2024Text2Street: Controllable Text-to-image Generation for Street Views7 Feb 2024
- 2023UniGS: Unified Representation for Image Generation and Segmentation4 Dec 2023
- 2023TEDi: Temporally-Entangled Diffusion for Long-Term Motion Synthesis27 Jul 2023
- 2023Differential Diffusion: Giving Each Pixel Its Strength1 Jun 2023
- 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preference25 Mar 2023
- 2022Scalable Adaptive Computation for Iterative Generation22 Dec 2022
12 newest of 15 All 15 (JSON)
- 2023JourneyDB: A Benchmark for Generative Image Understandingcited by 203
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 691
- 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
- 2021Cross-Modal Contrastive Learning for Text-to-Image Generationcited by 259
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
- 2021Attention Mechanisms in Computer Vision: A Surveycited by 232
- 2021Fast Convergence of DETR with Spatially Modulated Co-Attentioncited by 176
- 2021Paint by Wordcited by 107
- 2021Generalization and Robustness Implications in Object-Centric Learningcited by 81
- 2021Learning to Compose Visual Relationscited by 72
- 2022Synthetic Data -- what, why and how?cited by 66
- 2022Improving Object-centric Learning with Query Optimizationcited by 60
12 most cited of 169 All 169 (JSON)
- 2026ODE-Based Transformer Decoders for Iterative Sign Language Translation11 Aug 2026
- 2026Active Spiking Perception: The Membrane Potential as a Belief State for Anytime 3D Point Cloud Recognition4 Aug 2026
- 2026Implicit Variational Rejection Sampling12 Jun 2026
- 2026Stability Enhanced Gaussian Process Variational Autoencoders10 Apr 2026
- 2026ReLU Networks for Exact Generation of Similar Graphs7 Apr 2026
- 2026Harnessing Synthetic Data from Generative AI for Statistical Inference5 Mar 2026
- 2026EyeLayer: Integrating Human Attention Patterns into LLM-Based Code Summarization25 Feb 2026
- 2026Stroke of Surprise: Progressive Semantic Illusions in Vector Sketching12 Feb 2026
- 2026Tuning the burn-in phase in training recurrent neural networks improves their performance11 Feb 2026
- 2026ResTok: Learning Hierarchical Residuals in 1D Visual Tokenizers for Autoregressive Image Generation7 Jan 2026
- 2025Hierarchical Vector-Quantized Latents for Perceptual Low-Resolution Video Compression31 Dec 2025
- 2025Ksurf-Drone: Attention Kalman Filter for Contextual Bandit Optimization in Cloud Resource Allocation12 Nov 2025
12 newest of 169 All 169 (JSON)