mlsanityData to 14 Oct 2026

Generating Images from Captions with Attention

arXiv 1511.02793 ↗First posted 9 Nov 2015cs.LG cs.CVcited by 136

Not on the map. Why?

Cited by 47 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Motivated by the recent progress in generative models, we introduce a model that generates images from natural language descriptions. The proposed model iteratively draws patches on a canvas, while attending to the relevant words in the description. After training on Microsoft COCO, we compare our model with several baseline generative models on image generation and retrieval tasks. We demonstrate that our model produces higher quality samples than other approaches and generates images with novel scene compositions corresponding to previously unseen captions in the dataset.

Key facts. Cited by 136 papers in the map (data through 14 Oct 2026). First posted on arXiv 9 Nov 2015.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 19; 2022: 17; 2023: 53; 2024: 34; 2025: 10; 2026: 3.

136 papers.

Sort:

By area:

  1. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  2. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  3. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  4. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
  5. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
  6. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
  7. 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 694
  8. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
  9. 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
  10. 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
  11. 2022Blended Latent Diffusioncited by 432
  12. 2023Ablating Concepts in Text-to-Image Diffusion Modelscited by 317
38 more
  1. 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 287
  2. 2023Text-to-image Diffusion Models in Generative AI: A Surveycited by 265
  3. 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 231
  4. 2022DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Modelscited by 230
  5. 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 205
  6. 2023JourneyDB: A Benchmark for Generative Image Understandingcited by 205
  7. 2023SneakyPrompt: Jailbreaking Text-to-image Generative Modelscited by 189
  8. 2023Swap Attention in Spatiotemporal Diffusions for Text-to-Video Generationcited by 154
  9. 2023Getting aligned on representational alignmentcited by 143
  10. 2023CoDeF: Content Deformation Fields for Temporally Consistent Video Processingcited by 108
  11. 2021Paint by Wordcited by 107
  12. 2023Cones 2: Customizable Image Synthesis with Multiple Subjectscited by 101
  13. 2021D2C: Diffusion-Denoising Models for Few-shot Conditional Generationcited by 96
  14. 2023Expressive Text-to-Image Generation with Rich Textcited by 89
  15. 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?cited by 84
  16. 2022Frido: Feature Pyramid Diffusion for Complex Scene Image Synthesiscited by 75
  17. 2021Learning to Compose Visual Relationscited by 72
  18. 2021FuseDream: Training-Free Text-to-Image Generation with Improved CLIP+GAN Space Optimizationcited by 71
  19. 2024Analysis of Classifier-Free Guidance Weight Schedulerscited by 68
  20. 2022Synthetic Data -- what, why and how?cited by 67
  21. 2023Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Modelscited by 67
  22. 2023ITI-GEN: Inclusive Text-to-Image Generationcited by 64
  23. 2024PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinementcited by 62
  24. 2021Generating images from caption and vice versa via CLIP-Guided Generative Latent Space Searchcited by 57
  25. 2022AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatarscited by 55
  26. 2023One Small Step for Generative AI, One Giant Leap for AGI: A Complete Survey on ChatGPT in AIGC Eracited by 55
  27. 2023Visual Programming for Text-to-Image Generation and Evaluationcited by 54
  28. 2021Multimodal Image Synthesis and Editing: The Generative AI Eracited by 52
  29. 2023RenAIssance: A Survey into AI Text-to-Image Generation in the Era of Large Modelcited by 47
  30. 2021DAE-GAN: Dynamic Aspect-aware GAN for Text-to-Image Synthesiscited by 45
  31. 2023Inspecting the Geographical Representativeness of Images from Text-to-Image Modelscited by 44
  32. 2024HanDiffuser: Text-to-Image Generation With Realistic Hand Appearancescited by 42
  33. 2023If at First You Don't Succeed, Try, Try Again: Faithful Diffusion-based Text-to-Image Generation by Selectioncited by 40
  34. 2024Perception-guided Jailbreak against Text-to-Image Modelscited by 40
  35. 2024A-Bench: Are LMMs Masters at Evaluating AI-generated Images?cited by 39
  36. 2023'Person' == Light-skinned, Western Man, and Sexualization of Women of Color: Stereotypes in Stable Diffusioncited by 33
  37. 2021Multimodal Dialogue Response Generationcited by 32
  38. 2022VAEL: Bridging Variational Autoencoders and Probabilistic Logic Programmingcited by 31

50 most cited of 136 All 136 (JSON)