mlsanityData to 14 Oct 2026

Text-to-Image Synthesis: A Decade Survey

arXiv 2411.16164 ↗First posted 25 Nov 2024cs.CVcited by 9

Not on the map. Why?

Abstract (arXiv)

Text-to-image synthesis (T2I) focuses on generating high-quality images from textual descriptions In this survey, we review 490 papers on T2I spanning the past decade, with representative advances covered through 2026. We start by briefly introducing how GANs, autoregressive models, and diffusion models have been used for image generation, and we additionally examine the shared components whose evolution has driven recent progress. Building on this foundation, we discuss the development of these models for T2I and organize cutting-edge research by problem rather than by chronology alone, covering controllability, personalized and identity-preserving generation, instruction-based image editing, preference alignment and post-training with human and AI feedback, efficiency, safety, and consistency in content and spatial relationships. We further review unified multimodal understanding-and-generation models, summarize the datasets and evaluation metrics commonly used in T2I research, and provide a comparative discussion of the three paradigms together with their respective trade-offs. Finally, we discuss the potential applications of T2I within AIGC, along with the challenges and forward-looking research opportunities in this field.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 135 of its 446 references that are in the map. First posted on arXiv 25 Nov 2024.

Builds on

135 of 446 references.

References · 135

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  7. 2022Classifier-Free Diffusion Guidancecited by 5,847
  8. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
  9. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  10. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  11. 2013Auto-Encoding Variational Bayescited by 4,053
  12. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
38 more
  1. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  2. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  3. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  4. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  5. 2014Conditional Generative Adversarial Netscited by 2,162
  6. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,989
  7. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  8. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
  9. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  10. 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,462
  11. 2018Demystifying MMD GANscited by 1,293
  12. 2023A Survey on Multimodal Large Language Modelscited by 909
  13. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
  14. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
  15. 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 752
  16. 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 648
  17. 2022When and why vision-language models behave like bags-of-words, and what to do about it?cited by 610
  18. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
  19. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
  20. 2024OmniGen: Unified Image Generationcited by 394
  21. 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 388
  22. 2020Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stoppingcited by 384
  23. 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 379
  24. 2024Learning to (Learn at Test Time): RNNs with Expressive Hidden Statescited by 355
  25. 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 337
  26. 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generationcited by 329
  27. 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
  28. 2023Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystackcited by 279
  29. 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 279
  30. 2016Revisiting Classifier Two-Sample Testscited by 268
  31. 2023Text-to-image Diffusion Models in Generative AI: A Surveycited by 265
  32. 2022Red-Teaming the Stable Diffusion Safety Filtercited by 264
  33. 2024Playground v2.5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generationcited by 256
  34. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 247
  35. 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Modelscited by 243
  36. 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
  37. 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 201
  38. 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 185

50 most cited of 135 All 135 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 7; 2026: 2.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Text to Image Generation and Editing: A Survey
  2. 2023RenAIssance: A Survey into AI Text-to-Image Generation in the Era of Large Model
  3. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translation
  4. 2026Unified Text-Image Generation with Weakness-Targeted Post-Training
  5. 2023KOALA: Empirical Lessons Toward Memory-Efficient and Fast Diffusion Models for Text-to-Image Synthesis
  6. 2025Few-Step Distillation for Text-to-Image Generation: A Practical Guide
  7. 2023Rich Human Feedback for Text-to-Image Generation
  8. 2022Implementing and Experimenting with Diffusion Models for Text-to-Image Generation