Generative Adversarial Text to Image Synthesis
Not on the map. Why?
Cited by 170 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Automatic synthesis of realistic images from text would be interesting and useful, but current AI systems are still far from this goal. However, in recent years generic and powerful recurrent neural network architectures have been developed to learn discriminative text feature representations. Meanwhile, deep convolutional generative adversarial networks (GANs) have begun to generate highly compelling images of specific categories, such as faces, album covers, and room interiors. In this work, we develop a novel deep architecture and GAN formulation to effectively bridge these advances in text and image model- ing, translating visual concepts from characters to pixels. We demonstrate the capability of our model to generate plausible images of birds and flowers from detailed text descriptions.
Key facts. Cited by 735 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 May 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 0; 2020: 0; 2021: 148; 2022: 137; 2023: 213; 2024: 135; 2025: 76; 2026: 25.
735 papers.
Sort:
By area:
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Generative Adversarial Networkscited by 5,603
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2021Transformers in Vision: A Surveycited by 1,009
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
38 more
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
- 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 691
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
- 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
- 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
- 2022Blended Latent Diffusioncited by 430
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
- 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 358
- 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 343
- 2022Text2LIVE: Text-Driven Layered Image and Video Editingcited by 312
- 2023Ablating Concepts in Text-to-Image Diffusion Modelscited by 312
- 2023Training-Free Layout Control with Cross-Attention Guidancecited by 312
- 2023Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generationcited by 300
- 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
- 2023Text-to-image Diffusion Models in Generative AI: A Surveycited by 264
- 2021Cross-Modal Contrastive Learning for Text-to-Image Generationcited by 259
- 2023Generating Images with Multimodal Language Modelscited by 259
- 2022Diffsound: Discrete Diffusion Model for Text-to-sound Generationcited by 256
- 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 253
- 2022DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Modelscited by 230
- 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 230
- 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMscited by 224
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
- 2022SpaText: Spatio-Textual Representation for Controllable Image Generationcited by 217
- 2023StyleGAN-T: Unlocking the Power of GANs for Fast Large-Scale Text-to-Image Synthesiscited by 212
- 2021More Control for Free! Image Synthesis with Semantic Diffusion Guidancecited by 211
- 2023Controlling Text-to-Image Diffusion by Orthogonal Finetuningcited by 207
- 2022Optimizing Prompts for Text-to-Image Generationcited by 204
- 2023To Generate or Not? Safety-Driven Unlearned Diffusion Models Are Still Easy To Generate Unsafe Images ... For Nowcited by 204
- 2021CLIPDraw: Exploring Text-to-Drawing Synthesis through Language-Image Encoderscited by 186
- 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 184
- 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 182
- 2022Depth-Aware Generative Adversarial Network for Talking Head Video Generationcited by 177
- 2022ReCo: Region-Controlled Text-to-Image Generationcited by 177
- 2024InstanceDiffusion: Instance-level Control for Image Generationcited by 175
50 most cited of 735 All 735 (JSON)
- 2026Sphere Encoder 21 Oct 2026
- 2026PromptKWS: A Novel Prompt-Guided Open-Vocabulary Keyword Spotting Framework11 Aug 2026
- 2026PRISM: Prompt Refinement via Image-grounded Self-rewarding Mechanism for Text-to-Image Generation27 Jul 2026
- 2026Motion4Motion: Motion Transfer Across Subjects at Inference13 Jul 2026
- 2026MythraGen: Two-Stage Retrieval Augmented Art Generation Framework22 Jun 2026
- 2026RepFusion: Leveraging Multimodal Priors for Denoising in Representation Space12 Jun 2026
- 2026BLM-SGAN: Bidirectional Language Modeling for Semantic-Spatial Text-to-Image Generation7 Jun 2026
- 2026COLLAR: Cascaded Object-Level Latent Refinement for High-Fidelity Conditional Generation31 May 2026
- 2026Envisioning Beyond the Few: Disentangled Semantics and Primitives for Few-Shot Atypical Layout-to-Image Generation29 May 2026
- 2026Conformal Reliability: A New Evaluation Metric for Conditional Generation29 May 2026
- 2026DyCoRM: Dynamic Criterion-Aware Reward Modeling for Text-to-Image Generation25 May 2026
- 2026Boosting Text-to-Image Diffusion Models via Core Token Attention-Based Seed Selection19 May 2026
38 more
- 2026Power Reinforcement Post-Training of Text-to-Image Models with Super-Linear Advantage Shaping11 May 2026
- 2026Who Defines Fairness? Target-Based Prompting for Demographic Representation in Generative Models22 Apr 2026
- 2026Text2Arch: A Dataset for Generating Scientific Architecture Diagrams from Natural Language Descriptions16 Apr 2026
- 2026Verify Claimed Text-to-Image Models via Boundary-Aware Prompt Optimization27 Mar 2026
- 2026CRAFT: Aligning Diffusion Models with Fine-Tuning Is Easier Than You Think19 Mar 2026
- 2026Agentic Flow Steering and Parallel Rollout Search for Spatially Grounded Text-to-Image Generation19 Mar 2026
- 2026BlackMirror: Black-Box Backdoor Detection for Text-to-Image Models via Instruction-Response Deviation6 Mar 2026
- 2026HiFi-Inpaint: Towards High-Fidelity Reference-Based Inpainting for Generating Detail-Preserving Human-Product Images2 Mar 2026
- 2026SesaHand: Enhancing 3D Hand Reconstruction via Controllable Generation with Semantic and Structural Alignment28 Feb 2026
- 2026Diff-PC: Identity-preserving and 3D-aware Controllable Diffusion for Zero-shot Portrait Customization31 Jan 2026
- 2026PosterVerse: A Full-Workflow Framework for Commercial-Grade Poster Generation with HTML-Based Scalable Typography7 Jan 2026
- 2026Forget Less by Learning Together through Concept Consolidation5 Jan 2026
- 2026DeepInv: A Novel Self-supervised Learning Approach for Fast and Accurate Diffusion Inversion4 Jan 2026
- 2025AnyMS: Bottom-up Attention Decoupling for Layout-guided and Training-free Multi-subject Customization29 Dec 2025
- 2025Speak the Art: A Direct Speech to Image Generation Framework24 Dec 2025
- 2025FluencyVE: Marrying Temporal-Aware Mamba with Bypass Attention for Video Editing24 Dec 2025
- 2025Dynamic Image Prompt Adapter for Scalable Zero-shot Personalized Text-to-Image Generation10 Dec 2025
- 2025Adversarial Flow Models27 Nov 2025
- 2025A Training-Free Approach for Multi-ID Customization via Attention Adjustment and Spatial Control25 Nov 2025
- 2025MINDiff: Mask-Integrated Negative Attention for Controlling Overfitting in Text-to-Image Personalization22 Nov 2025
- 2025LiteUpdate: A Lightweight Framework for Updating AI-Generated Image Detectors10 Nov 2025
- 2025Language-Enhanced Generative Modeling for Amyloid PET Synthesis from MRI and Blood Biomarkers4 Nov 2025
- 2025NSYNC: Negative Synthetic Image Generation for Contrastive Training to Improve Stylized Text-To-Image Translation3 Nov 2025
- 2025Cross-view Localization and Synthesis -- Datasets, Challenges and Opportunities26 Oct 2025
- 2025TerraGen: A Unified Multi-Task Layout Generation Framework for Remote Sensing Data Augmentation24 Oct 2025
- 2025ConsistEdit: Highly Consistent and Precise Training-free Visual Editing20 Oct 2025
- 2025SONA: Learning Conditional, Unconditional, and Mismatching-Aware Discriminator6 Oct 2025
- 2025Mirage: Unveiling Hidden Artifacts in Synthetic Images with Large Vision-Language Models4 Oct 2025
- 2025One-shot Conditional Sampling: MMD meets Nearest Neighbors29 Sep 2025
- 2025Tumor Synthesis conditioned on Radiomics29 Sep 2025
- 2025MoveFM-R: Advancing Mobility Foundation Models via Language-driven Semantic Reasoning26 Sep 2025
- 2025Integrating Object Interaction Self-Attention and GAN-Based Debiasing for Visual Question Answering25 Sep 2025
- 2025Multimodal Prompt Decoupling Attack on the Safety Filters in Text-to-Image Models21 Sep 2025
- 2025Conditional Policy Generator for Dynamic Constraint Satisfaction and Optimization21 Sep 2025
- 2025The Iconicity of the Generated Image19 Sep 2025
- 2025PRISM: Phase-enhanced Radial-based Image Signature Mapping framework for fingerprinting AI-generated images18 Sep 2025
- 2025LazyDrag: Enabling Stable Drag-Based Editing on Multi-Modal Diffusion Transformers via Explicit Correspondence15 Sep 2025
- 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewriting4 Sep 2025
50 newest of 735 All 735 (JSON)
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
- 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 358
- 2023Ablating Concepts in Text-to-Image Diffusion Modelscited by 312
- 2023Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generationcited by 300
- 2023Text-to-image Diffusion Models in Generative AI: A Surveycited by 264
12 most cited of 162 All 162 (JSON)
- 2026COLLAR: Cascaded Object-Level Latent Refinement for High-Fidelity Conditional Generation31 May 2026
- 2026Boosting Text-to-Image Diffusion Models via Core Token Attention-Based Seed Selection19 May 2026
- 2026Who Defines Fairness? Target-Based Prompting for Demographic Representation in Generative Models22 Apr 2026
- 2026CRAFT: Aligning Diffusion Models with Fine-Tuning Is Easier Than You Think19 Mar 2026
- 2026Forget Less by Learning Together through Concept Consolidation5 Jan 2026
- 2026DeepInv: A Novel Self-supervised Learning Approach for Fast and Accurate Diffusion Inversion4 Jan 2026
- 2025FluencyVE: Marrying Temporal-Aware Mamba with Bypass Attention for Video Editing24 Dec 2025
- 2025LazyDrag: Enabling Stable Drag-Based Editing on Multi-Modal Diffusion Transformers via Explicit Correspondence15 Sep 2025
- 2025MUSE: Multi-Subject Unified Synthesis via Explicit Layout Semantic Expansion20 Aug 2025
- 2025Training-Free Text-Guided Color Editing with Multi-Modal Diffusion Transformer12 Aug 2025
- 2025Frequency-Aware Autoregressive Modeling for Efficient High-Resolution Image Synthesis28 Jul 2025
- 2025Style Composition within Distinct LoRA modules for Traditional Art16 Jul 2025
12 newest of 162 All 162 (JSON)
- 2022Blended Latent Diffusioncited by 430
- 2023Generating Images with Multimodal Language Modelscited by 259
- 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMscited by 224
- 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 182
- 2023Visual cognition in multimodal large language modelscited by 38
- 2023GPT4Video: A Unified Multimodal Large Language Model for lnstruction-Followed Understanding and Safety-Aware Generationcited by 36
- 2023Improving Compositional Text-to-image Generation with Large Vision-Language Modelscited by 24
- 2023MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokenscited by 15
- 2024TIGeR: Unifying Text-to-Image Generation and Retrieval with Large Multimodal Modelscited by 12
- 2025MedUnifier: Unifying Vision-and-Language Pre-training on Medical Data with Vision Generation Task using Discrete Visual Representationscited by 11
- 2025Self-Rewarding Large Vision-Language Models for Optimizing Prompts in Text-to-Image Generationcited by 10
- 2024Iteratively Prompting Multimodal LLMs to Reproduce Natural and AI-Generated Imagescited by 9
12 most cited of 16 All 16 (JSON)
- 2025Mirage: Unveiling Hidden Artifacts in Synthetic Images with Large Vision-Language Models4 Oct 2025
- 2025LLMControl: Grounded Control of Text-to-Image Diffusion-based Synthesis with Multimodal LLMs26 Jul 2025
- 2025Moodifier: MLLM-Enhanced Emotion-Driven Image Editing18 Jul 2025
- 2025Self-Rewarding Large Vision-Language Models for Optimizing Prompts in Text-to-Image Generation22 May 2025
- 2025MedUnifier: Unifying Vision-and-Language Pre-training on Medical Data with Vision Generation Task using Discrete Visual Representations2 Mar 2025
- 2024Multi-modal Generative AI: Multi-modal LLMs, Diffusions, and the Unification23 Sep 2024
- 2024TIGeR: Unifying Text-to-Image Generation and Retrieval with Large Multimodal Models9 Jun 2024
- 2024Iteratively Prompting Multimodal LLMs to Reproduce Natural and AI-Generated Images21 Apr 2024
- 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMs22 Jan 2024
- 2023Visual cognition in multimodal large language models27 Nov 2023
- 2023GPT4Video: A Unified Multimodal Large Language Model for lnstruction-Followed Understanding and Safety-Aware Generation25 Nov 2023
- 2023Improving Compositional Text-to-image Generation with Large Vision-Language Models10 Oct 2023
12 newest of 16 All 16 (JSON)
- 2022DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Modelscited by 230
- 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewritingcited by 38
- 2022VAEL: Bridging Variational Autoencoders and Probabilistic Logic Programmingcited by 31
- 2023Multimodality Representation Learning: A Survey on Evolution, Pretraining and Its Applicationscited by 27
- 2023Reason out Your Layout: Evoking the Layout Master from Large Language Models for Text-to-Image Synthesiscited by 16
- 2026Power Reinforcement Post-Training of Text-to-Image Models with Super-Linear Advantage Shapingcited by 3
- 2023Generating by Understanding: Neural Visual Generation with Logical Symbol Groundingscited by 2
- 2025MoveFM-R: Advancing Mobility Foundation Models via Language-driven Semantic Reasoningcited by 1
- 2026Power Reinforcement Post-Training of Text-to-Image Models with Super-Linear Advantage Shaping11 May 2026
- 2025MoveFM-R: Advancing Mobility Foundation Models via Language-driven Semantic Reasoning26 Sep 2025
- 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewriting4 Sep 2025
- 2023Reason out Your Layout: Evoking the Layout Master from Large Language Models for Text-to-Image Synthesis28 Nov 2023
- 2023Generating by Understanding: Neural Visual Generation with Logical Symbol Groundings26 Oct 2023
- 2023Multimodality Representation Learning: A Survey on Evolution, Pretraining and Its Applications1 Feb 2023
- 2022DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Models8 Feb 2022
- 2022VAEL: Bridging Variational Autoencoders and Probabilistic Logic Programming7 Feb 2022
- 2023Steal My Artworks for Fine-tuning? A Watermarking Framework for Detecting Art Theft Mimicry in Text-to-Image Modelscited by 8
- 2023T2IW: Joint Text to Image & Watermark Generationcited by 4
- 2024RogueGPT: dis-ethical tuning transforms ChatGPT4 into a Rogue AI in 158 Wordscited by 4
- 2025Multimodal Prompt Decoupling Attack on the Safety Filters in Text-to-Image Modelscited by 2
- 2026BlackMirror: Black-Box Backdoor Detection for Text-to-Image Models via Instruction-Response Deviationcited by 1
- 2026BlackMirror: Black-Box Backdoor Detection for Text-to-Image Models via Instruction-Response Deviation6 Mar 2026
- 2025Multimodal Prompt Decoupling Attack on the Safety Filters in Text-to-Image Models21 Sep 2025
- 2024RogueGPT: dis-ethical tuning transforms ChatGPT4 into a Rogue AI in 158 Words11 Jun 2024
- 2023Steal My Artworks for Fine-tuning? A Watermarking Framework for Detecting Art Theft Mimicry in Text-to-Image Models22 Nov 2023
- 2023T2IW: Joint Text to Image & Watermark Generation7 Sep 2023
- 2025ComfyGPT: A Self-Optimizing Multi-Agent System for Comprehensive ComfyUI Workflow Generationcited by 14
- 2024AesopAgent: Agent-driven Evolutionary System on Story-to-Video Productioncited by 12
- 2026Agentic Flow Steering and Parallel Rollout Search for Spatially Grounded Text-to-Image Generationcited by 1
- 2026Agentic Flow Steering and Parallel Rollout Search for Spatially Grounded Text-to-Image Generation19 Mar 2026
- 2025ComfyGPT: A Self-Optimizing Multi-Agent System for Comprehensive ComfyUI Workflow Generation22 Mar 2025
- 2024AesopAgent: Agent-driven Evolutionary System on Story-to-Video Production12 Mar 2024
- 2022Generative Adversarial Networkscited by 5,603
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
- 2021Transformers in Vision: A Surveycited by 1,009
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
- 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 691
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
- 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
- 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
12 most cited of 532 All 532 (JSON)
- 2026Sphere Encoder 21 Oct 2026
- 2026PromptKWS: A Novel Prompt-Guided Open-Vocabulary Keyword Spotting Framework11 Aug 2026
- 2026Motion4Motion: Motion Transfer Across Subjects at Inference13 Jul 2026
- 2026RepFusion: Leveraging Multimodal Priors for Denoising in Representation Space12 Jun 2026
- 2026BLM-SGAN: Bidirectional Language Modeling for Semantic-Spatial Text-to-Image Generation7 Jun 2026
- 2026Envisioning Beyond the Few: Disentangled Semantics and Primitives for Few-Shot Atypical Layout-to-Image Generation29 May 2026
- 2026Conformal Reliability: A New Evaluation Metric for Conditional Generation29 May 2026
- 2026Text2Arch: A Dataset for Generating Scientific Architecture Diagrams from Natural Language Descriptions16 Apr 2026
- 2026Verify Claimed Text-to-Image Models via Boundary-Aware Prompt Optimization27 Mar 2026
- 2026HiFi-Inpaint: Towards High-Fidelity Reference-Based Inpainting for Generating Detail-Preserving Human-Product Images2 Mar 2026
- 2026SesaHand: Enhancing 3D Hand Reconstruction via Controllable Generation with Semantic and Structural Alignment28 Feb 2026
- 2026Diff-PC: Identity-preserving and 3D-aware Controllable Diffusion for Zero-shot Portrait Customization31 Jan 2026
12 newest of 532 All 532 (JSON)