mlsanityData to 7 Oct 2026

UFOGen: You Forward Once Large Scale Text-to-Image Generation via Diffusion GANs

arXiv 2311.09257 ↗First posted 14 Nov 2023cs.CVcited by 165

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Text-to-image diffusion models have demonstrated remarkable capabilities in transforming textual prompts into coherent images, yet the computational cost of their inference remains a persistent challenge. To address this issue, we present UFOGen, a novel generative model designed for ultra-fast, one-step text-to-image synthesis. In contrast to conventional approaches that focus on improving samplers or employing distillation techniques for diffusion models, UFOGen adopts a hybrid methodology, integrating diffusion models with a GAN objective. Leveraging a newly introduced diffusion-GAN objective and initialization with pre-trained diffusion models, UFOGen excels in efficiently generating high-quality images conditioned on textual descriptions in a single step. Beyond traditional text-to-image generation, UFOGen showcases versatility in applications. Notably, UFOGen stands among the pioneering models enabling one-step text-to-image generation and diverse downstream tasks, presenting a significant advancement in the landscape of efficient generative models.

Key facts. Cited by 165 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 61 of its 74 references that are in the map. First posted on arXiv 14 Nov 2023.

Builds on

61 of 74 references.

Closest ancestors · 14

Same direction, newest first

  1. 2023SnapFusion: Text-to-Image Diffusion Model on Mobile Devices within Two Seconds1 Jun
  2. 2023RAPHAEL: Text-to-Image Generation via Large Mixture of Diffusion Paths29 May
  3. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models16 Feb
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
  5. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models31 Jan
  6. 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis9 Dec
  7. 2022Multi-Concept Customization of Text-to-Image Diffusion8 Dec
  8. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Models23 Nov
  9. 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
  10. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoisers2 Nov
  11. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
  12. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
2 more
  1. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
  2. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec

Other references · 47

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  5. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  6. 2020Denoising Diffusion Implicit Modelscited by 9,655
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  8. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  9. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  10. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  11. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  12. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
35 more
  1. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  2. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  3. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  4. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  5. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  6. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  7. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  8. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
  9. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
  10. 2021Variational Diffusion Modelscited by 1,145
  11. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
  12. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
  13. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
  14. 2016Generative Adversarial Text to Image Synthesiscited by 735
  15. 2022On Distillation of Guided Diffusion Modelscited by 721
  16. 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
  17. 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 640
  18. 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 515
  19. 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generationcited by 511
  20. 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
  21. 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 489
  22. 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
  23. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
  24. 2022Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Modelscited by 331
  25. 2022Rectified Flow: A Marginal Preserving Approach to Optimal Transportcited by 277
  26. 2020Learning Gradient Fields for Shape Generationcited by 245
  27. 2023StyleGAN-T: Unlocking the Power of GANs for Fast Large-Scale Text-to-Image Synthesiscited by 212
  28. 2023Subject-driven Text-to-Image Generation via Apprenticeship Learningcited by 210
  29. 2022Diffusion-GAN: Training GANs with Diffusioncited by 203
  30. 2020DF-GAN: A Simple and Effective Baseline for Text-to-Image Synthesiscited by 161
  31. 2021LAFITE: Towards Language-Free Training for Text-to-Image Generationcited by 126
  32. 2022Riemannian Diffusion Modelscited by 120
  33. 2023TRACT: Denoising Diffusion Models with Transitive Closure Time-Distillationcited by 115
  34. 2022A Study on the Evaluation of Generative Modelscited by 35
  35. 2023Semi-Implicit Denoising Diffusion Models (SIDDMs)cited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 5; 2024: 70; 2025: 63; 2026: 27.

165 papers.

Sort:

By area:

  1. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  2. 2023Adversarial Diffusion Distillationcited by 741
  3. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  4. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
  5. 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 294
  6. 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 276
  7. 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 258
  8. 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 211
  9. 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 142
  10. 2024Consistency Models Made Easycited by 140
  11. 2024One-Step Image Translation with Text-to-Image Modelscited by 111
  12. 2024PeRFlow: Piecewise Rectified Flow as Universal Plug-and-Play Acceleratorcited by 95
38 more
  1. 2024Align Your Steps: Optimizing Sampling Schedules in Diffusion Modelscited by 91
  2. 2025Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generationcited by 84
  3. 2024One-Step Diffusion Policy: Fast Visuomotor Policies via Diffusion Distillationcited by 83
  4. 2024Distilling Diffusion Models into Conditional GANscited by 78
  5. 2024Multistep Distillation of Diffusion Models via Moment Matchingcited by 76
  6. 2024Simpler Diffusion (SiD2): 1.5 FID on ImageNet512 with pixel-space diffusioncited by 74
  7. 2024One-Step Diffusion Distillation through Score Implicit Matchingcited by 68
  8. 2024Multistep Consistency Modelscited by 67
  9. 2024CoMat: Aligning Text-to-Image Diffusion Model with Image-to-Text Concept Matchingcited by 60
  10. 2024EM Distillation for One-step Diffusion Modelscited by 60
  11. 2024Rectified Diffusion: Straightness Is Not Your Need in Rectified Flowcited by 59
  12. 2024Flash Diffusion: Accelerating Any Conditional Diffusion Model for Few Steps Image Generationcited by 56
  13. 2024LAPTOP-Diff: Layer Pruning and Normalized Distillation for Compressing Diffusion Modelscited by 52
  14. 2024Adversarial Diffusion Compression for Real-World Image Super-Resolutioncited by 49
  15. 2025Learning Few-Step Diffusion Models by Trajectory Distribution Matchingcited by 49
  16. 2024Adversarial Score identity Distillation: Rapidly Surpassing the Teacher in One Stepcited by 47
  17. 2025Text2Earth: Unlocking Text-driven Remote Sensing Image Generation with a Global-Scale Dataset and a Foundation Modelcited by 46
  18. 2024SwiftBrush v2: Make Your One-step Diffusion Model Better Than Its Teachercited by 45
  19. 2025SeedVR2: One-Step Video Restoration via Diffusion Adversarial Post-Trainingcited by 45
  20. 2025One-step Diffusion Models with f-Divergence Distribution Matchingcited by 43
  21. 2025StreamDiT: Real-Time Streaming Text-to-Video Generationcited by 43
  22. 2023MobileDiffusion: Instant Text-to-Image Generation on Mobile Devicescited by 42
  23. 2024SF-V: Single Forward Video Generation Modelcited by 40
  24. 2025Adversarial Distribution Matching for Diffusion Distillation Towards Efficient Image and Video Synthesiscited by 39
  25. 2024Motion Consistency Model: Accelerating Video Diffusion with Disentangled Motion-Appearance Distillationcited by 38
  26. 2024Imagine Flash: Accelerating Emu Diffusion Models with Backward Distillationcited by 37
  27. 2024OSV: One Step is Enough for High-Quality Image to Video Generationcited by 36
  28. 2025LBM: Latent Bridge Matching for Fast Image-to-Image Translationcited by 36
  29. 2026DiffusionOPD: A Unified Perspective of On-Policy Distillation in Diffusion Modelscited by 35
  30. 2025FlashVideo: Flowing Fidelity to Detail for Efficient High-Resolution Video Generationcited by 32
  31. 2024Simple and Fast Distillation of Diffusion Modelscited by 31
  32. 2024SlimFlow: Training Smaller One-Step Diffusion Models with Rectified Flowcited by 30
  33. 2024Diff-Instruct++: Training One-step Text-to-image Generator Model to Align with Human Preferencescited by 30
  34. 2025Accelerated Diffusion Models via Speculative Samplingcited by 30
  35. 2024Diffusion Models Meet Remote Sensing: Principles, Methods, and Perspectivescited by 27
  36. 2024PaGoDA: Progressive Growing of a One-Step Generator from a Low-Resolution Diffusion Teachercited by 27
  37. 2024SnapGen: Taming High-Resolution Text-to-Image Models for Mobile Devices with Efficient Architectures and Trainingcited by 27
  38. 2024Flow Generator Matchingcited by 26

50 most cited of 165 All 165 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2022Implementing and Experimenting with Diffusion Models for Text-to-Image Generation
  2. 2023RenAIssance: A Survey into AI Text-to-Image Generation in the Era of Large Model
  3. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translation
  4. 2023Text-to-image Diffusion Models in Generative AI: A Survey
  5. 2022Diffusion Guided Domain Adaptation of Image Generators
  6. 2023IT3D: Improved Text-to-3D Generation with Explicit View Synthesis
  7. 2024MaxFusion: Plug&Play Multi-Modal Generation in Text-to-Image Diffusion Models
  8. 2026ImageRAGTurbo: Towards One-step Text-to-Image Generation with Retrieval-Augmented Diffusion Models