mlsanityData to 14 Oct 2026

SAGA: Learning Signal-Aligned Distributions for Improved Text-to-Image Generation

arXiv 2508.13866 ↗First posted 19 Aug 2025cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

State-of-the-art text-to-image models produce visually impressive results but often struggle with precise alignment to text prompts, leading to missing critical elements or unintended blending of distinct concepts. We propose a novel approach that learns a high-success-rate distribution conditioned on a target prompt, ensuring that generated images faithfully reflect the corresponding prompts. Our method explicitly models the signal component during the denoising process, offering fine-grained control that mitigates over-optimization and out-of-distribution artifacts. Moreover, our framework is training-free and seamlessly integrates with both existing diffusion and flow matching architectures. It also supports additional conditioning modalities -- such as bounding boxes -- for enhanced spatial alignment. Extensive experiments demonstrate that our approach outperforms current state-of-the-art methods. The code is available at https://github.com/grimalPaul/gsn-factory.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 48 of its 56 references that are in the map. First posted on arXiv 19 Aug 2025.

Builds on

48 of 56 references.

References · 48

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  8. 2022Scalable Diffusion Models with Transformerscited by 6,054
  9. 2022Classifier-Free Diffusion Guidancecited by 5,847
  10. 2022Flow Matching for Generative Modelingcited by 5,702
  11. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  12. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
36 more
  1. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  2. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  3. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  4. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  5. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  6. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  7. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
  8. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 931
  9. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
  10. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
  11. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
  12. 2024Emu3: Next-Token Prediction is All You Needcited by 781
  13. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
  14. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
  15. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
  16. 2022When and why vision-language models behave like bags-of-words, and what to do about it?cited by 610
  17. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
  18. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
  19. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
  20. 2023Universal Guidance for Diffusion Modelscited by 437
  21. 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 388
  22. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 331
  23. 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 310
  24. 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 294
  25. 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 282
  26. 2022What the DAAM: Interpreting Stable Diffusion Using Cross Attentioncited by 236
  27. 2023Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignmentcited by 171
  28. 2022Generative Modelling With Inverse Heat Dissipationcited by 167
  29. 2023Understanding the Latent Space of Diffusion Models through the Lens of Riemannian Geometrycited by 125
  30. 2024InitNO: Boosting Text-to-Image Diffusion Models via Initial Noise Optimizationcited by 123
  31. 2023Divide & Bind Your Attention for Improved Generative Semantic Nursingcited by 81
  32. 2023A-STAR: Test-time Attention Segregation and Retention for Text-to-image Synthesiscited by 78
  33. 2023A Picture is Worth a Thousand Words: Principled Recaptioning Improves Image Generationcited by 41
  34. 2023Exploiting the Signal-Leak Bias in Diffusion Modelscited by 36
  35. 2023The Lottery Ticket Hypothesis in Denoising: Towards Semantic-Driven Initializationcited by 23
  36. 2023TIAM -- A Metric for Evaluating Alignment in Text-to-Image Generationcited by 18

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Text-to-Image Alignment in Denoising-Based Models through Step Selection
  2. 2025Asynchronous Denoising Diffusion Models for Aligning Text-to-Image Generation
  3. 2023Divide, Evaluate, and Refine: Evaluating and Improving Text-to-Image Alignment with Iterative VQA Feedback
  4. 2026Alignment of Diffusion Model and Flow Matching for Text-to-Image Generation
  5. 2025Guiding What Not to Generate: Automated Negative Prompting for Text-Image Alignment
  6. 2024AlignIT: Enhancing Prompt Alignment in Customization of Text-to-Image Models
  7. 2025M3T2IBench: A Large-Scale Multi-Category, Multi-Instance, Multi-Relation Text-to-Image Benchmark
  8. 2023Aligning Text-to-Image Models using Human Feedback