SAGA: Learning Signal-Aligned Distributions for Improved Text-to-Image Generation
Not on the map. Why?
Abstract (arXiv)
State-of-the-art text-to-image models produce visually impressive results but often struggle with precise alignment to text prompts, leading to missing critical elements or unintended blending of distinct concepts. We propose a novel approach that learns a high-success-rate distribution conditioned on a target prompt, ensuring that generated images faithfully reflect the corresponding prompts. Our method explicitly models the signal component during the denoising process, offering fine-grained control that mitigates over-optimization and out-of-distribution artifacts. Moreover, our framework is training-free and seamlessly integrates with both existing diffusion and flow matching architectures. It also supports additional conditioning modalities -- such as bounding boxes -- for enhanced spatial alignment. Extensive experiments demonstrate that our approach outperforms current state-of-the-art methods. The code is available at https://github.com/grimalPaul/gsn-factory.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 48 of its 56 references that are in the map. First posted on arXiv 19 Aug 2025.
Builds on
48 of 56 references.
References · 48
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
36 more
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 931
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
- 2024Emu3: Next-Token Prediction is All You Needcited by 781
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
- 2022When and why vision-language models behave like bags-of-words, and what to do about it?cited by 610
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
- 2023Universal Guidance for Diffusion Modelscited by 437
- 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 388
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 331
- 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 310
- 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 294
- 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 282
- 2022What the DAAM: Interpreting Stable Diffusion Using Cross Attentioncited by 236
- 2023Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignmentcited by 171
- 2022Generative Modelling With Inverse Heat Dissipationcited by 167
- 2023Understanding the Latent Space of Diffusion Models through the Lens of Riemannian Geometrycited by 125
- 2024InitNO: Boosting Text-to-Image Diffusion Models via Initial Noise Optimizationcited by 123
- 2023Divide & Bind Your Attention for Improved Generative Semantic Nursingcited by 81
- 2023A-STAR: Test-time Attention Segregation and Retention for Text-to-image Synthesiscited by 78
- 2023A Picture is Worth a Thousand Words: Principled Recaptioning Improves Image Generationcited by 41
- 2023Exploiting the Signal-Leak Bias in Diffusion Modelscited by 36
- 2023The Lottery Ticket Hypothesis in Denoising: Towards Semantic-Driven Initializationcited by 23
- 2023TIAM -- A Metric for Evaluating Alignment in Text-to-Image Generationcited by 18
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Text-to-Image Alignment in Denoising-Based Models through Step Selection
- 2025Asynchronous Denoising Diffusion Models for Aligning Text-to-Image Generation
- 2023Divide, Evaluate, and Refine: Evaluating and Improving Text-to-Image Alignment with Iterative VQA Feedback
- 2026Alignment of Diffusion Model and Flow Matching for Text-to-Image Generation
- 2025Guiding What Not to Generate: Automated Negative Prompting for Text-Image Alignment
- 2024AlignIT: Enhancing Prompt Alignment in Customization of Text-to-Image Models
- 2025M3T2IBench: A Large-Scale Multi-Category, Multi-Instance, Multi-Relation Text-to-Image Benchmark
- 2023Aligning Text-to-Image Models using Human Feedback