mlsanityData to 14 Oct 2026

Guiding What Not to Generate: Automated Negative Prompting for Text-Image Alignment

arXiv 2512.07702 ↗First posted 8 Dec 2025cs.CV cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

Despite substantial progress in text-to-image generation, achieving precise text-image alignment remains challenging, particularly for prompts with rich compositional structure or imaginative elements. To address this, we introduce Negative Prompting for Image Correction (NPC), an automated pipeline that improves alignment by identifying and applying negative prompts that suppress unintended content. We begin by analyzing cross-attention patterns to explain why both targeted negatives-those directly tied to the prompt's alignment error-and untargeted negatives-tokens unrelated to the prompt but present in the generated image-can enhance alignment. To discover useful negatives, NPC generates candidate prompts using a verifier-captioner-proposer framework and ranks them with a salient text-space score, enabling effective selection without requiring additional image synthesis. On GenEval++ and Imagine-Bench, NPC outperforms strong baselines, achieving 0.571 vs. 0.371 on GenEval++ and the best overall performance on Imagine-Bench. By guiding what not to generate, NPC provides a principled, fully automated route to stronger text-image alignment in diffusion models. Code is released at https://github.com/wiarae/NPC.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 66 of its 77 references that are in the map. First posted on arXiv 8 Dec 2025.

Builds on

66 of 77 references.

References · 66

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  6. 2025Qwen3 Technical Reportcited by 8,820
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  9. 2022Scalable Diffusion Models with Transformerscited by 6,054
  10. 2022Classifier-Free Diffusion Guidancecited by 5,847
  11. 2022Flow Matching for Generative Modelingcited by 5,702
  12. 2025Qwen2.5-VL Technical Reportcited by 5,587
38 more
  1. 2024GPT-4o System Cardcited by 4,588
  2. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  3. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  5. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  6. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  7. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  8. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  9. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  10. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  11. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  12. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
  13. 2024Emu3: Next-Token Prediction is All You Needcited by 781
  14. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
  15. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
  16. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
  17. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
  18. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
  19. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
  20. 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 428
  21. 2024OmniGen: Unified Image Generationcited by 394
  22. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
  23. 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
  24. 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 287
  25. 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 282
  26. 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Modelscited by 243
  27. 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMscited by 224
  28. 2022Optimizing Prompts for Text-to-Image Generationcited by 207
  29. 2024TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generationcited by 202
  30. 2022mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connectionscited by 187
  31. 2024InstanceDiffusion: Instance-level Control for Image Generationcited by 175
  32. 2023Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignmentcited by 171
  33. 2023Davidsonian Scene Graph: Improving Reliability in Fine-grained Evaluation for Text-to-Image Generationcited by 171
  34. 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 166
  35. 2023Rich Human Feedback for Text-to-Image Generationcited by 141
  36. 2024GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generationcited by 135
  37. 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editingcited by 133
  38. 2021Simple multi-dataset detectioncited by 127

50 most cited of 66 All 66 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Removing Distributional Discrepancies in Captions Improves Image-Text Alignment
  2. 2025M3T2IBench: A Large-Scale Multi-Category, Multi-Instance, Multi-Relation Text-to-Image Benchmark
  3. 2025YINYANG-ALIGN: Benchmarking Contradictory Objectives and Proposing Multi-Objective Optimization based DPO for Text-to-Image Alignment
  4. 2025Align Beyond Prompts: Evaluating World Knowledge Alignment in Text-to-Image Generation
  5. 2024Optimizing Negative Prompts for Enhanced Aesthetics and Fidelity in Text-To-Image Generation
  6. 2024AlignIT: Enhancing Prompt Alignment in Customization of Text-to-Image Models
  7. 2025SAGA: Learning Signal-Aligned Distributions for Improved Text-to-Image Generation
  8. 2023Aligning Text-to-Image Models using Human Feedback