Guiding What Not to Generate: Automated Negative Prompting for Text-Image Alignment
Not on the map. Why?
Abstract (arXiv)
Despite substantial progress in text-to-image generation, achieving precise text-image alignment remains challenging, particularly for prompts with rich compositional structure or imaginative elements. To address this, we introduce Negative Prompting for Image Correction (NPC), an automated pipeline that improves alignment by identifying and applying negative prompts that suppress unintended content. We begin by analyzing cross-attention patterns to explain why both targeted negatives-those directly tied to the prompt's alignment error-and untargeted negatives-tokens unrelated to the prompt but present in the generated image-can enhance alignment. To discover useful negatives, NPC generates candidate prompts using a verifier-captioner-proposer framework and ranks them with a salient text-space score, enabling effective selection without requiring additional image synthesis. On GenEval++ and Imagine-Bench, NPC outperforms strong baselines, achieving 0.571 vs. 0.371 on GenEval++ and the best overall performance on Imagine-Bench. By guiding what not to generate, NPC provides a principled, fully automated route to stronger text-image alignment in diffusion models. Code is released at https://github.com/wiarae/NPC.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 66 of its 77 references that are in the map. First posted on arXiv 8 Dec 2025.
Builds on
66 of 77 references.
References · 66
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2025Qwen3 Technical Reportcited by 8,820
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Qwen2.5-VL Technical Reportcited by 5,587
38 more
- 2024GPT-4o System Cardcited by 4,588
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
- 2024Emu3: Next-Token Prediction is All You Needcited by 781
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
- 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 428
- 2024OmniGen: Unified Image Generationcited by 394
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
- 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
- 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 287
- 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 282
- 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Modelscited by 243
- 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMscited by 224
- 2022Optimizing Prompts for Text-to-Image Generationcited by 207
- 2024TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generationcited by 202
- 2022mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connectionscited by 187
- 2024InstanceDiffusion: Instance-level Control for Image Generationcited by 175
- 2023Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignmentcited by 171
- 2023Davidsonian Scene Graph: Improving Reliability in Fine-grained Evaluation for Text-to-Image Generationcited by 171
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 166
- 2023Rich Human Feedback for Text-to-Image Generationcited by 141
- 2024GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generationcited by 135
- 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editingcited by 133
- 2021Simple multi-dataset detectioncited by 127
50 most cited of 66 All 66 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026GEMS: Agent-Native Multimodal Generation with Memory and Skillscited by 21
- 2026Diagnosing and Correcting Concept Omission in Multimodal Diffusion Transformerscited by 2
- 2026Position: Natural Language Should Not Fully Replace Formal Languagescited by 1
- 2026Learning Sampling Parameters for Diffusion Modelscited by 1
- 2026TIDE: Trajectory-Informed Skill Distillation for Efficient Text-to-Video Prompt Optimizationcited by 0
- 2026TIDE: Trajectory-Informed Skill Distillation for Efficient Text-to-Video Prompt Optimization10 Oct 2026
- 2026Learning Sampling Parameters for Diffusion Models26 Jul 2026
- 2026Diagnosing and Correcting Concept Omission in Multimodal Diffusion Transformers14 May 2026
- 2026Position: Natural Language Should Not Fully Replace Formal Languages10 May 2026
- 2026GEMS: Agent-Native Multimodal Generation with Memory and Skills30 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2024Removing Distributional Discrepancies in Captions Improves Image-Text Alignment
- 2025M3T2IBench: A Large-Scale Multi-Category, Multi-Instance, Multi-Relation Text-to-Image Benchmark
- 2025YINYANG-ALIGN: Benchmarking Contradictory Objectives and Proposing Multi-Objective Optimization based DPO for Text-to-Image Alignment
- 2025Align Beyond Prompts: Evaluating World Knowledge Alignment in Text-to-Image Generation
- 2024Optimizing Negative Prompts for Enhanced Aesthetics and Fidelity in Text-To-Image Generation
- 2024AlignIT: Enhancing Prompt Alignment in Customization of Text-to-Image Models
- 2025SAGA: Learning Signal-Aligned Distributions for Improved Text-to-Image Generation
- 2023Aligning Text-to-Image Models using Human Feedback