mlsanityData to 14 Oct 2026

One Rewrite to Fix Them All? Type-Aware Repair Allocation for Text-to-Image Prompt Optimization

arXiv 2607.18724 ↗First posted 21 Jul 2026cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Text-to-image (T2I) generators often fail to follow their prompts faithfully, producing wrong counts, swapped attributes, ambiguous relations, and illegible text. Prompt optimization repairs such failures by rewriting the user prompt, requiring no generator retraining, and has yielded promising results. However, existing optimizers absorb heterogeneous failures into one uniform prompt expansion, even though each calls for different repair language. We formulate semantic prompt optimization as atomic repair allocation: each failed proposition is routed to a type-conditioned repair operator before the resulting local constraints are compiled into one executable prompt. We instantiate this formulation in the training-free Type-Aware Repair Allocation (TARA) framework, which separates diagnosis, allocation, compilation, and a semantic repair gate, an accept-or-revert controller over exactly one prescribed repair that prevents semantic regressions. Extensive experiments on DSG and TIFA across four frozen generators demonstrate that TARA achieves the best semantic accuracy in all eight benchmark-generator cells, improving over VisualPrompter by 5.6 and 2.6 points on DSG and TIFA, respectively, while maintaining image quality and running fastest in our matched local setting at 16.0 seconds versus 20.0 seconds per prompt.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 37 of its 42 references that are in the map. First posted on arXiv 21 Jul 2026.

Builds on

37 of 42 references.

References · 37

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2022Classifier-Free Diffusion Guidancecited by 5,847
  9. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  10. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  11. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  12. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
25 more
  1. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
  2. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
  3. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  4. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  5. 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 431
  6. 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 428
  7. 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 287
  8. 2021Design Guidelines for Prompt Engineering Text-to-Image Generative Modelscited by 218
  9. 2022Optimizing Prompts for Text-to-Image Generationcited by 207
  10. 2023Davidsonian Scene Graph: Improving Reliability in Fine-grained Evaluation for Text-to-Image Generationcited by 171
  11. 2023What You See is What You Read? Improving Text-Image Alignment Evaluationcited by 108
  12. 2024Improving Text-to-Image Consistency via Automatic Prompt Optimizationcited by 90
  13. 2020Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a Summarycited by 88
  14. 2023Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Modelscited by 67
  15. 2024PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinementcited by 62
  16. 2023PromptMagician: Interactive Prompt Engineering for Text-to-Image Creationcited by 58
  17. 2022A Taxonomy of Prompt Modifiers for Text-To-Image Generationcited by 55
  18. 2023RePrompt: Automatic Prompt Editing to Refine AI-Generative Art Towards Precise Expressionscited by 43
  19. 2022Best Prompts for Text-to-Image Models and How to Find Themcited by 35
  20. 2023Prompt Expansion for Adaptive Text-to-Image Generationcited by 24
  21. 2023NeuroPrompts: An Adaptive Framework to Optimize Prompts for Text-to-Image Generationcited by 10
  22. 2024A User-Friendly Framework for Generating Model-Preferred Prompts in Text-to-Image Synthesiscited by 7
  23. 2024TIPO: Text to Image with Text Presampling for Prompt Optimizationcited by 6
  24. 2025VisualPrompter: Semantic-Aware Prompt Optimization with Visual Feedback for Text-to-Image Synthesiscited by 6
  25. 2024FRAP: Faithful and Realistic Text-to-Image Generation with Adaptive Prompt Weightingcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.