mlsanityData to 14 Oct 2026

APE: Agentic Prompt Enhancer for Image Generation and Editing

arXiv 2606.00204 ↗First posted 29 May 2026cs.CVcited by 3

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Natural language has become a powerful interface for image generation and editing, yet text-guided visual systems remain highly sensitive to prompt formulation. Semantically similar requests can produce different outputs depending on wording, specificity, and how explicitly visual constraints are stated, motivating prompt enhancement as a trainable component rather than a peripheral user choice. Existing strong enhancers often rely on large, proprietary LLMs such as ChatGPT or Gemini, adding cost, latency, and deployment dependence to the visual generation pipeline. We propose Agentic Prompt Enhancer (APE), a lightweight framework that post-trains small language models (SLMs) as prompt-enhancement agents. APE supports both single-agent rewriting and role-specialized multi-agent enhancement. Its single-agent instantiation, SAPE, rewrites the prompt in one pass, while its multi-agent instantiation, MAPE, decomposes enhancement into a router--rewriter--composer process for handling compositional constraints over objects, attributes, spatial relations, and edits. With task-aware rewards and post-training protocols, APE improves visual alignment and prompt following without modifying the downstream visual model. Experiments on challenging image generation and editing benchmarks demonstrate that post-trained small prompt enhancers reliably outperform their base counterparts, narrowing the gap to closed-source prompt enhancers; in addition, MAPE proves particularly strong on complex compositional tasks within these benchmarks.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 46 of its 56 references that are in the map. First posted on arXiv 29 May 2026.

Builds on

46 of 56 references.

References · 46

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  5. 2025Qwen3 Technical Reportcited by 8,820
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  7. 2022Scalable Diffusion Models with Transformerscited by 6,054
  8. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  9. 2022Flow Matching for Generative Modelingcited by 5,702
  10. 2022Generative Adversarial Networkscited by 5,627
  11. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  12. 2021Zero-Shot Text-to-Image Generationcited by 4,288
34 more
  1. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  2. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  3. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  4. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
  5. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  6. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
  7. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  8. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
  9. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
  10. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  11. 2025Qwen-Image Technical Reportcited by 1,044
  12. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  13. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  14. 2023ChatDev: Communicative Agents for Software Developmentcited by 919
  15. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
  16. 2016Conditional Image Generation with PixelCNN Decoderscited by 862
  17. 2018Image Transformercited by 772
  18. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
  19. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
  20. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 598
  21. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
  22. 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 431
  23. 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 277
  24. 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Modelscited by 243
  25. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
  26. 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 230
  27. 2025Unified Reward Model for Multimodal Understanding and Generationcited by 199
  28. 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 193
  29. 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewritingcited by 43
  30. 2025ChronoEdit: Towards Temporal Reasoning for Image Editing and World Simulationcited by 29
  31. 2025UniGenBench++: A Unified Semantic Evaluation Benchmark for Text-to-Image Generationcited by 25
  32. 2025Multi-Agent Debate for LLM Judges with Adaptive Stability Detectioncited by 23
  33. 2025Generating an Image From 1,000 Words: Enhancing Text-to-Image With Structured Captionscited by 14
  34. 2024Diversity of Thought Elicits Stronger Reasoning Capabilities in Multi-Agent Debate Frameworkscited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026ImageEdit-R1: Boosting Multi-Agent Image Editing via Reinforcement Learning
  2. 2025PromptSculptor: Multi-Agent Based Text-to-Image Prompt Optimization
  3. 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editing
  4. 2024Batch-Instructed Gradient for Prompt Evolution:Systematic Prompt Optimization for Enhanced Text-to-Image Synthesis
  5. 2025T2I-Copilot: A Training-Free Multi-Agent Text-to-Image System for Enhanced Prompt Interpretation and Interactive Generation
  6. 2026Making Image Editing Easier via Adaptive Task Reformulation with Agentic Executions
  7. 2025AgentComp: From Agentic Reasoning to Compositional Mastery in Text-to-Image Models
  8. 2024DiffusionAgent: Navigating Expert Models for Agentic Image Generation