APE: Agentic Prompt Enhancer for Image Generation and Editing
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Natural language has become a powerful interface for image generation and editing, yet text-guided visual systems remain highly sensitive to prompt formulation. Semantically similar requests can produce different outputs depending on wording, specificity, and how explicitly visual constraints are stated, motivating prompt enhancement as a trainable component rather than a peripheral user choice. Existing strong enhancers often rely on large, proprietary LLMs such as ChatGPT or Gemini, adding cost, latency, and deployment dependence to the visual generation pipeline. We propose Agentic Prompt Enhancer (APE), a lightweight framework that post-trains small language models (SLMs) as prompt-enhancement agents. APE supports both single-agent rewriting and role-specialized multi-agent enhancement. Its single-agent instantiation, SAPE, rewrites the prompt in one pass, while its multi-agent instantiation, MAPE, decomposes enhancement into a router--rewriter--composer process for handling compositional constraints over objects, attributes, spatial relations, and edits. With task-aware rewards and post-training protocols, APE improves visual alignment and prompt following without modifying the downstream visual model. Experiments on challenging image generation and editing benchmarks demonstrate that post-trained small prompt enhancers reliably outperform their base counterparts, narrowing the gap to closed-source prompt enhancers; in addition, MAPE proves particularly strong on complex compositional tasks within these benchmarks.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 46 of its 56 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
46 of 56 references.
References · 46
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2025Qwen3 Technical Reportcited by 8,820
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022Generative Adversarial Networkscited by 5,627
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
34 more
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2025Qwen-Image Technical Reportcited by 1,044
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
- 2016Conditional Image Generation with PixelCNN Decoderscited by 862
- 2018Image Transformercited by 772
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 598
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 431
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 277
- 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Modelscited by 243
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
- 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 230
- 2025Unified Reward Model for Multimodal Understanding and Generationcited by 199
- 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 193
- 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewritingcited by 43
- 2025ChronoEdit: Towards Temporal Reasoning for Image Editing and World Simulationcited by 29
- 2025UniGenBench++: A Unified Semantic Evaluation Benchmark for Text-to-Image Generationcited by 25
- 2025Multi-Agent Debate for LLM Judges with Adaptive Stability Detectioncited by 23
- 2025Generating an Image From 1,000 Words: Enhancing Text-to-Image With Structured Captionscited by 14
- 2024Diversity of Thought Elicits Stronger Reasoning Capabilities in Multi-Agent Debate Frameworkscited by 12
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Boogu-Image-0.1: Boosting Open Agentic Multimodal Generation via Understanding under a Minimal Budgetcited by 6
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 1
- 2026PE-OPSD: Internalizing Prompt Enhancement into Flow-matching Models via On-Policy Self-Distillationcited by 0
- 2026PE-OPSD: Internalizing Prompt Enhancement into Flow-matching Models via On-Policy Self-Distillation29 Sep 2026
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026Boogu-Image-0.1: Boosting Open Agentic Multimodal Generation via Understanding under a Minimal Budget14 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026ImageEdit-R1: Boosting Multi-Agent Image Editing via Reinforcement Learning
- 2025PromptSculptor: Multi-Agent Based Text-to-Image Prompt Optimization
- 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editing
- 2024Batch-Instructed Gradient for Prompt Evolution:Systematic Prompt Optimization for Enhanced Text-to-Image Synthesis
- 2025T2I-Copilot: A Training-Free Multi-Agent Text-to-Image System for Enhanced Prompt Interpretation and Interactive Generation
- 2026Making Image Editing Easier via Adaptive Task Reformulation with Agentic Executions
- 2025AgentComp: From Agentic Reasoning to Compositional Mastery in Text-to-Image Models
- 2024DiffusionAgent: Navigating Expert Models for Agentic Image Generation