mlsanityData to 14 Oct 2026

PromptSculptor: Multi-Agent Based Text-to-Image Prompt Optimization

arXiv 2509.12446 ↗First posted 15 Sep 2025cs.MA cs.AIcited by 19

Not on the map. Why?

Abstract (arXiv)

The rapid advancement of generative AI has democratized access to powerful tools such as Text-to-Image models. However, to generate high-quality images, users must still craft detailed prompts specifying scene, style, and context-often through multiple rounds of refinement. We propose PromptSculptor, a novel multi-agent framework that automates this iterative prompt optimization process. Our system decomposes the task into four specialized agents that work collaboratively to transform a short, vague user prompt into a comprehensive, refined prompt. By leveraging Chain-of-Thought reasoning, our framework effectively infers hidden context and enriches scene and background details. To iteratively refine the prompt, a self-evaluation agent aligns the modified prompt with the original input, while a feedback-tuning agent incorporates user feedback for further refinement. Experimental results demonstrate that PromptSculptor significantly enhances output quality and reduces the number of iterations needed for user satisfaction. Moreover, its model-agnostic design allows seamless integration with various T2I models, paving the way for industrial applications.

Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 30 of its 59 references that are in the map. First posted on arXiv 15 Sep 2025.

Builds on

30 of 59 references.

References · 30

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  4. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  5. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  6. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
  7. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
  8. 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 653
  9. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
  10. 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 388
  11. 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
  12. 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 287
18 more
  1. 2023Text-to-image Diffusion Models in Generative AI: A Surveycited by 265
  2. 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Modelscited by 243
  3. 2023PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimizationcited by 233
  4. 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Drivingcited by 166
  5. 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Stepcited by 131
  6. 2024Improving Text-to-Image Consistency via Automatic Prompt Optimizationcited by 90
  7. 2022Black-box Prompt Learning for Pre-trained Language Modelscited by 70
  8. 2023PromptMagician: Interactive Prompt Engineering for Text-to-Image Creationcited by 58
  9. 2023DreamSync: Aligning Text-to-Image Generation with Image Understanding Feedbackcited by 58
  10. 2022Toward Human Readable Prompt Tuning: Kubrick's The Shining is a good movie, and a good prompt too?cited by 49
  11. 2023If at First You Don't Succeed, Try, Try Again: Faithful Diffusion-based Text-to-Image Generation by Selectioncited by 40
  12. 2023Use Your INSTINCT: INSTruction optimization for LLMs usIng Neural bandits Coupled with Transformerscited by 30
  13. 2025Bridging the Editing Gap in LLMs: FineEdit for Precise and Targeted Text Modificationscited by 21
  14. 2025Selective KV-Cache Sharing to Mitigate Timing Side-Channels in LLM Inferencecited by 18
  15. 2022SLIC: Self-Supervised Learning with Iterative Clustering for Human Action Videoscited by 17
  16. 2024Revisiting OPRO: The Limitations of Small-Scale LLMs as Optimizerscited by 15
  17. 2025From LLM-anation to LLM-orchestrator: Coordinating Small Models for Data Labelingcited by 8
  18. 2025Learning Explainable Stock Predictions with Tweets Using Mixture of Expertscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 14.

19 papers.

Sort:

By area:

  1. 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigationcited by 89
  2. 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Viewscited by 65
  3. 2025HUD: Hierarchical Uncertainty-Aware Disambiguation Network for Composed Video Retrievalcited by 32
  4. 2026Mind-Brush: Integrating Agentic Cognitive Search and Reasoning into Image Generationcited by 23
  5. 2026Think-Then-Generate: Reasoning-Aware Text-to-Image Diffusion with LLM Encoderscited by 15
  6. 2026SCOPE: Structured Decomposition and Conditional Skill Orchestration for Complex Image Generationcited by 7
  7. 2026RoboRouter: Training-Free Policy Routing for Robotic Manipulationcited by 6
  8. 2026AnimeAgent: Is the Multi-Agent via Image-to-Video models a Good Disney Storytelling Artist?cited by 5
  9. 2026GenRouter: Unified Workflow Routing for Agentic Image Generationcited by 5
  10. 2025HyperEdit: Unlocking Instruction-based Text Editing in LLMs via Hypernetworkscited by 4
  11. 2026BrandFusion: A Multi-Agent Framework for Seamless Brand Integration in Text-to-Video Generationcited by 3
  12. 2026MUSE: Resolving Manifold Misalignment in Visual Tokenization via Topological Orthogonalitycited by 3
7 more
  1. 2026SIDiffAgent: Self-Improving Diffusion Agentcited by 1
  2. 2026PRISM: Prompt Refinement via Image-grounded Self-rewarding Mechanism for Text-to-Image Generationcited by 1
  3. 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 1
  4. 2025One Tool Is Enough: Reinforcement Learning for Repository-Level LLM Agentscited by 0
  5. 2026Position: Vector Prompt Interfaces Should Be Exposed to Enable Customization of Large Language Modelscited by 0
  6. 2026P-Flow: Prompting Visual Effects Generationcited by 0
  7. 2026Semantic Browsing: Controllable Diversity for Image Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Batch-Instructed Gradient for Prompt Evolution:Systematic Prompt Optimization for Enhanced Text-to-Image Synthesis
  2. 2025T2I-Copilot: A Training-Free Multi-Agent Text-to-Image System for Enhanced Prompt Interpretation and Interactive Generation
  3. 2025GenPilot: A Multi-Agent System for Test-Time Prompt Optimization in Image Generation
  4. 2024PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinement
  5. 2025Maestro: Self-Improving Text-to-Image Generation via Agent Orchestration
  6. 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewriting
  7. 2022Optimizing Prompts for Text-to-Image Generation
  8. 2026APE: Agentic Prompt Enhancer for Image Generation and Editing