mlsanityData to 7 Oct 2026

PromptMagician: Interactive Prompt Engineering for Text-to-Image Creation

arXiv 2307.09036 ↗First posted 18 Jul 2023cs.AI cs.HCcited by 58

Not on the map. Why?

Abstract (arXiv)

Generative text-to-image models have gained great popularity among the public for their powerful capability to generate high-quality images based on natural language prompts. However, developing effective prompts for desired images can be challenging due to the complexity and ambiguity of natural language. This research proposes PromptMagician, a visual analysis system that helps users explore the image results and refine the input prompts. The backbone of our system is a prompt recommendation model that takes user prompts as input, retrieves similar prompt-image pairs from DiffusionDB, and identifies special (important and relevant) prompt keywords. To facilitate interactive prompt refinement, PromptMagician introduces a multi-level visualization for the cross-modal embedding of the retrieved images and recommended keywords, and supports users in specifying multiple criteria for personalized exploration. Two usage scenarios, a user study, and expert interviews demonstrate the effectiveness and usability of our system, suggesting it facilitates prompt engineering and improves the creativity support of the generative text-to-image model.

Key facts. Cited by 58 papers in the map (data through 7 Oct 2026). Builds on 53 of its 84 references that are in the map. First posted on arXiv 18 Jul 2023.

Builds on

53 of 84 references.

References · 53

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2023GPT-4 Technical Reportcited by 18,132
  7. 2022Training language models to follow instructions with human feedbackcited by 15,712
  8. 2020Denoising Diffusion Implicit Modelscited by 9,655
  9. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  10. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  11. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  12. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
38 more
  1. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  2. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  3. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  4. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
  5. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  6. 2019How Can We Know What Language Models Know?cited by 953
  7. 2020It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learnerscited by 668
  8. 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 575
  9. 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 376
  10. 2019DM-GAN: Dynamic Memory Generative Adversarial Networks for Text-to-Image Synthesiscited by 308
  11. 2021AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model Promptscited by 265
  12. 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 218
  13. 2021Design Guidelines for Prompt Engineering Text-to-Image Generative Modelscited by 216
  14. 2022Optimizing Prompts for Text-to-Image Generationcited by 204
  15. 2021How Many Data Points is a Prompt Worth?cited by 197
  16. 2016Learning a No-Reference Quality Metric for Single-Image Super-Resolutioncited by 143
  17. 2022PromptChainer: Chaining Large Language Model Prompts through Visual Programmingcited by 134
  18. 2021ArtEmis: Affective Language for Visual Artcited by 103
  19. 2022Adapting Pretrained Vision-Language Foundational Models to Medical Imaging Domainscited by 85
  20. 2022Interactive and Visual Prompt Engineering for Ad-hoc Task Adaptation with Large Language Modelscited by 70
  21. 2021Perceptual Image Quality Assessment with Transformerscited by 54
  22. 2022A Taxonomy of Prompt Modifiers for Text-To-Image Generationcited by 54
  23. 2023RePrompt: Automatic Prompt Editing to Refine AI-Generative Art Towards Precise Expressionscited by 43
  24. 2018Contemplating Visual Emotions: Understanding and Overcoming Dataset Biascited by 41
  25. 2022Opal: Multimodal Image Generation for News Illustrationcited by 36
  26. 2022MultiViz: Towards Visualizing and Understanding Multimodal Modelscited by 36
  27. 2021M2Lens: Visualizing and Explaining Multimodal Models for Sentiment Analysiscited by 29
  28. 2023XNLI: Explaining and Diagnosing NLI-based Visual Data Analysiscited by 18
  29. 2019EmoCo: Visual Analysis of Emotion Coherence in Presentation Videoscited by 13
  30. 2022DendroMap: Visual Exploration of Large-Scale Image Datasets for Machine Learning with Treemapscited by 12
  31. 2021Towards Visual Explainable Active Learning for Zero-Shot Classificationcited by 10
  32. 2021Explaining with Examples: Lessons Learned from Crowdsourced Introductory Description of Information Visualizationscited by 8
  33. 2023Towards an Understanding and Explanation for Mixed-Initiative Artificial Scientific Text Detectioncited by 8
  34. 2023Anchorage: Visual Analysis of Satisfaction in Customer Service Videos via Anchor Eventscited by 7
  35. 2020TaxThemis: Interactive Mining and Exploration of Suspicious Tax Evasion Groupcited by 6
  36. 2022Beyond Interestingness: Semantic and Context-Aware Natural Language Query Recommendations for Visual Data Analysiscited by 6
  37. 2022CohortVA: A Visual Analytic System for Interactive Exploration of Cohorts based on Historical Datacited by 5
  38. 2022GestureLens: Visual Analysis of Gestures in Presentation Videoscited by 4

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 3; 2024: 23; 2025: 21; 2026: 11.

58 papers.

Sort:

By area:

  1. 2024PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinementcited by 61
  2. 2023Foundation Models Meet Visualizations: Challenges and Opportunitiescited by 31
  3. 2024MagicQuill: An Intelligent Interactive Image Editing Systemcited by 30
  4. 2024AgentCoord: Visually Exploring Coordination Strategy for LLM-based Multi-Agent Collaborationcited by 26
  5. 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Modelscited by 24
  6. 2024AgentLens: Visual Analysis for Agent Behaviors in LLM-based Autonomous Systemscited by 23
  7. 2025PromptSculptor: Multi-Agent Based Text-to-Image Prompt Optimizationcited by 19
  8. 2024A Survey on Quality Metrics for Text-to-Image Generationcited by 17
  9. 2026IGenBench: Benchmarking the Reliability of Text-to-Infographic Generationcited by 14
  10. 2024Prompt Refinement with Image Pivot for Text-to-Image Generationcited by 11
  11. 2024Human-Guided Image Generation for Expanding Small-Scale Training Image Datasetscited by 10
  12. 2025PromptMap: An Alternative Interaction Style for AI-Based Image Generationcited by 8
38 more
  1. 2025DeepVIS: Bridging Natural Language and Data Visualization Through Step-wise Reasoningcited by 8
  2. 2023VideoPro: A Visual Analytics Approach for Interactive Video Programmingcited by 7
  3. 2024JailbreakLens: Visual Analysis of Jailbreak Attacks Against Large Language Modelscited by 7
  4. 2024ModalChorus: Visual Probing and Alignment of Multi-modal Embeddings via Modal Fusion Mapcited by 7
  5. 2024Prompting for products: Investigating design space exploration strategies for text-to-image generative modelscited by 6
  6. 2024Exploring Empty Spaces: Human-in-the-Loop Data Augmentationcited by 6
  7. 2025SketchFlex: Facilitating Spatial-Semantic Coherence in Text-to-Image Generation with Region-Based Sketchescited by 6
  8. 2025VisualPrompter: Semantic-Aware Prompt Optimization with Visual Feedback for Text-to-Image Synthesiscited by 6
  9. 2024ASAP: Interpretable Analysis and Summarization of AI-generated Image Patterns at Scalecited by 5
  10. 2024Natural Language Generation for Visualizations: State of the Art, Challenges and Future Directionscited by 5
  11. 2024Vital Insight: Assisting Experts' Context-Driven Sensemaking of Multi-modal Personal Tracking Data Using Visualization and Human-In-The-Loop LLMcited by 5
  12. 2025Exploring Multimodal Prompt for Visualization Authoring with Large Language Modelscited by 5
  13. 2025GenTune: Toward Traceable Prompts to Improve Controllability of Image Refinement in Environment Designcited by 5
  14. 2023Visual Analytics for Efficient Image Exploration and User-Guided Image Captioningcited by 4
  15. 2024Taming Text-to-Image Synthesis for Novices: User-centric Prompt Generation via Multi-turn Guidancecited by 4
  16. 2025World-To-Image: Grounding Text-to-Image Generation with Agent-Driven World Knowledgecited by 4
  17. 2026From Words to Widgets for Controllable LLM Generationcited by 4
  18. 2024Visualization for Trust in Machine Learning Revisited: The State of the Field in 2023cited by 3
  19. 2025Poetry in Pixels: Prompt Tuning for Poem Image Generation via Diffusion Modelscited by 3
  20. 2025POET: Preference Optimization for Enhanced Text-to-Image Generationcited by 3
  21. 2024CUPID: Contextual Understanding of Prompt-conditioned Image Distributionscited by 2
  22. 2025XGraphRAG: Interactive Visual Analysis for Graph-based Retrieval-Augmented Generationcited by 2
  23. 2025CompSlider: Compositional Slider for Disentangled Multiple-Attribute Image Generationcited by 2
  24. 2025Exploration vs. Fixation: Scaffolding Divergent and Convergent Thinking for Human-AI Co-Creation with Generative Modelscited by 2
  25. 2024POEM: Interactive Prompt Optimization for Enhancing Multimodal Reasoning of Large Language Modelscited by 1
  26. 2024Interactive Visual Assessment for Text-to-Image Generation Modelscited by 1
  27. 2025Multimedia and Visual Analytics in the Agentic Eracited by 1
  28. 2025LumiGen: An LVLM-Enhanced Iterative Framework for Fine-Grained Text-to-Image Generationcited by 1
  29. 2025ConceptViz: A Visual Analytics Approach for Exploring Concepts in Large Language Modelscited by 1
  30. 2025LLMs Behind the Scenes: Enabling Narrative Scene Illustrationcited by 1
  31. 2025AnimAgents: Coordinating Multi-Stage Animation Pre-Production with Human-Multi-Agent Collaborationcited by 1
  32. 2026Bridging Gulfs in UI Generation through Semantic Guidancecited by 1
  33. 2026ScribbleSense: Generative Scribble-Based Texture Editing with Intent Predictioncited by 1
  34. 2026SCHEMA for Gemini 3 Pro Image: A Structured Methodology for Controlled AI Image Generation on Google's Native Multimodal Modelcited by 1
  35. 2026One Rewrite to Fix Them All? Type-Aware Repair Allocation for Text-to-Image Prompt Optimizationcited by 1
  36. 2026PRISM: Prompt Refinement via Image-grounded Self-rewarding Mechanism for Text-to-Image Generationcited by 1
  37. 2024SSP: A Simple and Safe automatic Prompt engineering method towards realistic image synthesis on LVMcited by 0
  38. 2024Prismatic: Interactive Multi-View Cluster Analysis of Concept Stockscited by 0

50 most cited of 58 All 58 (JSON)