mlsanityData to 7 Oct 2026

GPTDrawer: Enhancing Visual Synthesis through ChatGPT

arXiv 2412.10429 ↗First posted 11 Dec 2024cs.CV cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

In the burgeoning field of AI-driven image generation, the quest for precision and relevance in response to textual prompts remains paramount. This paper introduces GPTDrawer, an innovative pipeline that leverages the generative prowess of GPT-based models to enhance the visual synthesis process. Our methodology employs a novel algorithm that iteratively refines input prompts using keyword extraction, semantic analysis, and image-text congruence evaluation. By integrating ChatGPT for natural language processing and Stable Diffusion for image generation, GPTDrawer produces a batch of images that undergo successive refinement cycles, guided by cosine similarity metrics until a threshold of semantic alignment is attained. The results demonstrate a marked improvement in the fidelity of images generated in accordance with user-defined prompts, showcasing the system's ability to interpret and visualize complex semantic constructs. The implications of this work extend to various applications, from creative arts to design automation, setting a new benchmark for AI-assisted creative processes.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 21 of its 30 references that are in the map. First posted on arXiv 11 Dec 2024.

Builds on

21 of 30 references.

References · 21

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  6. 2017Neural Discrete Representation Learningcited by 4,650
  7. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  8. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  9. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  10. 2023Text-to-image Diffusion Models in Generative AI: A Surveycited by 264
  11. 2020A Review on Generative Adversarial Networks: Algorithms, Theory, and Applicationscited by 209
  12. 2023Iterative Prompt Learning for Unsupervised Backlit Image Enhancementcited by 107
9 more
  1. 2019Patent Claim Generation by Fine-Tuning OpenAI GPT-2cited by 49
  2. 2024Exploring Diverse Methods in Visual Question Answeringcited by 45
  3. 2018Information Constraints on Auto-Encoding Variational Bayescited by 33
  4. 2024Regional Style and Color Transfercited by 30
  5. 2024RAG-RLRC-LaySum at BioLaySumm: Integrating Retrieval-Augmented Generation and Readability Control for Layman Summarization of Biomedical Textscited by 23
  6. 2024Mitigating the Risk of Health Inequity Exacerbated by Large Language Modelscited by 21
  7. 2024Few-shot Name Entity Recognition on StackOverflowcited by 14
  8. 2024Mix of Experts Language Model for Named Entity Recognitioncited by 11
  9. 2022SPE: Symmetrical Prompt Enhancement for Fact Probingcited by 5

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinement
  2. 2024Prompt-Consistency Image Generation (PCIG): A Unified Framework Integrating LLMs, Knowledge Graphs, and Controllable Diffusion Models
  3. 2023Advancements in Generative AI: A Comprehensive Review of GANs, GPT, Autoencoders, Diffusion Model, and Transformers
  4. 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Models
  5. 2025CRAFT: Continuous Reasoning and Agentic Feedback Tuning for Multimodal Text-to-Image Generation
  6. 2025Towards Enhanced Image Generation Via Multi-modal Chain of Thought in Unified Generative Models
  7. 2024ArtAug: Enhancing Text-to-Image Generation through Synthesis-Understanding Interaction
  8. 2024ChatDiT: A Training-Free Baseline for Task-Agnostic Free-Form Chatting with Diffusion Transformers