TIPO: Text to Image with Text Presampling for Prompt Optimization
Not on the map. Why?
Abstract (arXiv)
TIPO (Text-to-Image Prompt Optimization) introduces an efficient approach for automatic prompt refinement in text-to-image (T2I) generation. Starting from simple user prompts, TIPO leverages a lightweight pre-trained model to expand these prompts into richer and more detailed versions. Conceptually, TIPO samples refined prompts from a targeted sub-distribution within the broader semantic space, preserving the original intent while significantly improving visual quality, coherence, and detail. Unlike resource-intensive methods based on large language models (LLMs) or reinforcement learning (RL), TIPO offers strong computational efficiency and scalability, opening new possibilities for effective automated prompt engineering in T2I tasks. Extensive experiments across multiple domains demonstrate that TIPO achieves stronger text alignment, reduced visual artifacts, and consistently higher human preference rates, while maintaining competitive aesthetic quality. These results highlight the effectiveness of distribution-aligned prompt engineering and point toward broader opportunities for scalable, automated refinement in text-to-image generation.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 41 of its 82 references that are in the map. First posted on arXiv 12 Nov 2024.
Builds on
41 of 82 references.
References · 41
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2023Visual Instruction Tuningcited by 7,869
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
29 more
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
- 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 410
- 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 340
- 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generationcited by 329
- 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 311
- 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
- 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 279
- 2022Optimizing Prompts for Text-to-Image Generationcited by 207
- 2023Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion modelscited by 205
- 2024jina-embeddings-v3: Multilingual Embeddings With Task LoRAcited by 141
- 2024NVLM: Open Frontier-Class Multimodal LLMscited by 125
- 2017Latent Dirichlet Allocation (LDA) and Topic modeling: models, applications, a surveycited by 91
- 2024Improving Text-to-Image Consistency via Automatic Prompt Optimizationcited by 90
- 2020Improving Image Captioning with Better Use of Captionscited by 84
- 2024CogView3: Finer and Faster Text-to-Image Generation via Relay Diffusioncited by 72
- 2024Towards Understanding the Working Mechanism of Text-to-Image Diffusion Modelcited by 48
- 2024Dynamic Prompt Optimizing for Text-to-Image Generationcited by 45
- 2023Language Models as Black-Box Optimizers for Vision-Language Modelscited by 36
- 2024Automated Black-box Prompt Engineering for Personalized Text-to-Image Generationcited by 12
- 2024Leveraging Long-Context Large Language Models for Multi-Document Understanding and Summarization in Enterprise Applicationscited by 10
- 2024Graph-Based Captioning: Enhancing Visual Descriptions by Interconnecting Region Captionscited by 7
- 2024Illustrious: an Open Advanced Illustration Modelcited by 5
- 2024Improvements to SDXL in NovelAI Diffusion V3cited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 5.
6 papers.
- 2025RePrompt: Reasoning-Augmented Reprompting for Text-to-Image Generation via Reinforcement Learningcited by 23
- 2026AtelierEval: Agentic Evaluation of Humans & LLMs as Text-to-Image Prompterscited by 8
- 2026One Rewrite to Fix Them All? Type-Aware Repair Allocation for Text-to-Image Prompt Optimizationcited by 1
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 1
- 2026Text-to-seed generation: Training-free open-vocabulary seeded semantic segmentation via re-purposing diffusion as text-guided seed generatorcited by 0
- 2026A Matched-Budget Audit Framework for Recaptioned Image-Text Supervision Distributionscited by 0
- 2026A Matched-Budget Audit Framework for Recaptioned Image-Text Supervision Distributions1 Oct 2026
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026Text-to-seed generation: Training-free open-vocabulary seeded semantic segmentation via re-purposing diffusion as text-guided seed generator27 Aug 2026
- 2026One Rewrite to Fix Them All? Type-Aware Repair Allocation for Text-to-Image Prompt Optimization21 Jul 2026
- 2026AtelierEval: Agentic Evaluation of Humans & LLMs as Text-to-Image Prompters21 May 2026
- 2025RePrompt: Reasoning-Augmented Reprompting for Text-to-Image Generation via Reinforcement Learning23 May 2025
Similar, not cited
Close in wording, no citation either way
- 2025POET: Preference Optimization for Enhanced Text-to-Image Generation
- 2025Test-time Prompt Refinement for Text-to-Image Models
- 2025Free Lunch Alignment of Text-to-Image Diffusion Models without Preference Image Pairs
- 2024PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinement
- 2025Self-Rewarding Large Vision-Language Models for Optimizing Prompts in Text-to-Image Generation
- 2025Reward-Agnostic Prompt Optimization for Text-to-Image Diffusion Models
- 2024Batch-Instructed Gradient for Prompt Evolution:Systematic Prompt Optimization for Enhanced Text-to-Image Synthesis
- 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewriting