DetailMaster: Can Your Text-to-Image Model Handle Long Prompts?
Not on the map. Why?
Abstract (arXiv)
While recent Text-to-Image (T2I) models show impressive capabilities in synthesizing images from brief descriptions, they struggle with the long, detailed prompts required for professional applications. We present DetailMaster, a comprehensive benchmark for evaluating T2I capabilities on long prompts with complex compositional requirements, accompanied by an automated data construction pipeline and an evaluation workflow. Comprising expert-validated prompts averaging 284.89 tokens, our benchmark introduces four critical evaluation dimensions: Character Attributes, Structured Character Locations, Multi-Dimensional Scene Attributes, and Spatial/Interactive Relationships. Evaluations on various general-purpose and long-prompt-optimized models reveal critical performance limitations, showing that weak encoders struggle to preserve syntactic dependencies within prompts and diffusion models suffer from attribute leakage under detail-intensive conditions. Through a controlled ablation study under varying constraints, we further show that high-fidelity generation requires a synergistic combination of expanded prompt limits and long-prompt training. We open-source our dataset and code to foster progress in long-prompt-driven T2I generation.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 55 of its 83 references that are in the map. First posted on arXiv 22 May 2025.
Builds on
55 of 83 references.
References · 55
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
38 more
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
- 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
- 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 577
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
- 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 428
- 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 340
- 2019Connecting Vision and Language with Localized Narrativescited by 226
- 2022mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connectionscited by 187
- 2016Visual Storytellingcited by 176
- 2023Davidsonian Scene Graph: Improving Reliability in Fine-grained Evaluation for Text-to-Image Generationcited by 171
- 2024JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generationcited by 163
- 2023Rich Human Feedback for Text-to-Image Generationcited by 141
- 2024DOCCI: Descriptions of Connected and Contrasting Imagescited by 132
- 2024Learning Multi-dimensional Human Preference for Text-to-Image Generationcited by 106
- 2025Lumina-Image 2.0: A Unified and Efficient Image Generative Frameworkcited by 96
- 2023HRS-Bench: Holistic, Reliable and Scalable Benchmark for Text-to-Image Modelscited by 95
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Surveycited by 76
- 2024ConceptMix: A Compositional Image Generation Benchmark with Controllable Difficultycited by 61
- 2023LLM Blueprint: Enabling Text-to-Image Generation with Complex and Detailed Promptscited by 54
- 2023Data-Juicer: A One-Stop Data Processing System for Large Language Modelscited by 52
- 2024Revisiting Text-to-Image Evaluation with Gecko: On Metrics, Prompts, and Human Ratingscited by 44
- 2023Paragraph-to-Image Generation with Information-Enriched Diffusion Modelcited by 39
- 2024LLM4GEN: Leveraging Semantic Representation of LLMs for Text-to-Image Generationcited by 30
- 2024Improving Long-Text Alignment for Text-to-Image Diffusion Modelscited by 18
- 2024From Training-Free to Adaptive: Empirical Insights into MLLMs' Understanding of Detection Informationcited by 16
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 4.
6 papers.
- 2025A Survey of Multimodal Hallucination Evaluation and Detectioncited by 27
- 2025Attention Basin: Why Contextual Position Matters in Large Language Modelscited by 2
- 2026Scaling Properties of Text Conditioning in Visual Generationcited by 2
- 2026Long-Text-to-Image Generation via Compositional Prompt Decompositioncited by 1
- 2026GenScale: A Benchmark for Relative Object Scale in Image Generation and Editingcited by 1
- 2026Panoptic Scene Program Diffusion Transformercited by 0
- 2026Panoptic Scene Program Diffusion Transformer24 Sep 2026
- 2026GenScale: A Benchmark for Relative Object Scale in Image Generation and Editing1 Sep 2026
- 2026Scaling Properties of Text Conditioning in Visual Generation31 Jul 2026
- 2026Long-Text-to-Image Generation via Compositional Prompt Decomposition20 Apr 2026
- 2025Attention Basin: Why Contextual Position Matters in Large Language Models7 Aug 2025
- 2025A Survey of Multimodal Hallucination Evaluation and Detection25 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2025Detail++: Training-Free Detail Enhancer for T2I Diffusion Models
- 2025AcT2I: Evaluating and Improving Action Depiction in Text-to-Image Models
- 2025ConceptMix++: Leveling the Playing Field in Text-to-Image Benchmarking via Iterative Prompt Optimization
- 2025Draw ALL Your Imagine: A Holistic Benchmark and Agent Framework for Complex Instruction-based Image Generation
- 2025Test-time Prompt Refinement for Text-to-Image Models
- 2025POET: Preference Optimization for Enhanced Text-to-Image Generation
- 2025DeCoT: Decomposing Complex Instructions for Enhanced Text-to-Image Generation with Large Language Models
- 2025TIIF-Bench: How Does Your T2I Model Follow Your Instructions?