Detail++: Training-Free Detail Enhancer for T2I Diffusion Models
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Recent advances in text-to-image (T2I) generation have led to impressive visual results. However, these models still face significant challenges when handling complex prompt, particularly those involving multiple subjects with distinct attributes. Inspired by the human drawing process, which first outlines the composition and then incrementally adds details, we propose Detail++, a training-free framework that introduces a novel Progressive Detail Injection (PDI) strategy to address this limitation. Specifically, we decompose a complex prompt into a sequence of simplified sub-prompts, guiding the generation process in stages. This staged generation leverages the inherent layout-controlling capacity of self-attention to first ensure global composition, followed by precise refinement. To achieve accurate binding between attributes and corresponding subjects, we exploit cross-attention mechanisms and further introduce a Centroid Alignment Loss at test time to reduce binding noise and enhance attribute consistency. Extensive experiments on T2I-CompBench and a newly constructed style composition benchmark demonstrate that Detail++ significantly outperforms existing methods, particularly in scenarios involving multiple objects and complex stylistic conditions.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 66 of its 79 references that are in the map. First posted on arXiv 23 Jul 2025.
Builds on
66 of 79 references.
Closest ancestors · 34
Same direction, newest first
- 2025Rethinking Cross-Modal Interaction in Multimodal Diffusion Transformers9 Jun
- 2024Enhancing MMDiT-Based Text-to-Image Models for Similar Subject Generation27 Nov
- 2024Text Embedding is Not All You Need: Attention Control for Text-to-Image Semantic Alignment with Text Self-Attention Maps21 Nov
- 2024IterComp: Iterative Composition-Aware Feedback Learning from Model Gallery for Text-to-Image Generation9 Oct
- 2024A Cat Is A Cat (Not A Dog!): Unraveling Information Mix-ups in Text-to-Image Encoders through Causal Analysis and Embedding Optimization1 Oct
- 2024Object-Conditioned Energy-Based Attention Map Alignment in Text-to-Image Diffusion Models10 Apr
- 2024CoMat: Aligning Text-to-Image Diffusion Model with Image-to-Text Concept Matching4 Apr
- 2024Enhancing Semantic Fidelity in Text-to-Image Synthesis: Attention Regulation in Diffusion Models11 Mar
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment8 Mar
- 2024Towards Understanding Cross and Self-Attention in Stable Diffusion for Text-Guided Image Editing6 Mar
- 2024RealCompo: Balancing Realism and Compositionality Improves Text-to-Image Diffusion Models20 Feb
- 2024DreamMatcher: Appearance Matching Self-Attention for Semantically-Consistent Text-to-Image Personalization15 Feb
22 more
- 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMs22 Jan
- 2023Ranni: Taming Text-to-Image Diffusion for Accurate Instruction Following28 Nov
- 2023LoCo: Locally Constrained Training-Free Layout-to-Image Synthesis21 Nov
- 2023LayoutLLM-T2I: Eliciting Layout Guidance from LLM for Text-to-Image Generation9 Aug
- 2023Divide & Bind Your Attention for Improved Generative Semantic Nursing20 Jul
- 2023A-STAR: Test-time Attention Segregation and Retention for Text-to-image Synthesis26 Jun
- 2023Energy-Based Cross Attention for Bayesian Context Update in Text-to-Image Diffusion Models16 Jun
- 2023Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignment15 Jun
- 2023GeoDiffusion: Text-Prompted Geometric Control for Object Detection Data Generation7 Jun
- 2023Controllable Text-to-Image Generation with GPT-429 May
- 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Models23 May
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generation30 Mar
- 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models31 Jan
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generation17 Jan
- 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis9 Dec
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoisers2 Nov
- 2022Compositional Visual Generation with Composable Diffusion Models3 Jun
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulation6 Oct
Other references · 32
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
20 more
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
- 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 276
- 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 253
- 2023Style Aligned Image Generation via Shared Attentioncited by 214
- 2022ReCo: Region-Controlled Text-to-Image Generationcited by 177
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 162
- 2019ManiGAN: Text-Guided Image Manipulationcited by 156
- 2018Text-Adaptive Generative Adversarial Networks: Manipulating Images with Natural Languagecited by 90
- 2023Expressive Text-to-Image Generation with Rich Textcited by 89
- 2024Token Merging for Training-Free Semantic Binding in Text-to-Image Synthesiscited by 35
- 2024StyleStudio: Text-Driven Style Transfer with Selective Control of Style Elementscited by 26
- 2023What is in a Text-to-Image Prompt: The Potential of Stable Diffusion in Visual Arts Educationcited by 14
- 2024CoRe: Context-Regularized Text Embedding Learning for Text-to-Image Personalizationcited by 14
- 2024Unbounded: A Generative Infinite Game of Character Life Simulationcited by 14
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025Adaptive Stochastic Coefficients for Accelerating Diffusion Samplingcited by 6
- 2026Temporal and Cross-Modal Alignment for Enhanced Audiovisual Video Captioningcited by 1
- 2026Delta-K: Boosting Multi-Instance Generation via Cross-Attention Augmentationcited by 0
- 2026STEDiff: Strengthening Text Embedding for Text-to-Image Alignment in Diffusion Modelcited by 0
- 2026Temporal and Cross-Modal Alignment for Enhanced Audiovisual Video Captioning2 Jul 2026
- 2026STEDiff: Strengthening Text Embedding for Text-to-Image Alignment in Diffusion Model9 Jun 2026
- 2026Delta-K: Boosting Multi-Instance Generation via Cross-Attention Augmentation10 Mar 2026
- 2025Adaptive Stochastic Coefficients for Accelerating Diffusion Sampling27 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025DetailMaster: Can Your Text-to-Image Model Handle Long Prompts?
- 2024Draw Like an Artist: Complex Scene Generation with Diffusion Model via Composition, Painting, and Retouching
- 2023Separate-and-Enhance: Compositional Finetuning for Text2Image Diffusion Models
- 2023Compositional Text-to-Image Synthesis with Attention Map Control of Diffusion Models
- 2024GraPE: A Generate-Plan-Edit Framework for Compositional T2I Synthesis
- 2025Local Prompt Adaptation for Style-Consistent Multi-Object Generation in Diffusion Models
- 2025Draw ALL Your Imagine: A Holistic Benchmark and Agent Framework for Complex Instruction-based Image Generation
- 2026CoBind: Stage-Aware Compositional Binding for Training-Free Text-to-Image Generation