Long-Text-to-Image Generation via Compositional Prompt Decomposition
Not on the map. Why?
Abstract (arXiv)
While modern text-to-image (T2I) models excel at generating images from intricate prompts, they struggle to capture the key details when the inputs are descriptive paragraphs. This limitation stems from the prevalence of concise captions that shape their training distributions. Existing methods attempt to bridge this gap by either fine-tuning T2I models on long prompts, which generalizes poorly to longer lengths; or by projecting the oversize inputs into normal-prompt space and compromising fidelity. We propose Prompt Refraction for Intricate Scene Modeling (PRISM), a compositional approach that enables pre-trained T2I models to process long sequence inputs. PRISM uses a lightweight module to extract constituent representations from the long prompts. The T2I model makes independent noise predictions for each component, and their outputs are merged into a single denoising step using energy-based conjunction. We evaluate PRISM across a wide range of model architectures, showing comparable performances to models fine-tuned on the same training data. Furthermore, PRISM demonstrates superior generalization, outperforming baseline models by 7.4% on prompts over 500 tokens in a challenging public benchmark.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 42 of its 49 references that are in the map. First posted on arXiv 20 Apr 2026.
Builds on
42 of 49 references.
References · 42
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
30 more
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2025Qwen-Image Technical Reportcited by 1,044
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,005
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 536
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
- 2023Directly Fine-Tuning Diffusion Models on Differentiable Rewardscited by 448
- 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 287
- 2023Reduce, Reuse, Recycle: Compositional Generation with Energy-Based Diffusion Models and MCMCcited by 220
- 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 211
- 2024LongAlign: A Recipe for Long Context Alignment of Large Language Modelscited by 106
- 2024Compositional Generative Modeling: A Single Model is Not All You Needcited by 41
- 2023Compositional Diffusion-Based Continuous Constraint Solverscited by 40
- 2023Paragraph-to-Image Generation with Information-Enriched Diffusion Modelcited by 39
- 2023Unsupervised Compositional Concepts Discovery with Text-to-Image Generative Modelscited by 36
- 2024LLM4GEN: Leveraging Semantic Representation of LLMs for Text-to-Image Generationcited by 30
- 2023Compositional Sculpting of Iterative Generative Processescited by 27
- 2024Bridging Different Language Models and Generative Vision Models for Text-to-Image Generationcited by 17
- 2025Mechanisms of Projective Composition of Diffusion Modelscited by 14
- 2024Compositional Risk Minimizationcited by 13
- 2024Compositional Image Decomposition with Diffusion Modelscited by 12
- 2025DetailMaster: Can Your Text-to-Image Model Handle Long Prompts?cited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Panoptic Scene Program Diffusion Transformercited by 0
- 2026Panoptic Scene Program Diffusion Transformer24 Sep 2026