mlsanityData to 14 Oct 2026

Scaling Properties of Text Conditioning in Visual Generation

arXiv 2607.29679 ↗First posted 31 Jul 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

We study empirical scaling properties for text conditioning in visual generation. Such properties have rarely been measured because diffusion loss does not scale with the number of tokens in natural-language prompts. Surprisingly, we find that the converged diffusion loss scales with the amount of structured language in the prompt. To quantify structured language, we adapt two complementary measures: a white-box likelihood metric (GPG) and a black-box attribute metric (ED). Across controlled training runs, the converged diffusion loss decreases approximately linearly with GPG and follows a power law with ED. Guided by these scaling properties, we improve diffusability by constructing structured prompts with semantic and geometric annotations derived from images, and improve promptability by training a prompter through supervised fine-tuning, cold-start, and verifier-gated on-policy distillation. The resulting system outperforms all evaluated open-weight models on nearly every compositional, reasoning, and world-knowledge benchmark, while matching or surpassing the strongest closed-weight models on most evaluations.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 27 of its 64 references that are in the map. First posted on arXiv 31 Jul 2026.

Builds on

27 of 64 references.

References · 27

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2020Scaling Laws for Neural Language Modelscited by 6,586
  4. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  5. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  6. 2025Qwen-Image Technical Reportcited by 1,044
  7. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  8. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
  9. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
  10. 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 204
  11. 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
  12. 2025HunyuanImage 3.0 Technical Reportcited by 149
15 more
  1. 2025Emu3.5: Native Multimodal Models are World Learnerscited by 132
  2. 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 100
  3. 2025LongCat-Image Technical Reportcited by 100
  4. 2025Improving the Diffusability of Autoencoderscited by 80
  5. 2025TIIF-Bench: How Does Your T2I Model Follow Your Instructions?cited by 69
  6. 2025GenEval 2: Addressing Benchmark Drift in Text-to-Image Evaluationcited by 52
  7. 2024Scaling Laws For Diffusion Transformerscited by 44
  8. 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewritingcited by 43
  9. 2023A Picture is Worth a Thousand Words: Principled Recaptioning Improves Image Generationcited by 41
  10. 2026GEMS: Agent-Native Multimodal Generation with Memory and Skillscited by 21
  11. 2025Generating an Image From 1,000 Words: Enhancing Text-to-Image With Structured Captionscited by 14
  12. 2025DetailMaster: Can Your Text-to-Image Model Handle Long Prompts?cited by 6
  13. 2025Harnessing Caption Detailness for Data-Efficient Text-to-Image Generationcited by 4
  14. 2025POET: Preference Optimization for Enhanced Text-to-Image Generationcited by 4
  15. 2025Structured Captions Improve Prompt Adherence in Text-to-Image Models (Re-LAION-Caption 19M)cited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Diversifying Long Prompt Image Generation through Structured Prompt Embedding Space Sampling
  2. 2024Words Worth a Thousand Pictures: Measuring and Understanding Perceptual Variability in Text-to-Image Generation
  3. 2025ConceptMix++: Leveling the Playing Field in Text-to-Image Benchmarking via Iterative Prompt Optimization
  4. 2026Abra: Scaling Diffusion Image Training
  5. 2026All-in-One Conditioning for Text-to-Image Synthesis
  6. 2025TextInVision: Text and Prompt Complexity Driven Visual Text Generation Benchmark
  7. 2026Large Language Models are Universal Reasoners for Visual Generation
  8. 2026Text-to-Image Models Need Less from Text Encoders Than You Think