mlsanityData to 14 Oct 2026

The Describe-Then-Generate Bottleneck: How VLM Descriptions Alter Image Generation Outcomes

arXiv 2509.18179 ↗First posted 18 Sep 2025cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

With the increasing integration of multimodal AI systems in creative workflows, understanding information loss in vision-language-vision pipelines has become important for evaluating system limitations. However, the degradation that occurs when visual content passes through textual intermediation remains poorly quantified. In this work, we provide empirical analysis of the describe-then-generate bottleneck, where natural language serves as an intermediate representation for visual information. We generated 150 image pairs through the describe-then-generate pipeline and applied existing metrics (LPIPS, SSIM, and color distance) to measure information preservation across perceptual, structural, and chromatic dimensions. Our evaluation reveals that 99.3% of samples exhibit substantial perceptual degradation and 91.5% demonstrate significant structural information loss, providing empirical evidence that the describe-then-generate bottleneck represents a measurable and consistent limitation in contemporary multimodal systems.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 35 references that are in the map. First posted on arXiv 18 Sep 2025.

Builds on

25 of 35 references.

References · 25

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  5. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
  6. 2020Concept Bottleneck Modelscited by 1,032
  7. 2024DeCo: Decoupling Token Compression from Semantic Abstraction in Multimodal Large Language Modelscited by 75
  8. 2024Cross-modal Information Flow in Multimodal Large Language Modelscited by 67
  9. 2023Extending Context Window of Large Language Models via Semantic Compressioncited by 45
  10. 2022Geometric Multimodal Contrastive Representation Learningcited by 40
  11. 2024Looking Beyond Text: Reducing Language bias in Large Vision-Language Models via Multimodal Dual-Attention and Soft-Image Guidancecited by 32
  12. 2025Identifying and Mitigating Position Bias of Multi-image Vision-Language Modelscited by 25
13 more
  1. 2025Lost in Embeddings: Information Loss in Vision-Language Modelscited by 20
  2. 2025Principled Multimodal Representation Learningcited by 19
  3. 2024See It from My Perspective: How Language Affects Cultural Bias in Image Understandingcited by 17
  4. 2024DCBM: Data-Efficient Visual Concept Bottleneck Modelscited by 16
  5. 2025Learning Optimal Multimodal Information Bottleneck Representationscited by 15
  6. 2023Dynamic Multimodal Information Bottleneck for Multimodality Classificationcited by 14
  7. 2020Improving Image Autoencoder Embeddings with Perceptual Losscited by 13
  8. 2025Aligning Multimodal Representations through an Information Bottleneckcited by 13
  9. 2024Free-VSC: Free Semantics from Visual Foundation Models for Unsupervised Video Semantic Compressioncited by 10
  10. 2025VisuRiddles: Fine-grained Perception is a Primary Bottleneck for Multimodal Large Language Models in Abstract Visual Reasoningcited by 7
  11. 2025Multimodal Conditional Information Bottleneck for Generalizable AI-Generated Image Detectioncited by 5
  12. 2025Uncovering Cultural Representation Disparities in Vision-Language Modelscited by 4
  13. 2023The Right Losses for the Right Gains: Improving the Semantic Consistency of Deep Text-to-Image Generation with Distribution-Sensitive Lossescited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024The Narrow Gate: Localized Image-Text Communication in Native Multimodal Models
  2. 2025Growing Visual Generative Capacity for Pre-Trained MLLMs
  3. 2024What's in the Image? A Deep-Dive into the Vision of Vision Language Models
  4. 2026Do Vision Language Models Need to Process Image Tokens?
  5. 2026CLEAR: Unlocking Generative Potential for Degraded Image Understanding in Unified Multimodal Models
  6. 2026Scaling Properties of Text Conditioning in Visual Generation
  7. 2026EmCom-Diffusion: Probing Visual Reflection in Emergent Languages via Image Generation
  8. 2026Reversing the Flow: Generation-to-Understanding Synergy in Large Multimodal Models