mlsanityData to 7 Oct 2026

A Matched-Budget Audit Framework for Recaptioned Image-Text Supervision Distributions

arXiv 2610.00952 ↗First posted 1 Oct 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Recaptioned image-text corpora are now standard for text-to-image (T2I) training, with vision--language model (VLM) captioners replacing sparse alt-text by dense descriptions. A recaptioned corpus is a supervision distribution induced by a documented captioning policy (π), captioner (Vc), and source corpus (C). Length-correlated proxies miss caption-register artifacts and downstream T2I benchmarks entangle the corpus with training choices, so this distribution is hard to audit at corpus scale. We introduce a reusable matched-budget audit framework for recaptioned supervision distributions Dπ,Vc,C: at a fixed text budget of B = 64 it reports a five-axis profile spanning prompt-side coverage, image-conditioned faithfulness, and caption-surface health, with claimed controllable basic units (CBU) as the common claim unit. We instantiate the framework on seven paired comparisons over five public source corpora. Across the four cross-corpus pairs, the released surface raises supported CBU per caption by +3.39 to +6.36 under both Qwen and Gemma Judges, and on CC12M the same framework exposes a long-vs-dense frontier that is consistent across both judges and four budgets. We release the audited multi-source recap corpus (≈ 490M) together with the audit-artifact bundle.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 46 of its 58 references that are in the map. First posted on arXiv 1 Oct 2026.

Builds on

46 of 58 references.

References · 46

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  5. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  6. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  7. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  8. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  9. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  10. 2018Datasheets for Datasetscited by 1,371
  11. 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,209
  12. 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,000
34 more
  1. 2025Qwen-Image Technical Reportcited by 973
  2. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
  3. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  4. 2018Object Hallucination in Image Captioningcited by 661
  5. 2023DataComp: In search of the next generation of multimodal datasetscited by 635
  6. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
  7. 2020Reliable Fidelity and Diversity Metrics for Generative Modelscited by 425
  8. 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 416
  9. 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 403
  10. 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 376
  11. 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 299
  12. 2024Long-CLIP: Unlocking the Long-Text Capability of CLIPcited by 298
  13. 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 253
  14. 2022Optimizing Prompts for Text-to-Image Generationcited by 204
  15. 2023Davidsonian Scene Graph: Improving Reliability in Fine-grained Evaluation for Text-to-Image Generationcited by 159
  16. 2020REVISE: A Tool for Measuring and Mitigating Bias in Visual Datasetscited by 136
  17. 2023A Picture is Worth More Than 77 Text Tokens: Evaluating CLIP-Style Models on Dense Captionscited by 107
  18. 2023CapsFusion: Rethinking Image-Text Data at Scalecited by 90
  19. 2024Improving Text-to-Image Consistency via Automatic Prompt Optimizationcited by 88
  20. 2024What If We Recaption Billions of Web Images with LLaMA-3?cited by 82
  21. 2024Croissant: A Metadata Format for ML-Ready Datasetscited by 79
  22. 2023Into the LAIONs Den: Investigating Hate in Multimodal Datasetscited by 54
  23. 2023FaithScore: Fine-grained Evaluations of Hallucinations in Large Vision-Language Modelscited by 44
  24. 2024ALOHa: A New Measure for Hallucination in Captioning Modelscited by 44
  25. 2023A Picture is Worth a Thousand Words: Principled Recaptioning Improves Image Generationcited by 40
  26. 2023Prompt Expansion for Adaptive Text-to-Image Generationcited by 24
  27. 2025Painting with Words: Elevating Detailed Image Captioning with Benchmark and Alignment Learningcited by 23
  28. 2024From Descriptive Richness to Bias: Unveiling the Dark Side of Generative Image Caption Enrichmentcited by 8
  29. 2024A Standardized Machine-readable Dataset Documentation Format for Responsible AIcited by 6
  30. 2024TIPO: Text to Image with Text Presampling for Prompt Optimizationcited by 6
  31. 2024Capability-aware Prompt Reformulation Learning for Text-to-Image Generationcited by 5
  32. 2025How to Train your Text-to-Image Model: Evaluating Design Choices for Synthetic Training Captionscited by 5
  33. 2025Harnessing Caption Detailness for Data-Efficient Text-to-Image Generationcited by 3
  34. 2025Structured Captions Improve Prompt Adherence in Text-to-Image Models (Re-LAION-Caption 19M)cited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Linear Alignment of Vision-language Models for Image Captioning
  2. 2025RICO: Improving Accuracy and Completeness in Image Recaptioning via Visual Reconstruction
  3. 2026MONET: A Massive, Open, Non-redundant and Enriched Text-to-image dataset
  4. 2026ReflectCAP: Detailed Image Captioning with Reflective Memory
  5. 2025IF-VidCap: Can Video Caption Models Follow Instructions?
  6. 2026VIVECaption: A Split Approach to Caption Quality Improvement
  7. 2026DEPICT: Scoring Text-to-Image Alignment by Answer Agreement
  8. 2026ProCap: Prominence-guided Object Rectification for Faithful and Comprehensive Video Captioning