A Matched-Budget Audit Framework for Recaptioned Image-Text Supervision Distributions
Not on the map. Why?
Abstract (arXiv)
Recaptioned image-text corpora are now standard for text-to-image (T2I) training, with vision--language model (VLM) captioners replacing sparse alt-text by dense descriptions. A recaptioned corpus is a supervision distribution induced by a documented captioning policy (π), captioner (Vc), and source corpus (C). Length-correlated proxies miss caption-register artifacts and downstream T2I benchmarks entangle the corpus with training choices, so this distribution is hard to audit at corpus scale. We introduce a reusable matched-budget audit framework for recaptioned supervision distributions Dπ,Vc,C: at a fixed text budget of B = 64 it reports a five-axis profile spanning prompt-side coverage, image-conditioned faithfulness, and caption-surface health, with claimed controllable basic units (CBU) as the common claim unit. We instantiate the framework on seven paired comparisons over five public source corpora. Across the four cross-corpus pairs, the released surface raises supported CBU per caption by +3.39 to +6.36 under both Qwen and Gemma Judges, and on CC12M the same framework exposes a long-vs-dense frontier that is consistent across both judges and four budgets. We release the audited multi-source recap corpus (≈ 490M) together with the audit-artifact bundle.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 46 of its 58 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
46 of 58 references.
References · 46
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2018Datasheets for Datasetscited by 1,371
- 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,209
- 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,000
34 more
- 2025Qwen-Image Technical Reportcited by 973
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2018Object Hallucination in Image Captioningcited by 661
- 2023DataComp: In search of the next generation of multimodal datasetscited by 635
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
- 2020Reliable Fidelity and Diversity Metrics for Generative Modelscited by 425
- 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 416
- 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 403
- 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 376
- 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 299
- 2024Long-CLIP: Unlocking the Long-Text Capability of CLIPcited by 298
- 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 253
- 2022Optimizing Prompts for Text-to-Image Generationcited by 204
- 2023Davidsonian Scene Graph: Improving Reliability in Fine-grained Evaluation for Text-to-Image Generationcited by 159
- 2020REVISE: A Tool for Measuring and Mitigating Bias in Visual Datasetscited by 136
- 2023A Picture is Worth More Than 77 Text Tokens: Evaluating CLIP-Style Models on Dense Captionscited by 107
- 2023CapsFusion: Rethinking Image-Text Data at Scalecited by 90
- 2024Improving Text-to-Image Consistency via Automatic Prompt Optimizationcited by 88
- 2024What If We Recaption Billions of Web Images with LLaMA-3?cited by 82
- 2024Croissant: A Metadata Format for ML-Ready Datasetscited by 79
- 2023Into the LAIONs Den: Investigating Hate in Multimodal Datasetscited by 54
- 2023FaithScore: Fine-grained Evaluations of Hallucinations in Large Vision-Language Modelscited by 44
- 2024ALOHa: A New Measure for Hallucination in Captioning Modelscited by 44
- 2023A Picture is Worth a Thousand Words: Principled Recaptioning Improves Image Generationcited by 40
- 2023Prompt Expansion for Adaptive Text-to-Image Generationcited by 24
- 2025Painting with Words: Elevating Detailed Image Captioning with Benchmark and Alignment Learningcited by 23
- 2024From Descriptive Richness to Bias: Unveiling the Dark Side of Generative Image Caption Enrichmentcited by 8
- 2024A Standardized Machine-readable Dataset Documentation Format for Responsible AIcited by 6
- 2024TIPO: Text to Image with Text Presampling for Prompt Optimizationcited by 6
- 2024Capability-aware Prompt Reformulation Learning for Text-to-Image Generationcited by 5
- 2025How to Train your Text-to-Image Model: Evaluating Design Choices for Synthetic Training Captionscited by 5
- 2025Harnessing Caption Detailness for Data-Efficient Text-to-Image Generationcited by 3
- 2025Structured Captions Improve Prompt Adherence in Text-to-Image Models (Re-LAION-Caption 19M)cited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Linear Alignment of Vision-language Models for Image Captioning
- 2025RICO: Improving Accuracy and Completeness in Image Recaptioning via Visual Reconstruction
- 2026MONET: A Massive, Open, Non-redundant and Enriched Text-to-image dataset
- 2026ReflectCAP: Detailed Image Captioning with Reflective Memory
- 2025IF-VidCap: Can Video Caption Models Follow Instructions?
- 2026VIVECaption: A Split Approach to Caption Quality Improvement
- 2026DEPICT: Scoring Text-to-Image Alignment by Answer Agreement
- 2026ProCap: Prominence-guided Object Rectification for Faithful and Comprehensive Video Captioning