mlsanityData to 14 Oct 2026

Text-Printed Image: Bridging the Image-Text Modality Gap for Text-centric Training of Large Vision-Language Models

arXiv 2512.03463 ↗First posted 3 Dec 2025cs.CV cs.AI cs.CLcited by 1

On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning

Abstract (arXiv)

Recent large vision-language models (LVLMs) have been applied to diverse VQA tasks. However, achieving practical performance typically requires task-specific fine-tuning with large numbers of image-text pairs, which are costly to collect. In this work, we study text-centric training, a setting where only textual descriptions are available and no real images are provided, as a paradigm for low-cost data scaling. Unlike images, whose collection is often restricted by privacy constraints and scarcity in niche domains, text is widely available. Moreover, text is easily editable, enabling automatic diversification and expansion with LLMs at minimal human effort. While this offers clear advantages over image collection in terms of scalability and cost, training on raw text without images still yields limited gains on VQA tasks because of the image-text modality gap. To address this issue, we propose a Text-Printed Image (TPI), which generates synthetic images by directly rendering the given textual description on a plain white canvas. This simple rendering projects text into the image modality and can be integrated into arbitrary existing LVLM training pipelines at low cost. Moreover, TPI preserves the semantics of the text, whereas text-to-image models often fail to do. Across four models and seven benchmarks, our systematic experiments show that TPI enables more effective text-centric training than synthetic images generated by a diffusion model. We further explore TPI as a low-cost data-augmentation strategy and demonstrate its practical utility. Overall, our findings highlight the significant potential of text-centric training and, more broadly, chart a path toward fully automated data generation for LVLMs.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 65 of its 78 references that are in the map. First posted on arXiv 3 Dec 2025.

Builds on

65 of 78 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024Improving Fine-grained Visual Understanding in VLMs through Text-Only Training17 Dec
  2. 2024Towards Efficient and Robust VQA-NLE Data Generation with Large Vision-Language Models23 Sep
  3. 2024Synth2: Boosting Visual-Language Models with Synthetic Captions and Image Embeddings12 Mar
  4. 2024ALLaVA: Harnessing GPT4V-Synthesized Data for Lite Vision-Language Models18 Feb
  5. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond24 Aug

Other references · 60

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2023Visual Instruction Tuningcited by 7,869
  4. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  5. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  6. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  7. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  8. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  9. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  10. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  11. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  12. 2019Similarity of Neural Network Representations Revisitedcited by 1,755
38 more
  1. 2019Towards VQA Models That Can Readcited by 1,718
  2. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  3. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
  4. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  5. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
  6. 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
  7. 2018VizWiz Grand Challenge: Answering Visual Questions from Blind Peoplecited by 858
  8. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
  9. 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 807
  10. 2023VILA: On Pre-training for Visual Language Modelscited by 692
  11. 2022Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learningcited by 561
  12. 2023DriveLM: Driving with Graph Visual Question Answeringcited by 536
  13. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
  14. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
  15. 2021InfographicVQAcited by 437
  16. 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 428
  17. 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Modelscited by 353
  18. 2023Effective Data Augmentation With Diffusion Modelscited by 283
  19. 2023LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understandingcited by 274
  20. 2022CLIP-ReID: Exploiting Vision-Language Model for Image Re-Identification without Concrete Text Labelscited by 181
  21. 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 154
  22. 2024Vision-Language Models for Medical Report Generation and Visual Question Answering: A Reviewcited by 125
  23. 2022MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuningcited by 109
  24. 2022On the duality between contrastive and non-contrastive self-supervised learningcited by 108
  25. 2023Scaling Laws of Synthetic Images for Model Training ... for Nowcited by 108
  26. 2022Text-Only Training for Image Captioning using Noise-Injected CLIPcited by 91
  27. 2023DeCap: Decoding CLIP Latents for Zero-Shot Captioning via Text-Only Trainingcited by 84
  28. 2023VIGC: Visual Instruction Generation and Correctioncited by 80
  29. 2024Vision-Flan: Scaling Human-Labeled Tasks in Visual Instruction Tuningcited by 73
  30. 2025Virgo: A Preliminary Exploration on Reproducing o1-like MLLMcited by 68
  31. 2024SynthCLIP: Are We Ready for a Fully Synthetic CLIP Training?cited by 64
  32. 2023Diagnosing and Rectifying Vision Models using Languagecited by 58
  33. 2022Shifted Diffusion for Text-to-image Generationcited by 37
  34. 2025EndoChat: Grounded Multimodal Large Language Model for Endoscopic Surgerycited by 37
  35. 2024On Large Visual Language Models for Medical Imaging Analysis: An Empirical Studycited by 28
  36. 2025OmniAlign-V: Towards Enhanced Alignment of MLLMs with Human Preferencecited by 28
  37. 2024Connect, Collapse, Corrupt: Learning Cross-Modal Tasks with Uni-Modal Datacited by 27
  38. 2021Constructing Multi-Modal Dialogue Dataset by Replacing Text with Semantically Relevant Imagescited by 26

50 most cited of 60 All 60 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Text-Only Data Synthesis for Vision Language Model Training
  2. 2022LAION-5B: An open large-scale dataset for training next generation image-text models
  3. 2024The Narrow Gate: Localized Image-Text Communication in Native Multimodal Models
  4. 2025Symmetrical Visual Contrastive Optimization: Aligning Vision-Language Models with Minimal Contrastive Images
  5. 2026High-Fidelity Text-to-Image Generation from Pre-Trained Vision-Language Models via Distribution-Conditioned Diffusion Decoding
  6. 2025Scaling Text-Rich Image Understanding via Code-Guided Synthetic Multimodal Data Generation
  7. 2023Text as Images: Can Multimodal Large Language Models Follow Printed Instructions in Pixels?
  8. 2023CiT: Curation in Training for Effective Vision-Language Data