Text-Printed Image: Bridging the Image-Text Modality Gap for Text-centric Training of Large Vision-Language Models
On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning
Abstract (arXiv)
Recent large vision-language models (LVLMs) have been applied to diverse VQA tasks. However, achieving practical performance typically requires task-specific fine-tuning with large numbers of image-text pairs, which are costly to collect. In this work, we study text-centric training, a setting where only textual descriptions are available and no real images are provided, as a paradigm for low-cost data scaling. Unlike images, whose collection is often restricted by privacy constraints and scarcity in niche domains, text is widely available. Moreover, text is easily editable, enabling automatic diversification and expansion with LLMs at minimal human effort. While this offers clear advantages over image collection in terms of scalability and cost, training on raw text without images still yields limited gains on VQA tasks because of the image-text modality gap. To address this issue, we propose a Text-Printed Image (TPI), which generates synthetic images by directly rendering the given textual description on a plain white canvas. This simple rendering projects text into the image modality and can be integrated into arbitrary existing LVLM training pipelines at low cost. Moreover, TPI preserves the semantics of the text, whereas text-to-image models often fail to do. Across four models and seven benchmarks, our systematic experiments show that TPI enables more effective text-centric training than synthetic images generated by a diffusion model. We further explore TPI as a low-cost data-augmentation strategy and demonstrate its practical utility. Overall, our findings highlight the significant potential of text-centric training and, more broadly, chart a path toward fully automated data generation for LVLMs.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 65 of its 78 references that are in the map. First posted on arXiv 3 Dec 2025.
Builds on
65 of 78 references.
Closest ancestors · 5
Same direction, newest first
- 2024Improving Fine-grained Visual Understanding in VLMs through Text-Only Training17 Dec
- 2024Towards Efficient and Robust VQA-NLE Data Generation with Large Vision-Language Models23 Sep
- 2024Synth2: Boosting Visual-Language Models with Synthetic Captions and Image Embeddings12 Mar
- 2024ALLaVA: Harnessing GPT4V-Synthesized Data for Lite Vision-Language Models18 Feb
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond24 Aug
Other references · 60
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Visual Instruction Tuningcited by 7,869
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2019Similarity of Neural Network Representations Revisitedcited by 1,755
38 more
- 2019Towards VQA Models That Can Readcited by 1,718
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
- 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
- 2018VizWiz Grand Challenge: Answering Visual Questions from Blind Peoplecited by 858
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
- 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 807
- 2023VILA: On Pre-training for Visual Language Modelscited by 692
- 2022Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learningcited by 561
- 2023DriveLM: Driving with Graph Visual Question Answeringcited by 536
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
- 2021InfographicVQAcited by 437
- 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 428
- 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Modelscited by 353
- 2023Effective Data Augmentation With Diffusion Modelscited by 283
- 2023LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understandingcited by 274
- 2022CLIP-ReID: Exploiting Vision-Language Model for Image Re-Identification without Concrete Text Labelscited by 181
- 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 154
- 2024Vision-Language Models for Medical Report Generation and Visual Question Answering: A Reviewcited by 125
- 2022MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuningcited by 109
- 2022On the duality between contrastive and non-contrastive self-supervised learningcited by 108
- 2023Scaling Laws of Synthetic Images for Model Training ... for Nowcited by 108
- 2022Text-Only Training for Image Captioning using Noise-Injected CLIPcited by 91
- 2023DeCap: Decoding CLIP Latents for Zero-Shot Captioning via Text-Only Trainingcited by 84
- 2023VIGC: Visual Instruction Generation and Correctioncited by 80
- 2024Vision-Flan: Scaling Human-Labeled Tasks in Visual Instruction Tuningcited by 73
- 2025Virgo: A Preliminary Exploration on Reproducing o1-like MLLMcited by 68
- 2024SynthCLIP: Are We Ready for a Fully Synthetic CLIP Training?cited by 64
- 2023Diagnosing and Rectifying Vision Models using Languagecited by 58
- 2022Shifted Diffusion for Text-to-image Generationcited by 37
- 2025EndoChat: Grounded Multimodal Large Language Model for Endoscopic Surgerycited by 37
- 2024On Large Visual Language Models for Medical Imaging Analysis: An Empirical Studycited by 28
- 2025OmniAlign-V: Towards Enhanced Alignment of MLLMs with Human Preferencecited by 28
- 2024Connect, Collapse, Corrupt: Learning Cross-Modal Tasks with Uni-Modal Datacited by 27
- 2021Constructing Multi-Modal Dialogue Dataset by Replacing Text with Semantically Relevant Imagescited by 26
50 most cited of 60 All 60 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Text-Only Data Synthesis for Vision Language Model Training
- 2022LAION-5B: An open large-scale dataset for training next generation image-text models
- 2024The Narrow Gate: Localized Image-Text Communication in Native Multimodal Models
- 2025Symmetrical Visual Contrastive Optimization: Aligning Vision-Language Models with Minimal Contrastive Images
- 2026High-Fidelity Text-to-Image Generation from Pre-Trained Vision-Language Models via Distribution-Conditioned Diffusion Decoding
- 2025Scaling Text-Rich Image Understanding via Code-Guided Synthetic Multimodal Data Generation
- 2023Text as Images: Can Multimodal Large Language Models Follow Printed Instructions in Pixels?
- 2023CiT: Curation in Training for Effective Vision-Language Data