mlsanityData to 14 Oct 2026

Synthetic Perception: Can Generated Images Unlock Latent Visual Prior for Text-Centric Reasoning?

arXiv 2506.17623 ↗First posted 21 Jun 2025cs.MM cs.CVcited by 0

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

A significant ``modality gap" exists between the abundance of text-only data and the increasing power of multimodal models. This work systematically investigates whether images generated on-the-fly by Text-to-Image (T2I) models can serve as a mechanism to unlock latent visual priors for text-centric reasoning. Through a comprehensive evaluation framework on text classification, we analyze the impact of critical variables, including T2I model quality (e.g., Flux.1, SDXL), prompt engineering strategies, and multimodal fusion architectures. Our findings demonstrate that this ``synthetic perception" can yield significant performance gains by effectively projecting text into a visual semantic space, even when augmenting strong large language model baselines like Llama-3 and Qwen-2.5. We show that this approach serves as a form of cross-modal probing, mitigating the sensory deprivation inherent in pure text training. However, the effectiveness is highly conditional, depending on the semantic alignment between text and the generated image, the task's visual groundability, and the generative fidelity of the T2I model. Our work establishes a rigorous benchmark for this paradigm, demonstrating its viability as a pathway to enrich language understanding in traditionally unimodal scenarios.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 18 of its 38 references that are in the map. First posted on arXiv 21 Jun 2025.

Builds on

18 of 38 references.

References · 18

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  4. 2023Mistral 7Bcited by 3,164
  5. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  6. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  7. 2017Decoupled Weight Decay Regularizationcited by 1,831
  8. 2024Qwen2.5-Coder Technical Reportcited by 1,203
  9. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  10. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
  11. 2021Multimodal datasets: misogyny, pornography, and malignant stereotypescited by 327
  12. 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 266
6 more
  1. 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 206
  2. 2023Caption Anything: Interactive Image Description with Diverse Multimodal Controlscited by 99
  3. 2024Deep Multimodal Learning with Missing Modality: A Surveycited by 92
  4. 2024Diffusion Model for Planning: A Systematic Literature Reviewcited by 17
  5. 2023TTIDA: Controllable Generative Data Augmentation via Text-to-Text and Text-to-Image Modelscited by 14
  6. 2024DIAGen: Semantically Diverse Image Augmentation with Generative Models for Few-Shot Learningcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Are Text-to-Image Models Inductivist Turkeys? A Counterfactual Benchmark for Causal Reasoning
  2. 2026Unified Text-Image Generation with Weakness-Targeted Post-Training
  3. 2025Thinking with Generated Images
  4. 2025CRAFT: Continuous Reasoning and Agentic Feedback Tuning for Multimodal Text-to-Image Generation
  5. 2025Rethinking the Text-Vision Reasoning Imbalance in MLLMs through the Lens of Training Recipes
  6. 2026Evaluating Reasoning Fidelity in Visual Text Generation
  7. 2026LaViT: Aligning Latent Visual Thoughts for Multi-modal Reasoning
  8. 2025Beyond Words and Pixels: A Benchmark for Implicit World Knowledge Reasoning in Generative Models