mlsanityData to 14 Oct 2026

Unlocking the Latent Canvas: Eliciting and Benchmarking Symbolic Visual Expression in LLMs

arXiv 2603.14505 ↗First posted 15 Mar 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Current multimodal approaches predominantly treat visual generation as an external process, relying on pixel rendering or code execution, thereby overlooking the native visual representation capabilities latent within Large Language Models (LLMs). In this work, we unlock this potential through ASCII art, a compact, efficient, and text-native visual format. We introduce SVE-ASCII, a unified framework designed to elicit and benchmark Symbolic Visual Expression directly within the pure text space. To address the scarcity of systematic resources, we construct ASCIIArt-7K, a high-quality dataset synthesized via a novel "Seed-and-Evolve" pipeline that augments human-curated anchors through in-context stylistic editing. We further implement a unified instruction-tuning strategy that jointly optimizes for both Generation (Text-to-ASCII) and Understanding (ASCII-to-Text). Crucially, our experiments reveal a critical phenomenon regarding task duality: while it is established that perception aids generation, we provide compelling evidence that generative training significantly enhances visual comprehension. This confirms a mutually reinforcing cycle in symbolic visual processing, a relationship previously hypothesized but rarely empirically demonstrated in the visual domain. We release our dataset, the ASCIIArt-Bench benchmark, and the SVE-ASCII model, establishing a robust baseline for native text-based visual intelligence.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 27 of its 36 references that are in the map. First posted on arXiv 15 Mar 2026.

Builds on

27 of 36 references.

References · 27

  1. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  2. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  3. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  4. 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,310
  5. 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 906
  6. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
  7. 2022PaLI: A Jointly-Scaled Multilingual Language-Image Modelcited by 766
  8. 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 668
  9. 2023ViperGPT: Visual Inference via Python Execution for Reasoningcited by 603
  10. 2023Your Diffusion Model is Secretly a Zero-Shot Classifiercited by 306
  11. 2023Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Actioncited by 302
  12. 2023Generating Images with Multimodal Language Modelscited by 260
15 more
  1. 2023StableRep: Synthetic Images from Text-to-Image Models Make Strong Visual Representation Learnerscited by 177
  2. 2020DeepSVG: A Hierarchical Generative Network for Vector Graphics Animationcited by 159
  3. 2023StarVector: Generating Scalable Vector Graphics Code from Images and Textcited by 102
  4. 2023IconShop: Text-Guided Vector Icon Synthesis with Autoregressive Transformerscited by 75
  5. 2025OmniSVG: A Unified Scalable Vector Graphics Generation Modelcited by 74
  6. 2025LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformercited by 43
  7. 2024Chat2SVG: Vector Graphics Generation with Large Language Models and Image Diffusion Modelscited by 38
  8. 2022CLIPVG: Text-Guided Image Manipulation Using Differentiable Vector Graphicscited by 34
  9. 2023I Spy a Metaphor: Large Language Models and Diffusion Models Co-Create Visual Metaphorscited by 31
  10. 2025Sketch-in-Latents: Eliciting Unified Reasoning in MLLMscited by 25
  11. 2024AI Governance and Accountability: An Analysis of Anthropic's Claudecited by 14
  12. 2025ASCIIBench: Evaluating Language-Model-Based Understanding of Visually-Oriented Textcited by 4
  13. 2026SIGMA: Selective-Interleaved Generation with Multi-Attribute Tokenscited by 2
  14. 2025Evaluating Machine Learning Approaches for ASCII Art Generationcited by 1
  15. 2025How Large Language Models Need Symbolismcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.