See the Text: From Tokenization to Visual Reading
Not on the map. Why?
Abstract (arXiv)
People see text. Humans read by recognizing words as visual objects, including their shapes, layouts, and patterns, before connecting them to meaning, which enables us to handle typos, distorted fonts, and various scripts effectively. Modern large language models (LLMs), however, rely on subword tokenization, fragmenting text into pieces from a fixed vocabulary. While effective for high-resource languages, this approach over-segments low-resource languages, yielding long, linguistically meaningless sequences and inflating computation. In this work, we challenge this entrenched paradigm and move toward a vision-centric alternative. Our method, SeeTok, renders text as images (visual-text) and leverages pretrained multimodal LLMs to interpret them, reusing strong OCR and text-vision alignment abilities learned from large-scale multimodal training. Across three different language tasks, SeeTok matches or surpasses subword tokenizers while requiring 4.43 times fewer tokens and reducing FLOPs by 70.5%, with additional gains in cross-lingual generalization, robustness to typographic noise, and linguistic hierarchy. SeeTok signals a shift from symbolic tokenization to human-like visual reading, and takes a step toward more natural and cognitively inspired language models.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 41 of its 66 references that are in the map. First posted on arXiv 21 Oct 2025.
Builds on
41 of 66 references.
References · 41
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023Qwen Technical Reportcited by 3,273
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
- 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,203
- 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,103
29 more
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2018Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidatescited by 632
- 2024TinyLlama: An Open-Source Small Language Modelcited by 604
- 2021ByT5: Towards a token-free future with pre-trained byte-to-byte modelscited by 504
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 466
- 2020How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Modelscited by 313
- 2023MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformerscited by 164
- 2021VisualMRC: Machine Reading Comprehension on Document Imagescited by 150
- 2024Byte Latent Transformer: Patches Scale Better Than Tokenscited by 137
- 2019Neural Machine Translation with Byte-Level Subwordscited by 115
- 2023Tokenizer Choice For LLM Training: Negligible or Crucial?cited by 105
- 2019Text Processing Like Humans Do: Visually Attacking and Shielding NLP Systemscited by 99
- 2023A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Modelscited by 88
- 2024Long-Context Language Modeling with Parallel Context Encodingcited by 84
- 2023Tokenization Impacts Multilingual Language Modeling: Assessing Vocabulary Allocation and Overlap Across Languagescited by 61
- 2022Language Modelling with Pixelscited by 53
- 2022CLIPPO: Image-and-Language Understanding from Pixels Onlycited by 53
- 2024Math-PUMA: Progressive Upward Multimodal Alignment to Enhance Mathematical Reasoningcited by 52
- 2024X-ALMA: Plug & Play Modules and Adaptive Rejection for Quality Translation at Scalecited by 36
- 2022The SIGMORPHON 2022 Shared Task on Morpheme Segmentationcited by 25
- 2023Text Rendering Strategies for Pixel Language Modelscited by 22
- 2025Vision-centric Token Compression in Large Language Modelcited by 21
- 2024Tokenization Falling Short: On Subword Robustness in Large Language Modelscited by 18
- 2024Leveraging Visual Tokens for Extended Text Contexts in Multi-Modal Learningcited by 17
- 2024Cross-Modal Consistency in Multimodal Large Language Modelscited by 17
- 2023Parrot Captions Teach CLIP to Spot Textcited by 16
- 2024Improving Language Understanding from Screenshotscited by 14
- 2025Overcoming Vocabulary Constraints with Pixel-level Fallbackcited by 6
- 2025Understanding Subword Compositionality of Large Language Modelscited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 8.
9 papers.
- 2025Thinking with Video: Video Generation as a Promising Multimodal Reasoning Paradigmcited by 41
- 2026VTC-R1: Vision-Text Compression for Efficient Long-Context Reasoningcited by 8
- 2026VISTA-Bench: Do Vision-Language Models Really Understand Visualized Text as Well as Pure Text?cited by 8
- 2026Reading, Not Thinking: Understanding and Bridging the Modality Gap When Text Becomes Pixels in Multimodal LLMscited by 6
- 2026When Text-as-Vision Meets Semantic IDs in Generative Recommendation: An Empirical Studycited by 3
- 2026Structured Observation Language for Efficient and Generalizable Vision-Language Navigationcited by 3
- 2026Decoupling semantics from vision: A framework for faithful visual-text compression evaluationcited by 2
- 2026Reading is not Reasoning: Bridging the Agentic Policy Gap in Vision-Text Compressioncited by 1
- 2026How to Utilize Complementary Vision-Text Information for 2D Structure Understandingcited by 0
- 2026Reading is not Reasoning: Bridging the Agentic Policy Gap in Vision-Text Compression9 Aug 2026
- 2026Decoupling semantics from vision: A framework for faithful visual-text compression evaluation3 Aug 2026
- 2026Structured Observation Language for Efficient and Generalizable Vision-Language Navigation29 Mar 2026
- 2026How to Utilize Complementary Vision-Text Information for 2D Structure Understanding17 Mar 2026
- 2026Reading, Not Thinking: Understanding and Bridging the Modality Gap When Text Becomes Pixels in Multimodal LLMs10 Mar 2026
- 2026VISTA-Bench: Do Vision-Language Models Really Understand Visualized Text as Well as Pure Text?4 Feb 2026
- 2026VTC-R1: Vision-Text Compression for Efficient Long-Context Reasoning29 Jan 2026
- 2026When Text-as-Vision Meets Semantic IDs in Generative Recommendation: An Empirical Study21 Jan 2026
- 2025Thinking with Video: Video Generation as a Promising Multimodal Reasoning Paradigm6 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2023What You See is What You Read? Improving Text-Image Alignment Evaluation
- 2026Reading neq Seeing: Diagnosing and Closing the Typography Gap in Vision-Language Models
- 2025ReadBench: Measuring the Dense Text Visual Reading Ability of Vision-Language Models
- 2023Learning the Visualness of Text Using Large Vision-Language Models
- 2025Visual Text Processing: A Comprehensive Review and Unified Evaluation
- 2025Text Speaks Louder than Vision: ASCII Art Reveals Textual Biases in Vision-Language Models
- 2023Planting a SEED of Vision in Large Language Model
- 2025Words or Vision: Do Vision-Language Models Have Blind Faith in Text?