mlsanityData to 7 Oct 2026

See the Text: From Tokenization to Visual Reading

arXiv 2510.18840 ↗First posted 21 Oct 2025cs.CV cs.CLcited by 9

Not on the map. Why?

Abstract (arXiv)

People see text. Humans read by recognizing words as visual objects, including their shapes, layouts, and patterns, before connecting them to meaning, which enables us to handle typos, distorted fonts, and various scripts effectively. Modern large language models (LLMs), however, rely on subword tokenization, fragmenting text into pieces from a fixed vocabulary. While effective for high-resource languages, this approach over-segments low-resource languages, yielding long, linguistically meaningless sequences and inflating computation. In this work, we challenge this entrenched paradigm and move toward a vision-centric alternative. Our method, SeeTok, renders text as images (visual-text) and leverages pretrained multimodal LLMs to interpret them, reusing strong OCR and text-vision alignment abilities learned from large-scale multimodal training. Across three different language tasks, SeeTok matches or surpasses subword tokenizers while requiring 4.43 times fewer tokens and reducing FLOPs by 70.5%, with additional gains in cross-lingual generalization, robustness to typographic noise, and linguistic hierarchy. SeeTok signals a shift from symbolic tokenization to human-like visual reading, and takes a step toward more natural and cognitively inspired language models.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 41 of its 66 references that are in the map. First posted on arXiv 21 Oct 2025.

Builds on

41 of 66 references.

References · 41

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  4. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  5. 2025Qwen2.5-VL Technical Reportcited by 5,418
  6. 2023Qwen Technical Reportcited by 3,273
  7. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  8. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  9. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  10. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
  11. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,203
  12. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,103
29 more
  1. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
  2. 2018Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidatescited by 632
  3. 2024TinyLlama: An Open-Source Small Language Modelcited by 604
  4. 2021ByT5: Towards a token-free future with pre-trained byte-to-byte modelscited by 504
  5. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 466
  6. 2020How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Modelscited by 313
  7. 2023MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformerscited by 164
  8. 2021VisualMRC: Machine Reading Comprehension on Document Imagescited by 150
  9. 2024Byte Latent Transformer: Patches Scale Better Than Tokenscited by 137
  10. 2019Neural Machine Translation with Byte-Level Subwordscited by 115
  11. 2023Tokenizer Choice For LLM Training: Negligible or Crucial?cited by 105
  12. 2019Text Processing Like Humans Do: Visually Attacking and Shielding NLP Systemscited by 99
  13. 2023A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Modelscited by 88
  14. 2024Long-Context Language Modeling with Parallel Context Encodingcited by 84
  15. 2023Tokenization Impacts Multilingual Language Modeling: Assessing Vocabulary Allocation and Overlap Across Languagescited by 61
  16. 2022Language Modelling with Pixelscited by 53
  17. 2022CLIPPO: Image-and-Language Understanding from Pixels Onlycited by 53
  18. 2024Math-PUMA: Progressive Upward Multimodal Alignment to Enhance Mathematical Reasoningcited by 52
  19. 2024X-ALMA: Plug & Play Modules and Adaptive Rejection for Quality Translation at Scalecited by 36
  20. 2022The SIGMORPHON 2022 Shared Task on Morpheme Segmentationcited by 25
  21. 2023Text Rendering Strategies for Pixel Language Modelscited by 22
  22. 2025Vision-centric Token Compression in Large Language Modelcited by 21
  23. 2024Tokenization Falling Short: On Subword Robustness in Large Language Modelscited by 18
  24. 2024Leveraging Visual Tokens for Extended Text Contexts in Multi-Modal Learningcited by 17
  25. 2024Cross-Modal Consistency in Multimodal Large Language Modelscited by 17
  26. 2023Parrot Captions Teach CLIP to Spot Textcited by 16
  27. 2024Improving Language Understanding from Screenshotscited by 14
  28. 2025Overcoming Vocabulary Constraints with Pixel-level Fallbackcited by 6
  29. 2025Understanding Subword Compositionality of Large Language Modelscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 8.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023What You See is What You Read? Improving Text-Image Alignment Evaluation
  2. 2026Reading neq Seeing: Diagnosing and Closing the Typography Gap in Vision-Language Models
  3. 2025ReadBench: Measuring the Dense Text Visual Reading Ability of Vision-Language Models
  4. 2023Learning the Visualness of Text Using Large Vision-Language Models
  5. 2025Visual Text Processing: A Comprehensive Review and Unified Evaluation
  6. 2025Text Speaks Louder than Vision: ASCII Art Reveals Textual Biases in Vision-Language Models
  7. 2023Planting a SEED of Vision in Large Language Model
  8. 2025Words or Vision: Do Vision-Language Models Have Blind Faith in Text?