mlsanityData to 14 Oct 2026

PorTEXTO: A European Portuguese Benchmark for Visual Text Extraction

arXiv 2606.19096 ↗First posted 17 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

European Portuguese (pt-PT) is largely absent from Optical Character Recognition (OCR) benchmarks, which skew toward high-resource languages. The few benchmarks that cover pt-PT focus on historical artifacts and literature. This work addresses modern OCR applications, introducing PorTEXTO, the first benchmark for contemporary and culturally relevant pt-PT visual text extraction. To ascertain quality, we employ an annotation pipeline combining transcriptions from a frontier LVLM with exhaustive review by native speakers. We observe a sharp performance drop from synthetic to real world samples in most models, and find that, currently, specialized multilingual data is a better driver for pt-PT performance than model size or resolution budget, motivating the release of open pt-PT OCR resources.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 37 references that are in the map. First posted on arXiv 17 Jun 2026.

Builds on

21 of 37 references.

References · 21

  1. 2019Towards VQA Models That Can Readcited by 1,718
  2. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  3. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  4. 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
  5. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
  6. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 466
  7. 2021InfographicVQAcited by 437
  8. 2021OCR-free Document Understanding Transformercited by 407
  9. 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Modelscited by 353
  10. 2019Scene Text Visual Question Answeringcited by 331
  11. 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 244
  12. 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotationscited by 150
9 more
  1. 2026Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Groundingcited by 139
  2. 2026Ministral 3cited by 114
  3. 2024MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answeringcited by 93
  4. 2025PerceptionLM: Open-Access Data and Models for Detailed Visual Understandingcited by 92
  5. 2024CC-OCR: A Comprehensive and Challenging OCR Benchmark for Evaluating Large Multimodal Models in Literacycited by 81
  6. 2026DeepSeek-OCR 2: Visual Causal Flowcited by 74
  7. 2024Encoder vs Decoder: Comparative Analysis of Encoder and Decoder Language Models on Multilingual NLU Taskscited by 34
  8. 2026STEP3-VL-10B Technical Reportcited by 32
  9. 2025Bee: A High-Quality Corpus and Full-Stack Suite to Unlock Advanced Fully Open MLLMscited by 27

Built on by

Not cited yet.