SEA-Vision: A Multilingual Benchmark for Comprehensive Document and Scene Text Understanding in Southeast Asia
Not on the map. Why?
Abstract (arXiv)
Multilingual document and scene text understanding plays an important role in applications such as search, finance, and public services. However, most existing benchmarks focus on high-resource languages and fail to evaluate models in realistic multilingual environments. In Southeast Asia, the diversity of languages, complex writing systems, and highly varied document types make this challenge even greater. We introduce SEA-Vision, a benchmark that jointly evaluates Document Parsing and Text-Centric Visual Question Answering (TEC-VQA) across 11 Southeast Asian languages. SEA-Vision contains 15,234 document parsing pages from nine representative document types, annotated with hierarchical page-, block-, and line-level labels. It also provides 7,496 TEC-VQA question-answer pairs that probe text recognition, numerical calculation, comparative analysis, logical reasoning, and spatial understanding. To make such multilingual, multi-task annotation feasible, we design a hybrid pipeline for Document Parsing and TEC-VQA. It combines automated filtering and scoring with MLLM-assisted labeling and lightweight native-speaker verification, greatly reducing manual labeling while maintaining high quality. We evaluate several leading multimodal models and observe pronounced performance degradation on low-resource Southeast Asian languages, highlighting substantial remaining gaps in multilingual document and scene text understanding. We believe SEA-Vision will help drive global progress in document and scene text understanding.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 55 of its 65 references that are in the map. First posted on arXiv 16 Mar 2026.
Builds on
55 of 65 references.
References · 55
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2015VQA: Visual Question Answeringcited by 2,489
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2019Towards VQA Models That Can Readcited by 1,696
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
38 more
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 466
- 2021InfographicVQAcited by 430
- 2020TabTransformer: Tabular Data Modeling Using Contextual Embeddingscited by 398
- 2019Scene Text Visual Question Answeringcited by 327
- 2023LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understandingcited by 272
- 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 255
- 2019Image-based table recognition: data, model, and evaluationcited by 233
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
- 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipecited by 174
- 2025DeepSeek-OCR: Contexts Optical Compressioncited by 174
- 2024TextMonkey: An OCR-Free Large Multimodal Model for Understanding Documentcited by 173
- 2020ABCNet: Real-time Scene Text Spotting with Adaptive Bezier-Curve Networkcited by 170
- 2023mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understandingcited by 167
- 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 165
- 2020DocBank: A Benchmark Dataset for Document Layout Analysiscited by 152
- 2022DocLayNet: A Large Human-Annotated Dataset for Document-Layout Analysiscited by 146
- 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotationscited by 144
- 2019ICDAR2019 Robust Reading Challenge on Multi-lingual Scene Text Detection and Recognition -- RRC-MLT-2019cited by 138
- 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 108
- 2023DocPedia: Unleashing the Power of Large Multimodal Model in the Frequency Domain for Versatile Document Understandingcited by 106
- 2022PP-OCRv3: More Attempts for the Improvement of Ultra Lightweight OCR Systemcited by 105
- 2024MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answeringcited by 93
- 2022Unified Pretraining Framework for Document Understandingcited by 85
- 2025PaddleOCR-VL: Boosting Multilingual Document Parsing via a 0.9B Ultra-Compact Vision-Language Modelcited by 84
- 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 81
- 2024DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perceptioncited by 80
- 2024CC-OCR: A Comprehensive and Challenging OCR Benchmark for Evaluating Large Multimodal Models in Literacycited by 80
- 2021LayoutReader: Pre-training of Text and Layout for Reading Order Detectioncited by 79
- 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 78
- 2023UniDoc: A Universal Large Multimodal Model for Simultaneous Text Detection, Recognition, Spotting and Understandingcited by 74
- 2022SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognitioncited by 70
- 2022XYLayoutLM: Towards Layout-Aware Multimodal Networks For Visually-Rich Document Understandingcited by 68
- 2024Focus Anywhere for Fine-grained Multi-page Document Understandingcited by 62
- 2024Harmonizing Visual Text Comprehension and Generationcited by 54
- 2021PGNet: Real-time Arbitrarily-Shaped Text Spotting with Point Gathering Networkcited by 49
- 2025dots.ocr: Multilingual Document Layout Parsing in a Single Vision-Language Modelcited by 44
- 2023Improving Table Structure Recognition with Visual-Alignment Sequential Coordinate Modelingcited by 41
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026How Far Can Synthetic Data Take Thai OCR?cited by 0
- 2026How Far Can Synthetic Data Take Thai OCR?3 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2025VisR-Bench: An Empirical Study on Visual Retrieval-Augmented Generation for Multilingual Long Document Understanding
- 2026INDOTABVQA: A Benchmark for Cross-Lingual Table Understanding in Bahasa Indonesia Documents
- 2025Rice-VL: Evaluating Vision-Language Models for Cultural Understanding Across ASEAN Countries
- 2025HW-MLVQA: Elucidating Multilingual Handwritten Document Understanding with a Comprehensive VQA Benchmark
- 2026JaWildText: A Benchmark for Vision-Language Models on Japanese Scene Text Understanding
- 2024Cross-Lingual Text-Rich Visual Comprehension: An Information Theory Perspective
- 2025DRISHTIKON: Visual Grounding at Multiple Granularities in Documents
- 2025M4-RAG: A Massive-Scale Multilingual Multi-Cultural Multimodal RAG