Baseer: A Vision-Language Model for Arabic Document-to-Markdown OCR
On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG
Abstract (arXiv)
Arabic document OCR remains a challenging task due to the language's cursive script, diverse fonts, diacritics, and right-to-left orientation. While modern Multimodal Large Language Models (MLLMs) have advanced document understanding for high-resource languages, their performance on Arabic remains limited. In this work, we introduce Baseer, a vision-language model fine-tuned specifically for Arabic document OCR. Leveraging a large-scale dataset combining synthetic and real-world documents, Baseer is trained using a decoder-only fine-tuning strategy to adapt a pre-trained MLLM while preserving general visual features. We also present Misraj-DocOCR, a high-quality, expert-verified benchmark designed for rigorous evaluation of Arabic OCR systems. Our experiments show that Baseer significantly outperforms existing open-source and commercial solutions, achieving a WER of 0.25 and establishing a new state-of-the-art in the domain of Arabic document OCR. Our results highlight the benefits of domain-specific adaptation of general-purpose MLLMs and establish a strong baseline for high-accuracy OCR on morphologically rich languages like Arabic.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 18 of its 24 references that are in the map. First posted on arXiv 17 Sep 2025.
Builds on
18 of 24 references.
Closest ancestors · 1
Same direction, newest first
- 2025SmolDocling: An ultra-compact vision-language model for end-to-end multi-modal document conversion14 Mar
Other references · 17
- 2023Visual Instruction Tuningcited by 7,869
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2025Gemma 3 Technical Reportcited by 1,824
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
- 2024What matters when building vision-language models?cited by 326
- 2025SmolVLM: Redefining small and efficient multimodal modelscited by 237
- 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 207
5 more
- 2024Building and better understanding vision-language models: insights and future directionscited by 173
- 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 87
- 2025Aya Vision: Advancing the Frontier of Multilingual Multimodalitycited by 33
- 2025KITAB-Bench: A Comprehensive Multi-Domain Benchmark for Arabic OCR and Document Understandingcited by 15
- 2025QARI-OCR: High-Fidelity Arabic Text Recognition through Multimodal Large Language Model Adaptationcited by 5
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2026Anthropogenic Regional Adaptation in Multimodal Vision-Language Modelcited by 2
- 2025Wasm: A Pipeline for Constructing Structured Arabic Interleaved Multimodal Corporacited by 0
- 2026Beyond Recognition: Compact Multi-Domain Arabic Manuscript HTR with Candidate-Selection Analysis and Evidence-Preserving Reviewcited by 0
- 2026When Do VLMs Help Arabic Manuscript OCR? A Cross-Dataset Studycited by 0
- 2026When Do VLMs Help Arabic Manuscript OCR? A Cross-Dataset Study23 Aug 2026
- 2026Beyond Recognition: Compact Multi-Domain Arabic Manuscript HTR with Candidate-Selection Analysis and Evidence-Preserving Review19 Aug 2026
- 2026Anthropogenic Regional Adaptation in Multimodal Vision-Language Model13 Apr 2026
- 2025Wasm: A Pipeline for Constructing Structured Arabic Interleaved Multimodal Corpora10 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026AtlasOCR: Building the First Open-Source Darija OCR Model with Vision Language Models
- 2025SARD: A Large-Scale Synthetic Arabic OCR Dataset for Book-Style Text Recognition
- 2026KazakhOCR: A Synthetic Benchmark for Evaluating Multimodal Models in Low-Resource Kazakh Script OCR
- 2026RefLAM: A Reference-Grounded Line Annotation Pipeline for Historical Arabic Manuscripts
- 2026LightOnOCR: A 1B End-to-End Multilingual Vision-Language Model for State-of-the-Art OCR
- 2026GlotOCR Bench: OCR Models Still Struggle Beyond a Handful of Unicode Scripts
- 2026Do VLMs Read or Rewrite? On Transcription Faithfulness in Vision-Language Models
- 2026Multilingual OCR-Aware Fine-Tuning and Prompt-Guided Chain-of-Thought Reasoning for Multimodal Large Language Models