mlsanityData to 14 Oct 2026

Baseer: A Vision-Language Model for Arabic Document-to-Markdown OCR

arXiv 2509.18174 ↗First posted 17 Sep 2025cs.CV cs.CLcited by 4

On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG

Abstract (arXiv)

Arabic document OCR remains a challenging task due to the language's cursive script, diverse fonts, diacritics, and right-to-left orientation. While modern Multimodal Large Language Models (MLLMs) have advanced document understanding for high-resource languages, their performance on Arabic remains limited. In this work, we introduce Baseer, a vision-language model fine-tuned specifically for Arabic document OCR. Leveraging a large-scale dataset combining synthetic and real-world documents, Baseer is trained using a decoder-only fine-tuning strategy to adapt a pre-trained MLLM while preserving general visual features. We also present Misraj-DocOCR, a high-quality, expert-verified benchmark designed for rigorous evaluation of Arabic OCR systems. Our experiments show that Baseer significantly outperforms existing open-source and commercial solutions, achieving a WER of 0.25 and establishing a new state-of-the-art in the domain of Arabic document OCR. Our results highlight the benefits of domain-specific adaptation of general-purpose MLLMs and establish a strong baseline for high-accuracy OCR on morphologically rich languages like Arabic.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 18 of its 24 references that are in the map. First posted on arXiv 17 Sep 2025.

Builds on

18 of 24 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025SmolDocling: An ultra-compact vision-language model for end-to-end multi-modal document conversion14 Mar

Other references · 17

  1. 2023Visual Instruction Tuningcited by 7,869
  2. 2025Qwen2.5-VL Technical Reportcited by 5,587
  3. 2024GPT-4o System Cardcited by 4,588
  4. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  6. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  7. 2025Gemma 3 Technical Reportcited by 1,824
  8. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  9. 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
  10. 2024What matters when building vision-language models?cited by 326
  11. 2025SmolVLM: Redefining small and efficient multimodal modelscited by 237
  12. 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 207
5 more
  1. 2024Building and better understanding vision-language models: insights and future directionscited by 173
  2. 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 87
  3. 2025Aya Vision: Advancing the Frontier of Multilingual Multimodalitycited by 33
  4. 2025KITAB-Bench: A Comprehensive Multi-Domain Benchmark for Arabic OCR and Document Understandingcited by 15
  5. 2025QARI-OCR: High-Fidelity Arabic Text Recognition through Multimodal Large Language Model Adaptationcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026AtlasOCR: Building the First Open-Source Darija OCR Model with Vision Language Models
  2. 2025SARD: A Large-Scale Synthetic Arabic OCR Dataset for Book-Style Text Recognition
  3. 2026KazakhOCR: A Synthetic Benchmark for Evaluating Multimodal Models in Low-Resource Kazakh Script OCR
  4. 2026RefLAM: A Reference-Grounded Line Annotation Pipeline for Historical Arabic Manuscripts
  5. 2026LightOnOCR: A 1B End-to-End Multilingual Vision-Language Model for State-of-the-Art OCR
  6. 2026GlotOCR Bench: OCR Models Still Struggle Beyond a Handful of Unicode Scripts
  7. 2026Do VLMs Read or Rewrite? On Transcription Faithfulness in Vision-Language Models
  8. 2026Multilingual OCR-Aware Fine-Tuning and Prompt-Guided Chain-of-Thought Reasoning for Multimodal Large Language Models