MeDocVL: A Visual Language Model for Medical Document Understanding and Parsing
On the map: Multimodal LLMs / vision-language models → Medical vision-language models
Abstract (arXiv)
Medical document OCR is challenging due to complex layouts, domain-specific terminology, and noisy annotations, while requiring strict field-level exact matching. Existing OCR systems and general-purpose vision-language models often fail to reliably parse such documents. We propose MeDocVL, a post-trained vision-language model for query-driven medical document parsing. Our framework combines Training-driven Label Refinement to construct high-quality supervision from noisy annotations, with a Noise-aware Hybrid Post-training strategy that integrates reinforcement learning and supervised fine-tuning to achieve robust and precise extraction. Experiments on medical invoice benchmarks show that MeDocVL consistently outperforms conventional OCR systems and strong VLM baselines, achieving state-of-the-art performance under noisy supervision.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 28 of its 33 references that are in the map. First posted on arXiv 6 Feb 2026.
Builds on
28 of 33 references.
References · 28
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2024Qwen2.5-Coder Technical Reportcited by 1,151
- 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 526
- 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 508
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
- 2021OCR-free Document Understanding Transformercited by 400
- 2023Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Modelscited by 356
- 2023Nougat: Neural Optical Understanding for Academic Documentscited by 240
- 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Modelscited by 209
16 more
- 2024General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Modelcited by 174
- 2024TextMonkey: An OCR-Free Large Multimodal Model for Understanding Documentcited by 173
- 2025olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language Modelscited by 120
- 2024mPLUG-DocOwl2: High-resolution Compressing for OCR-free Multi-page Document Understandingcited by 113
- 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 108
- 2022PP-OCRv3: More Attempts for the Improvement of Ultra Lightweight OCR Systemcited by 105
- 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 81
- 2021LayoutReader: Pre-training of Text and Layout for Reading Order Detectioncited by 79
- 2020Tabular Transformers for Modeling Multivariate Time Seriescited by 77
- 2024OmniParser: A Unified Framework for Text Spotting, Key Information Extraction and Table Recognitioncited by 74
- 2023SPTS v2: Single-Point Scene Text Spottingcited by 66
- 2025Docling: An Efficient Open-Source Toolkit for AI-driven Document Conversioncited by 58
- 2021SPTS: Single-Point Text Spottingcited by 45
- 2024UniMERNet: A Universal Network for Real-World Mathematical Expression Recognitioncited by 41
- 2024DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Language Modelscited by 34
- 2021PingAn-VCGroup's Solution for ICDAR 2021 Competition on Scientific Table Image Recognition to Latexcited by 10
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Dr. DocBench: A Comprehensive Benchmark for Expert-Level and Difficult Document Parsing
- 2026Towards Clinically Faithful Medical Image Captioning via Enhanced Vision-Language Alignment
- 2026DocOCR-Eval: A Correction-Based Framework for OCR Tool Selection Without Ground Truth
- 2023Multi-modal Pre-training for Medical Vision-language Understanding and Generation: An Empirical Study with A New Benchmark
- 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learning
- 2026A Hybrid Architecture for Multi-Stage Claim Document Understanding: Combining Vision-Language Models and Machine Learning for Real-Time Processing
- 2025MonkeyOCR v1.5 Technical Report: Unlocking Robust Document Parsing for Complex Patterns
- 2026MEDIC-AD: Towards Medical Vision-Language Model's Clinical Intelligence