mlsanityData to 7 Oct 2026

Q-Mask: Query-driven Causal Masks for Text Anchoring in OCR-Oriented Vision-Language Models

arXiv 2604.00161 ↗First posted 31 Mar 2026cs.CVcited by 1

On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG

Abstract (arXiv)

Optical Character Recognition (OCR) is increasingly regarded as a foundational capability for modern vision-language models (VLMs), enabling them not only to read text in images but also to support downstream reasoning in real-world visual question answering (VQA). However, practical applications further require reliable text anchors, i.e., accurately grounding queried text to its corresponding spatial region. To systematically evaluate this capability, we introduce TextAnchor-Bench (TABench), a benchmark for fine-grained text-region grounding, which reveals that both general-purpose and OCR-specific VLMs still struggle to establish accurate and stable text anchors. To address this limitation, we propose Q-Mask, a precise OCR framework built upon a causal query-driven mask decoder (CQMD). Inspired by chain-of-thought reasoning, Q-Mask performs causal visual decoding that sequentially generates query-conditioned visual masks before producing the final OCR output. This visual CoT paradigm disentangles where the text is from what the text is, enforcing grounded evidence acquisition prior to recognition and enabling explicit text anchor construction during inference. To train CQMD, we construct TextAnchor-26M, a large-scale dataset of image-text pairs annotated with fine-grained masks corresponding to specific textual elements, encouraging stable text-region correspondences and injecting strong spatial priors into VLM training. Extensive experiments demonstrate that Q-Mask substantially improves text anchoring and understanding across diverse visual scenes.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 83 of its 107 references that are in the map. First posted on arXiv 31 Mar 2026.

Builds on

83 of 107 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025HunyuanOCR Technical Report24 Nov
  2. 2025PaddleOCR-VL: Boosting Multilingual Document Parsing via a 0.9B Ultra-Compact Vision-Language Model16 Oct
  3. 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing26 Sep
  4. 2025SmolDocling: An ultra-compact vision-language model for end-to-end multi-modal document conversion14 Mar
  5. 2025A Token-level Text Image Foundation Model for Document Understanding4 Mar
  6. 2024DocKylin: A Large Multimodal Model for Visual Document Understanding with Efficient Visual Slimming27 Jun
  7. 2024TextMonkey: An OCR-Free Large Multimodal Model for Understanding Document7 Mar
  8. 2022Language Matters: A Weakly Supervised Vision-Language Pre-training Approach for Scene Text Detection and Spotting8 Mar

Other references · 75

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2024The Llama 3 Herd of Modelscited by 14,192
  4. 2023Segment Anythingcited by 8,158
  5. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  6. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  7. 2025Qwen3-VL Technical Reportcited by 2,534
  8. 2019Towards VQA Models That Can Readcited by 1,696
  9. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
  10. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  11. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
  12. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 552
38 more
  1. 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
  2. 2021InfographicVQAcited by 430
  3. 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 402
  4. 2021OCR-free Document Understanding Transformercited by 400
  5. 2023Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Modelscited by 356
  6. 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 347
  7. 2019FUNSD: A Dataset for Form Understanding in Noisy Scanned Documentscited by 345
  8. 2018DVQA: Understanding Data Visualizations via Question Answeringcited by 338
  9. 2019Scene Text Visual Question Answeringcited by 327
  10. 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 321
  11. 2019PlotQA: Reasoning over Scientific Plotscited by 317
  12. 2017FigureQA: An Annotated Figure Dataset for Visual Reasoningcited by 314
  13. 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 255
  14. 2021ICDAR2019 Competition on Scanned Receipt OCR and Information Extractioncited by 254
  15. 2016COCO-Text: Dataset and Benchmark for Text Detection and Recognition in Natural Imagescited by 235
  16. 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
  17. 2024mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understandingcited by 220
  18. 2025DeepSeek-OCR: Contexts Optical Compressioncited by 174
  19. 2022Chart-to-Text: A Large-Scale Benchmark for Chart Summarizationcited by 166
  20. 2023UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoningcited by 158
  21. 2021VisualMRC: Machine Reading Comprehension on Document Imagescited by 150
  22. 2023MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuningcited by 149
  23. 2019ICDAR2019 Robust Reading Challenge on Arbitrary-Shaped Text (RRC-ArT)cited by 147
  24. 2020Global Table Extractor (GTE): A Framework for Joint Table Identification and Cell Structure Recognition Using Visual Contextcited by 146
  25. 2024Multimodal ArXiv: A Dataset for Improving Scientific Comprehension of Large Vision-Language Modelscited by 138
  26. 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 136
  27. 2025PaddleOCR 3.0 Technical Reportcited by 136
  28. 2019ICDAR 2019 Robust Reading Challenge on Reading Chinese Text on Signboardcited by 127
  29. 2019ICDAR 2019 Competition on Large-scale Street View Text with Partial Labeling -- RRC-LSVTcited by 121
  30. 2021HiTab: A Hierarchical Table Dataset for Question Answering and Natural Language Generationcited by 117
  31. 2022Wukong: A 100 Million Large-scale Chinese Cross-modal Pre-training Benchmarkcited by 114
  32. 2024mPLUG-DocOwl2: High-resolution Compressing for OCR-free Multi-page Document Understandingcited by 113
  33. 2023VisText: A Benchmark for Semantically Rich Chart Captioningcited by 111
  34. 2017ICDAR2017 Competition on Reading Chinese Text in the Wild (RCTW-17)cited by 103
  35. 2021WebSRC: A Dataset for Web-Based Structural Reading Comprehensioncited by 98
  36. 2022Towards End-to-End Unified Scene Text Detection and Layout Analysiscited by 96
  37. 2024MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answeringcited by 93
  38. 2019Complicated Table Structure Recognitioncited by 91

50 most cited of 75 All 75 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025DianJin-OCR-R1: Enhancing OCR Capabilities via a Reasoning-and-Tool Interleaved Vision-Language Model
  2. 2026Beyond OCR Accuracy: Text-Centric VQA Under Image Degradation with Modular and End-to-End
  3. 2026Where Vision Becomes Text: Locating the OCR Routing Bottleneck in Vision-Language Models
  4. 2024TAP-VL: Text Layout-Aware Pre-training for Enriched Vision-Language Models
  5. 2026From Retrieval to Recognition:How Vision--Language Models Become OCR Specialists
  6. 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoning
  7. 2026OCR-MetaReasoning Benchmark: Evaluating the Meta-Reasoning Ability of MLLMs in Text-Rich Image Understanding
  8. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond