mlsanityData to 14 Oct 2026

Reasoning-OCR: Can Large Multimodal Models Solve Complex Logical Reasoning Problems from OCR Cues?

arXiv 2505.12766 ↗First posted 19 May 2025cs.CVcited by 6

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Large Multimodal Models (LMMs) have become increasingly versatile, accompanied by impressive Optical Character Recognition (OCR) related capabilities. Existing OCR-related benchmarks emphasize evaluating LMMs' abilities of relatively simple visual question answering, visual-text parsing, etc. However, the extent to which LMMs can deal with complex logical reasoning problems based on OCR cues is relatively unexplored. To this end, we introduce the Reasoning-OCR benchmark, which challenges LMMs to solve complex reasoning problems based on the cues that can be extracted from rich visual-text. Reasoning-OCR covers six visual scenarios and encompasses 150 meticulously designed questions categorized into six reasoning challenges. Additionally, Reasoning-OCR minimizes the impact of field-specialized knowledge. Our evaluation offers some insights for proprietary and open-source LMMs in different reasoning challenges, underscoring the urgent to improve the reasoning performance. We hope Reasoning-OCR can inspire and facilitate future research on enhancing complex reasoning ability based on OCR cues. Reasoning-OCR is publicly available at https://github.com/Hxyz-123/ReasoningOCR.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 38 of its 41 references that are in the map. First posted on arXiv 19 May 2025.

Builds on

38 of 41 references.

Closest ancestors · 7

Same direction, newest first

  1. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
  2. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset22 Feb
  3. 2024ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoning19 Feb
  4. 2024ConTextual: Evaluating Context-Sensitive Text-Rich Visual Reasoning in Large Multimodal Models24 Jan
  5. 2023ChartBench: A Benchmark for Complex Visual Reasoning in Charts26 Dec
  6. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
  7. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning19 Mar

Other references · 31

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  3. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  4. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  5. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  6. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  7. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  8. 2019Towards VQA Models That Can Readcited by 1,718
  9. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  10. 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
  11. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
  12. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
19 more
  1. 2023Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Modelscited by 357
  2. 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 234
  3. 2021GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical Reasoningcited by 228
  4. 2024MMLongBench-Doc: Benchmarking Long-context Document Understanding with Visualizationscited by 183
  5. 2024General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Modelcited by 180
  6. 2024TextMonkey: An OCR-Free Large Multimodal Model for Understanding Documentcited by 174
  7. 2023MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuningcited by 150
  8. 2024SEED-Bench-2-Plus: Benchmarking Multimodal Large Language Models with Text-Rich Visual Comprehensioncited by 146
  9. 2023UReader: Universal OCR-free Visually-situated Language Understanding with Multimodal Large Language Modelcited by 143
  10. 2024mPLUG-DocOwl2: High-resolution Compressing for OCR-free Multi-page Document Understandingcited by 114
  11. 2024MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answeringcited by 93
  12. 2024CC-OCR: A Comprehensive and Challenging OCR Benchmark for Evaluating Large Multimodal Models in Literacycited by 81
  13. 2024If LLM Is the Wizard, Then Code Is the Wand: A Survey on How Code Empowers Large Language Models to Serve as Intelligent Agentscited by 79
  14. 2024MathGenie: Generating Synthetic Data with Question Back-translation for Enhancing Mathematical Reasoning of LLMscited by 72
  15. 2024Focus Anywhere for Fine-grained Multi-page Document Understandingcited by 62
  16. 2024OneChart: Purify the Chart Structural Extraction via One Auxiliary Tokencited by 39
  17. 2024MathCoder2: Better Math Reasoning from Continued Pretraining on Model-translated Mathematical Codecited by 39
  18. 2024Unveiling the Impact of Coding Data Instruction Fine-Tuning on Large Language Models Reasoningcited by 31
  19. 2024Exploring the Capabilities of Large Multimodal Models on Dense Textcited by 14

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 4.

6 papers.

  1. 2025Multimodal Reasoning for Science: Technical Report and 1st Place Solution to the ICML 2025 SeePhys Challengecited by 6
  2. 2025CapGeo-Bench: Decoupling Visual Perception from Reasoning and Evaluating Geometric Understandingcited by 5
  3. 2026OmniOCR: Generalist OCR for Ethnic Minority Languagescited by 2
  4. 2026GlotOCR Bench: OCR Models Still Struggle Beyond a Handful of Unicode Scriptscited by 2
  5. 2026OCR-MetaReasoning Benchmark: Evaluating the Meta-Reasoning Ability of MLLMs in Text-Rich Image Understandingcited by 0
  6. 2026InterTab: Interleaved Visual-Structure Alignment for Multi-Modal Table Reasoningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025OCR-Reasoning Benchmark: Unveiling the True Capabilities of MLLMs in Complex Text-Rich Image Reasoning
  2. 2025LogicOCR: Do Your Large Multimodal Models Excel at Logical Reasoning on Text-Rich Images?
  3. 2026Beyond Blind Compliance: Benchmarking Task Verification in OCR Reasoning
  4. 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoning
  5. 2025VMMU: A Vietnamese Multitask Multimodal Understanding and Reasoning Benchmark
  6. 2026ICDAR2026 Competition on Multimodal Reasoning over Documents in Multiple Domains
  7. 2026How Robust is OCR-Reasoning? Evaluating OCR-Reasoning Robustness of Vision-Language Models under Visual Perturbations
  8. 2025Context-Independent OCR with Multimodal LLMs: Effects of Image Resolution and Visual Complexity