mlsanityData to 14 Oct 2026

Simple Vision-Language Math Reasoning via Rendered Text

arXiv 2511.11704 ↗First posted 12 Nov 2025cs.LG cs.CVcited by 1

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

We present a lightweight yet effective pipeline for training vision-language models to solve math problems by rendering LaTeX encoded equations into images and pairing them with structured chain-of-thought prompts. This simple text-to-vision augmentation enables compact multimodal architectures to achieve state-of-the-art reasoning accuracy. Through systematic ablations, we find that rendering fidelity and prompt design are the primary drivers of performance. Despite its simplicity, our approach consistently matches or surpasses both open-source and proprietary math-focused vision-language solvers on widely used benchmarks, while preserving broad general-domain competence - showing gains on tasks such as MMMU, ChartQA, and DocVQA of up to 20%.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 34 of its 39 references that are in the map. First posted on arXiv 12 Nov 2025.

Builds on

34 of 39 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025Multimodal Chain of Continuous Thought for Latent-Space Reasoning in Vision-Language Models18 Aug
  2. 2025Advancing Multimodal Reasoning: From Optimized Cold Start to Staged Reinforcement Learning4 Jun
  3. 2025OpenThinkIMG: Learning to Think with Images via Visual Tool Reinforcement Learning13 May
  4. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  5. 2024DynaMath: A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Models29 Oct
  6. 2024MultiMath: Bridging Visual and Mathematical Reasoning for Large Language Models30 Aug
  7. 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contexts6 Jul
  8. 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?1 Jul
  9. 2024Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models25 Jun
  10. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset22 Feb
  11. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
  12. 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb
1 more
  1. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning19 Mar

Other references · 21

  1. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  2. 2024Qwen2.5 Technical Reportcited by 4,942
  3. 2022A ConvNet for the 2020scited by 3,579
  4. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  5. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  6. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  7. 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,005
  8. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
  9. 2024DeepSeek-V3 Technical Reportcited by 811
  10. 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instructcited by 625
  11. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
  12. 2021InfographicVQAcited by 437
9 more
  1. 2020TextCaps: a Dataset for Image Captioning with Reading Comprehensioncited by 400
  2. 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Modelscited by 353
  3. 2023LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understandingcited by 274
  4. 2021GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical Reasoningcited by 228
  5. 2023G-LLaVA: Solving Geometric Problem with Multi-Modal Large Language Modelcited by 210
  6. 2023MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuningcited by 150
  7. 2023SciGraphQA: A Large-Scale Synthetic Multi-Turn Question-Answering Dataset for Scientific Graphscited by 68
  8. 2024MathWriting: A Dataset For Handwritten Mathematical Expression Recognitioncited by 21
  9. 2024PosFormer: Recognizing Complex Handwritten Mathematical Expression with Position Forest Transformercited by 18

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Integrating Visual Interpretation and Linguistic Reasoning for Math Problem Solving
  2. 2025GSM8K-V: Can Vision Language Models Solve Grade School Math Word Problems in Visual Contexts
  3. 2025MathSight: A Benchmark Exploring Have Vision-Language Models Really Seen in University-Level Mathematical Reasoning?
  4. 2025MINT-CoT: Enabling Interleaved Visual Tokens in Mathematical Chain-of-Thought Reasoning
  5. 2024Self-Imagine: Effective Unimodal Reasoning with Multimodal Models using Self-Imagination
  6. 2025Why Vision Language Models Struggle with Visual Arithmetic? Towards Enhanced Chart and Geometry Understanding
  7. 2025CodePlot-CoT: Mathematical Visual Reasoning by Thinking with Code-Driven Images
  8. 2026Render-of-Thought: Rendering Textual Chain-of-Thought as Images for Visual Latent Reasoning