We-Math 2.0: A Versatile MathBook System for Incentivizing Visual Mathematical Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities across various tasks, but still struggle with complex mathematical reasoning. Existing research primarily focuses on dataset construction and method optimization, often overlooking two critical aspects: comprehensive knowledge-driven design and model-centric data space modeling. In this paper, we introduce We-Math 2.0, a unified system that integrates a structured mathematical knowledge system, model-centric data space modeling, and a reinforcement learning (RL)-based training paradigm to comprehensively enhance the mathematical reasoning abilities of MLLMs. The key contributions of We-Math 2.0 are fourfold: (1) MathBook Knowledge System: We construct a five-level hierarchical system encompassing 491 knowledge points and 1,819 fundamental principles. (2) MathBook-Standard & Pro: We develop MathBook-Standard, a dataset that ensures broad conceptual coverage and flexibility through dual expansion. Additionally, we define a three-dimensional difficulty space and generate 7 progressive variants per problem to build MathBook-Pro, a challenging dataset for robust training. (3) MathBook-RL: We propose a two-stage RL framework comprising: (i) Cold-Start Fine-tuning, which aligns the model with knowledge-oriented chain-of-thought reasoning; and (ii) Progressive Alignment RL, leveraging average-reward learning and dynamic data scheduling to achieve progressive alignment across difficulty levels. (4) MathBookEval: We introduce a comprehensive benchmark covering all 491 knowledge points with diverse reasoning step distributions. Experimental results show that MathBook-RL performs competitively with existing baselines on four widely-used benchmarks and achieves strong results on MathBookEval, suggesting promising generalization in mathematical reasoning.
Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 55 of its 77 references that are in the map. First posted on arXiv 14 Aug 2025.
Builds on
55 of 77 references.
Closest ancestors · 22
Same direction, newest first
- 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning1 Jul
- 2025WeThink: Toward General-purpose Vision-Language Reasoning via Reinforcement Learning9 Jun
- 2025SRPO: Enhancing Multimodal LLM Reasoning via Reflection-Aware Reinforcement Learning2 Jun
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
- 2025MathCoder-VL: Bridging Vision and Code for Enhanced Multimodal Mathematical Reasoning15 May
- 2025NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation17 Apr
- 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models10 Apr
- 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles21 Mar
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar
10 more
- 2025Unlocking Multimodal Mathematical Reasoning via Process Reward Model8 Jan
- 2024Progressive Multimodal Reasoning via Active Retrieval19 Dec
- 2024DynaMath: A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Models29 Oct
- 2024InfiMM-WebMath-40B: Advancing Multimodal Pre-Training for Enhanced Mathematical Reasoning19 Sep
- 2024MultiMath: Bridging Visual and Mathematical Reasoning for Large Language Models30 Aug
- 2024Math-PUMA: Progressive Upward Multimodal Alignment to Enhance Mathematical Reasoning16 Aug
- 2024MAVIS: Mathematical Visual Instruction Tuning with an Automatic Data Engine11 Jul
- 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?1 Jul
- 2024Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models25 Jun
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
Other references · 33
- 2023GPT-4 Technical Reportcited by 18,396
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2024OpenAI o1 System Cardcited by 1,244
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
- 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,050
- 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 928
- 2022Solving math word problems with process- and outcome-based feedbackcited by 901
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
21 more
- 2025LIMO: Less is More for Reasoningcited by 498
- 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 383
- 2025Seed1.5-VL Technical Reportcited by 373
- 2025ToolRL: Reward is All Tool Learning Needscited by 362
- 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 301
- 2024Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMscited by 273
- 2021IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoningcited by 267
- 2023G-LLaVA: Solving Geometric Problem with Multi-Modal Large Language Modelcited by 210
- 2024DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Searchcited by 197
- 2024TextMonkey: An OCR-Free Large Multimodal Model for Understanding Documentcited by 174
- 2025Agentic Reinforced Policy Optimizationcited by 172
- 2023mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understandingcited by 168
- 2023UReader: Universal OCR-free Visually-situated Language Understanding with Multimodal Large Language Modelcited by 143
- 2024Grounding DINO 1.5: Advance the "Edge" of Open-Set Object Detectioncited by 122
- 2025Tool-Star: Empowering LLM-Brained Multi-Tool Reasoner via Reinforcement Learningcited by 72
- 2025Kwai Keye-VL Technical Reportcited by 47
- 2024CS-Bench: A Comprehensive Benchmark for Large Language Models towards Computer Science Masterycited by 30
- 2025GeoSense: Evaluating Identification and Application of Geometric Principles in Multimodal Reasoningcited by 25
- 2025M2-Reasoning: Empowering MLLMs with Unified General and Spatial Reasoningcited by 16
- 2023InstructERC: Reforming Emotion Recognition in Conversation with Multi-task Retrieval-Augmented Large Language Modelscited by 11
- 2024GAOKAO-Eval: Does high scores truly reflect strong capabilities in LLMs?cited by 3
Built on by
Citing papers per year: 2025: 11; 2026: 21.
32 papers.
Sort:
By area:
- 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Callingcited by 61
- 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligencecited by 54
- 2025Agentic Entropy-Balanced Policy Optimizationcited by 40
- 2025OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipecited by 37
- 2025V-Thinker: Interactive Thinking with Imagescited by 26
- 2025SpaceVista: All-Scale Visual Spatial Reasoning from mm to kmcited by 19
- 2025Toward Effective Tool-Integrated Reasoning via Self-Evolved Preference Learningcited by 17
- 2026PyVision-RL: Forging Open Agentic Vision Models via RLcited by 16
- 2025Thinking with Programming Vision: Towards a Unified View for Thinking with Imagescited by 15
- 2025Euclid's Gift: Enhancing Spatial Perception and Reasoning in Vision-Language Models via Geometric Surrogate Taskscited by 13
- 2026Thinking in Uncertainty: Mitigating Hallucinations in MLRMs with Latent Entropy-Aware Decodingcited by 12
- 2026Vero: An Open RL Recipe for General Visual Reasoningcited by 11
20 more
- 2026Rethinking Token-Level Policy Optimization for Multimodal Chain-of-Thoughtcited by 9
- 2025TIM-PRM: Verifying multimodal reasoning with Tool-Integrated PRMcited by 8
- 2026CCCaption: Dual-Reward Reinforcement Learning for Complete and Correct Image Captioningcited by 8
- 2026Credit Where It is Due: Cross-Modality Connectivity Drives Precise Reinforcement Learning for MLLM Reasoningcited by 6
- 2026DeepVision-103K: A Visually Diverse, Broad-Coverage, and Verifiable Mathematical Dataset for Multimodal Reasoningcited by 6
- 2025Learning When to Look: A Disentangled Curriculum for Strategic Perception in Multimodal Reasoningcited by 5
- 2026CogFlow: Bridging Perception and Reasoning through Knowledge Internalization for Visual Mathematical Problem Solvingcited by 5
- 2026ET-Agent: Incentivizing Effective Tool-Integrated Reasoning Agent via Behavior Calibrationcited by 4
- 2026RetouchIQ: MLLM Agents for Instruction-Based Image Retouching with Generalist Rewardcited by 4
- 2026Persistent Visual Memory: Sustaining Perception for Deep Generation in LVLMscited by 4
- 2026LiveK12Bench: Have Large Multimodal Models Truly Conquered High School-level Examinations?cited by 3
- 2026Bypassing Copyright Protection in Diffusion-based Customization via Two-Stage Latent Feature Optimizationcited by 2
- 2026RL Forgets! Towards Continual Policy Optimizationcited by 2
- 2026AnE: Pushing the Reasoning Frontier of Multimodal LLMs via Anchor Evolutioncited by 1
- 2026MMVistaReason: Toward Open-Data and Post-Training Recipes for Multimodal Reasoningcited by 1
- 2025Towards Mixed-Modal Retrieval for Universal Retrieval-Augmented Generationcited by 0
- 2026Draw2Think: Harnessing Geometry Reasoning through Constraint Engine Interactioncited by 0
- 2026VeriEvol: Scaling Multimodal Mathematical Reasoning via Verifiable Evol-Instructcited by 0
- 2026When Prompts Become Pixels: Prompt-Region Grounding for Multimodal Reasoningcited by 0
- 2026V-Rubrics: Visual Faithfulness via Rubric-Based Reinforcement Learningcited by 0
- 2026MMVistaReason: Toward Open-Data and Post-Training Recipes for Multimodal Reasoning1 Oct 2026
- 2026V-Rubrics: Visual Faithfulness via Rubric-Based Reinforcement Learning26 Aug 2026
- 2026When Prompts Become Pixels: Prompt-Region Grounding for Multimodal Reasoning5 Aug 2026
- 2026RL Forgets! Towards Continual Policy Optimization5 Jul 2026
- 2026VeriEvol: Scaling Multimodal Mathematical Reasoning via Verifiable Evol-Instruct22 Jun 2026
- 2026Bypassing Copyright Protection in Diffusion-based Customization via Two-Stage Latent Feature Optimization6 Jun 2026
- 2026LiveK12Bench: Have Large Multimodal Models Truly Conquered High School-level Examinations?26 May 2026
- 2026AnE: Pushing the Reasoning Frontier of Multimodal LLMs via Anchor Evolution25 May 2026
- 2026Draw2Think: Harnessing Geometry Reasoning through Constraint Engine Interaction20 May 2026
- 2026Persistent Visual Memory: Sustaining Perception for Deep Generation in LVLMs1 May 2026
- 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence20 Apr 2026
- 2026Vero: An Open RL Recipe for General Visual Reasoning6 Apr 2026
20 more
- 2026Rethinking Token-Level Policy Optimization for Multimodal Chain-of-Thought24 Mar 2026
- 2026Thinking in Uncertainty: Mitigating Hallucinations in MLRMs with Latent Entropy-Aware Decoding9 Mar 2026
- 2026CCCaption: Dual-Reward Reinforcement Learning for Complete and Correct Image Captioning25 Feb 2026
- 2026PyVision-RL: Forging Open Agentic Vision Models via RL24 Feb 2026
- 2026RetouchIQ: MLLM Agents for Instruction-Based Image Retouching with Generalist Reward19 Feb 2026
- 2026DeepVision-103K: A Visually Diverse, Broad-Coverage, and Verifiable Mathematical Dataset for Multimodal Reasoning18 Feb 2026
- 2026Credit Where It is Due: Cross-Modality Connectivity Drives Precise Reinforcement Learning for MLLM Reasoning12 Feb 2026
- 2026ET-Agent: Incentivizing Effective Tool-Integrated Reasoning Agent via Behavior Calibration11 Jan 2026
- 2026CogFlow: Bridging Perception and Reasoning through Knowledge Internalization for Visual Mathematical Problem Solving5 Jan 2026
- 2025Learning When to Look: A Disentangled Curriculum for Strategic Perception in Multimodal Reasoning19 Dec 2025
- 2025Thinking with Programming Vision: Towards a Unified View for Thinking with Images3 Dec 2025
- 2025TIM-PRM: Verifying multimodal reasoning with Tool-Integrated PRM28 Nov 2025
- 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Calling25 Nov 2025
- 2025OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipe20 Nov 2025
- 2025V-Thinker: Interactive Thinking with Images6 Nov 2025
- 2025Towards Mixed-Modal Retrieval for Universal Retrieval-Augmented Generation20 Oct 2025
- 2025Agentic Entropy-Balanced Policy Optimization16 Oct 2025
- 2025SpaceVista: All-Scale Visual Spatial Reasoning from mm to km10 Oct 2025
- 2025Euclid's Gift: Enhancing Spatial Perception and Reasoning in Vision-Language Models via Geometric Surrogate Tasks29 Sep 2025
- 2025Toward Effective Tool-Integrated Reasoning via Self-Evolved Preference Learning27 Sep 2025
- 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Callingcited by 61
- 2025OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipecited by 37
- 2025V-Thinker: Interactive Thinking with Imagescited by 26
- 2025SpaceVista: All-Scale Visual Spatial Reasoning from mm to kmcited by 19
- 2025Toward Effective Tool-Integrated Reasoning via Self-Evolved Preference Learningcited by 17
- 2025Thinking with Programming Vision: Towards a Unified View for Thinking with Imagescited by 15
- 2025Euclid's Gift: Enhancing Spatial Perception and Reasoning in Vision-Language Models via Geometric Surrogate Taskscited by 13
- 2026Thinking in Uncertainty: Mitigating Hallucinations in MLRMs with Latent Entropy-Aware Decodingcited by 12
- 2026Vero: An Open RL Recipe for General Visual Reasoningcited by 11
- 2026Rethinking Token-Level Policy Optimization for Multimodal Chain-of-Thoughtcited by 9
- 2025TIM-PRM: Verifying multimodal reasoning with Tool-Integrated PRMcited by 8
- 2026Credit Where It is Due: Cross-Modality Connectivity Drives Precise Reinforcement Learning for MLLM Reasoningcited by 6
12 most cited of 21 All 21 (JSON)
- 2026MMVistaReason: Toward Open-Data and Post-Training Recipes for Multimodal Reasoning1 Oct 2026
- 2026When Prompts Become Pixels: Prompt-Region Grounding for Multimodal Reasoning5 Aug 2026
- 2026VeriEvol: Scaling Multimodal Mathematical Reasoning via Verifiable Evol-Instruct22 Jun 2026
- 2026AnE: Pushing the Reasoning Frontier of Multimodal LLMs via Anchor Evolution25 May 2026
- 2026Draw2Think: Harnessing Geometry Reasoning through Constraint Engine Interaction20 May 2026
- 2026Vero: An Open RL Recipe for General Visual Reasoning6 Apr 2026
- 2026Rethinking Token-Level Policy Optimization for Multimodal Chain-of-Thought24 Mar 2026
- 2026Thinking in Uncertainty: Mitigating Hallucinations in MLRMs with Latent Entropy-Aware Decoding9 Mar 2026
- 2026DeepVision-103K: A Visually Diverse, Broad-Coverage, and Verifiable Mathematical Dataset for Multimodal Reasoning18 Feb 2026
- 2026Credit Where It is Due: Cross-Modality Connectivity Drives Precise Reinforcement Learning for MLLM Reasoning12 Feb 2026
- 2026ET-Agent: Incentivizing Effective Tool-Integrated Reasoning Agent via Behavior Calibration11 Jan 2026
- 2026CogFlow: Bridging Perception and Reasoning through Knowledge Internalization for Visual Mathematical Problem Solving5 Jan 2026
12 newest of 21 All 21 (JSON)
- 2026RetouchIQ: MLLM Agents for Instruction-Based Image Retouching with Generalist Rewardcited by 4
- 2026Persistent Visual Memory: Sustaining Perception for Deep Generation in LVLMscited by 4
- 2026LiveK12Bench: Have Large Multimodal Models Truly Conquered High School-level Examinations?cited by 3
- 2026RL Forgets! Towards Continual Policy Optimizationcited by 2
- 2026V-Rubrics: Visual Faithfulness via Rubric-Based Reinforcement Learningcited by 0
- 2026V-Rubrics: Visual Faithfulness via Rubric-Based Reinforcement Learning26 Aug 2026
- 2026RL Forgets! Towards Continual Policy Optimization5 Jul 2026
- 2026LiveK12Bench: Have Large Multimodal Models Truly Conquered High School-level Examinations?26 May 2026
- 2026Persistent Visual Memory: Sustaining Perception for Deep Generation in LVLMs1 May 2026
- 2026RetouchIQ: MLLM Agents for Instruction-Based Image Retouching with Generalist Reward19 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025MV-MATH: Evaluating Multimodal Math Reasoning in Multi-Visual Contexts
- 2024MathScape: Benchmarking Multimodal Large Language Models in Real-World Mathematical Contexts
- 2026M3Kang: Evaluating Multilingual Multimodal Mathematical Reasoning in Vision-Language Models
- 2025MathSE: Improving Multimodal Mathematical Reasoning via Self-Evolving Iterative Reflection and Reward-Guided Fine-Tuning
- 2025MathReal: We Keep It Real! A Real Scene Benchmark for Evaluating Math Reasoning in Multimodal Large Language Models
- 2025Benchmarking Multimodal Mathematical Reasoning with Explicit Visual Dependency
- 2024A Survey of Mathematical Reasoning in the Era of Multimodal Large Language Model: Benchmark, Method & Challenges
- 2024MathGLM-Vision: Solving Mathematical Problems with Multi-Modal Large Language Model