mlsanityData to 14 Oct 2026

VeriEvol: Scaling Multimodal Mathematical Reasoning via Verifiable Evol-Instruct

arXiv 2606.23543 ↗First posted 22 Jun 2026cs.AI cs.CL cs.CVcited by 0

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Scaling reinforcement learning for visual mathematical reasoning requires more than generating harder questions: as data volume grows, the reward labels themselves must remain reliable. Yet existing data pipelines scale supervision while trusting the labeller, and policy-side methods assume the underlying answers are already correct. We instead treat scaling as a verifiable data-construction problem and decouple two axes before any policy update: prompt difficulty, expanded by route-specific evolution operators, and answer reliability, enforced by offline hypothesis-test falsification. We instantiate this as VeriEvol, an iterative framework with two extensible components: a type-aware evolution module that rewrites low-difficulty image-question seeds into harder, image-grounded prompts; and HTV-Agent, a verifier that accepts an answer only after multi-source counter-evidence has failed to refute it. The resulting verified data scales in volume, extends by adding evolution routes or verifier channels, and plugs directly into existing GRPO-style RL recipes. On a five-benchmark visual-math suite, scaling evolved SFT data from 10K to 250K samples raises the mean accuracy from 35.42 to 54.73; then, with backbone, SFT initialization, and GRPO recipe held fixed, VeriEvol adds a cumulative +3.88 over an un-evolved RL baseline, of which +1.82 comes from evolved prompts and +2.06 from the HTV-Agent verifier. We release the prompts, data, models, code, and the full verifier trace of every sample, so that downstream work can scale and audit the pipeline rather than only inspect its outputs.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 50 of its 52 references that are in the map. First posted on arXiv 22 Jun 2026.

Builds on

50 of 52 references.

Closest ancestors · 34

Same direction, newest first

  1. 2026TRON: Targeted Rule-Verifiable Online Environments for Visual Reasoning RL1 Jun
  2. 2026Visually-Guided Policy Optimization for Multimodal Reasoning10 Apr
  3. 2026From Narrow to Panoramic Vision: Attention-Guided Cold-Start Reshapes Multimodal Reasoning4 Mar
  4. 2026PaLMR: Towards Faithful Visual Reasoning via Multimodal Process Alignment28 Feb
  5. 2026MMFineReason: Closing the Multimodal Reasoning Gap via Open Data-Centric Methods29 Jan
  6. 2026V-Zero: Self-Improving Multimodal Reasoning with Zero Annotation15 Jan
  7. 2026iReasoner: Trajectory-Aware Intrinsic Reasoning Supervision for Self-Evolving Large Multimodal Models9 Jan
  8. 2026M3Kang: Evaluating Multilingual Multimodal Mathematical Reasoning in Vision-Language Models3 Jan
  9. 2025See Less, See Right: Bi-directional Perceptual Shaping For Multimodal Reasoning26 Dec
  10. 2025More Than the Final Answer: Improving Visual Extraction and Logical Consistency in Vision-Language Models13 Dec
  11. 2025Dual-Uncertainty Guided Policy Learning for Multimodal Reasoning1 Oct
  12. 2025MMR1: Enhancing Multimodal Reasoning with Variance-Aware Sampling and Open Resources25 Sep
22 more
  1. 2025We-Math 2.0: A Versatile MathBook System for Incentivizing Visual Mathematical Reasoning14 Aug
  2. 2025Perception-Aware Policy Optimization for Multimodal Reasoning8 Jul
  3. 2025Open Vision Reasoner: Transferring Linguistic Cognitive Behavior for Visual Reasoning7 Jul
  4. 2025WeThink: Toward General-purpose Vision-Language Reasoning via Reinforcement Learning9 Jun
  5. 2025Infi-MMR: Curriculum-based Unlocking Multimodal Reasoning via Phased Reinforcement Learning in Multimodal Small Language Models29 May
  6. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
  7. 2025MR. Judge: Multimodal Reasoner as a Judge19 May
  8. 2025MathCoder-VL: Bridging Vision and Code for Enhanced Multimodal Mathematical Reasoning15 May
  9. 2025Skywork R1V2: Multimodal Hybrid Reinforcement Learning for Reasoning23 Apr
  10. 2025NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation17 Apr
  11. 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
  12. 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles21 Mar
  13. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
  14. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
  15. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  16. 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar
  17. 2025MV-MATH: Evaluating Multimodal Math Reasoning in Multi-Visual Contexts28 Feb
  18. 2024MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale6 Dec
  19. 2024DynaMath: A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Models29 Oct
  20. 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?1 Jul
  21. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset22 Feb
  22. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct

Other references · 16

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  3. 2023Let's Verify Step by Stepcited by 3,789
  4. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  5. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  6. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  7. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
  8. 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
  9. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 928
  10. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
  11. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
  12. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
4 more
  1. 2024MMEvol: Empowering Multimodal Large Language Models with Evol-Instructcited by 42
  2. 2025VisualWebInstruct: Scaling up Multimodal Instruction Data through Web Searchcited by 35
  3. 2025Judge Anything: MLLM as a Judge Across Any Modalitycited by 34
  4. 2026Attend to Evidence: Evidence-Anchored Spatial Attention Supervision for Multimodal RLVRcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025SynthRL: Scaling Visual Reasoning with Verifiable Data Synthesis
  2. 2025MathSE: Improving Multimodal Mathematical Reasoning via Self-Evolving Iterative Reflection and Reward-Guided Fine-Tuning
  3. 2025EvoLMM: Self-Evolving Large Multimodal Models with Continuous Rewards
  4. 2025Multimodal Mathematical Reasoning with Diverse Solving Perspective
  5. 2026Eliciting Self-Verification in Multimodal Reasoning Agents with Reinforcement Learning
  6. 2025SyncLoop: A Multimodal Dual-Loop Framework for Self-Improving Mathematical Reasoning
  7. 2026Scaling the Scaling Logic: Agentic Meta-Synthesis of Logic Reasoning
  8. 2025Long Grounded Thoughts: Synthesizing Visual Problems and Reasoning Chains at Scale