AnE: Pushing the Reasoning Frontier of Multimodal LLMs via Anchor Evolution
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Post-training via Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL) is crucial for enhancing reasoning in Multimodal Large Language Models (MLLMs), yet existing paradigms often reach a performance bottleneck due to the limitations of static data. While current methods leverage self-reflection or self-evolution to push these boundaries, they still suffer from cognitive drift and hallucinated reasoning paths caused by low-quality synthetic data. To address these challenges, we propose Anchor Evolution (AnE), a new paradigm that integrates truth-anchored data curation and model evolution, achieving faithful and steady performance gains at the reasoning frontier. Specifically, we propose Truth Anchor Expansion, which pinpoints the model failing frontier via trajectory rollouts and leverages ground-truth databases to retrieve high-fidelity anchors for faithful data curation. Subsequently, we introduce the Scaffold-Stripping Mechanism to internalize reasoning capabilities. This mechanism first anchors reasoning paths via scaffold-augmented supervision to mitigate the learning complexity and distribution drift of direct SFT on raw data, then leverages RL to strip the scaffold template, thereby effectively transitioning the reasoning paths into intrinsic model capabilities. Experimental results on multimodal reasoning benchmarks show that our method substantially advances the model performance frontier, improving the base model by 10.3% across eight multimodal benchmarks and achieving state-of-the-art results. The code will be made publicly available.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 47 of its 64 references that are in the map. First posted on arXiv 25 May 2026.
Builds on
47 of 64 references.
Closest ancestors · 22
Same direction, newest first
- 2025OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipe20 Nov
- 2025MMR1: Enhancing Multimodal Reasoning with Variance-Aware Sampling and Open Resources25 Sep
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
- 2025We-Math 2.0: A Versatile MathBook System for Incentivizing Visual Mathematical Reasoning14 Aug
- 2025SyncLoop: A Multimodal Dual-Loop Framework for Self-Improving Mathematical Reasoning22 Jul
- 2025The Synergy Dilemma of Long-CoT SFT and RL: Investigating Post-Training Techniques for Reasoning VLMs10 Jul
- 2025Open Vision Reasoner: Transferring Linguistic Cognitive Behavior for Visual Reasoning7 Jul
- 2025Metis-RISE: RL Incentivizes and SFT Enhances Multimodal Reasoning Model Learning16 Jun
- 2025Advancing Multimodal Reasoning: From Optimized Cold Start to Staged Reinforcement Learning4 Jun
- 2025SRPO: Enhancing Multimodal LLM Reasoning via Reflection-Aware Reinforcement Learning2 Jun
- 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models8 May
- 2025Reinforced MLLM: A Survey on RL-Based Reasoning in Multimodal Large Language Models30 Apr
10 more
- 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models10 Apr
- 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
- 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvement10 Apr
- 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles21 Mar
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2025Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmark9 Jan
- 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contexts6 Jul
- 2024Are Language Models Puzzle Prodigies? Algorithmic Puzzles Unveil Serious Challenges in Multimodal Reasoning6 Mar
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
Other references · 25
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2025Group Sequence Policy Optimizationcited by 788
- 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 655
- 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRscited by 373
- 2025Seed1.5-VL Technical Reportcited by 367
- 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 211
- 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 171
- 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Modelscited by 105
13 more
- 2025Learning What Reinforcement Learning Can't: Interleaved Online Fine-Tuning for Hardest Questionscited by 95
- 2025UI-Vision: A Desktop-centric GUI Benchmark for Visual Perception and Interactioncited by 68
- 2025FineVision: Open Data Is All You Needcited by 51
- 2025LLaVA-Critic-R1: Your Critic Model is Secretly a Strong Policy Modelcited by 34
- 2025Step-wise Adaptive Integration of Supervised Fine-tuning and Reinforcement Learning for Task-Specific LLMscited by 25
- 2025EvoLMM: Self-Evolving Large Multimodal Models with Continuous Rewardscited by 24
- 2025Xiaomi MiMo-VL-Miloco Technical Reportcited by 15
- 2026Automated Optimization Modeling via a Localizable Error-Driven Perspectivecited by 14
- 2025MiroMind-M1: An Open-Source Advancement in Mathematical Reasoning via Context-Aware Multi-Stage Policy Optimizationcited by 12
- 2025ADHint: Adaptive Hints with Difficulty Priors for Reinforcement Learningcited by 10
- 2025SPARK: Synergistic Policy And Reward Co-Evolving Frameworkcited by 9
- 2025AdaSTaR: Adaptive Data Sampling for Training Self-Taught Reasonerscited by 6
- 2026Why Does RL Generalize Better Than SFT? A Data-Centric Perspective on VLM Post-Trainingcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025DRIFT: Transferring Reasoning Priors for Efficient MLLM Fine-Tuning
- 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start
- 2025Reinforcement Fine-Tuning Powers Reasoning Capability of Multimodal Large Language Models
- 2026When Models Judge Themselves: Unsupervised Self-Evolution for Multimodal Reasoning
- 2025MM-HELIX: Boosting Multimodal Long-Chain Reflective Reasoning with Holistic Platform and Adaptive Hybrid Policy Optimization
- 2025Empowering Lightweight MLLMs with Reasoning via Long CoT SFT
- 2025MindGPT-4ov: An Enhanced MLLM via a Multi-Stage Post-Training Paradigm
- 2025Towards Efficient Multimodal Unified Reasoning Model via Model Merging