RISE: Reliable Improvement in Self-Evolving Vision-Language Models
On the map: LLM reasoning → Multimodal reasoning
also in 2 more
Abstract (arXiv)
Vision-language models (VLMs) have achieved strong multimodal reasoning capabilities, but further improving them still relies heavily on large-scale human-constructed supervision for post-training. Such supervision is costly to obtain, especially for reasoning-intensive multimodal tasks where questions, answers, and feedback signals must be carefully designed. This motivates self-evolving learning, where a model improves itself through a dual-role closed loop: a questioner autonomously poses questions and a solver learns to solve them. However, we observe that current VLM self-evolving methods still face three major challenges: coarse-grained role alternation delays the interaction between question generation and solver adaptation; generated questions can progressively degrade in quality; and question types may collapse toward a narrow distribution. These issues limit the efficiency and reliability of self-evolution. Thus, we propose RISE, a reliable self-evolving framework for vision-language models. RISE is built on three complementary designs: fine-grained role alternation, which shortens the feedback loop between the questioner and the solver to improve efficiency; a quality supervisor, which improves question validity and pseudo-label reliability; and skill-aware dynamic balancing, which mitigates mode collapse and maintains broad skill coverage during evolution. Together, these components enable more reliable and effective self-evolution from unlabeled images. Experiments on two VLM backbones across seven benchmarks show that RISE consistently improves the base models, yielding broad and sustained gains. Our code is publicly available at https://github.com/AMAP-ML/RISE.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 53 of its 58 references that are in the map. First posted on arXiv 20 May 2026.
Builds on
53 of 58 references.
Closest ancestors · 14
Same direction, newest first
- 2026Visually-Guided Policy Optimization for Multimodal Reasoning10 Apr
- 2026MM-Zero: Self-Evolving Multi-Model Vision Language Models From Zero Data10 Mar
- 2026Entropy-Guided Data-Efficient Training for Multimodal Reasoning Reward Models2 Feb
- 2025VisPlay: Self-Evolving Vision-Language Models from Images19 Nov
- 2025Self-Rewarding Vision-Language Model via Reasoning Decomposition27 Aug
- 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models10 Apr
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
- 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset22 Feb
2 more
Other references · 39
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Visual Instruction Tuningcited by 7,792
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2024A Survey on LLM-as-a-Judgecited by 1,384
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,221
- 2023A Survey on Multimodal Large Language Modelscited by 898
- 2022STaR: Bootstrapping Reasoning With Reasoningcited by 895
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
27 more
- 2022Large Language Models Can Self-Improvecited by 656
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 573
- 2023Reinforced Self-Training (ReST) for Language Modelingcited by 486
- 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 451
- 2025Seed1.5-VL Technical Reportcited by 367
- 2023Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Modelscited by 325
- 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 323
- 2025TTRL: Test-Time Reinforcement Learningcited by 253
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
- 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 210
- 2025GPG: A Simple and Strong Reinforcement Learning Baseline for Model Reasoningcited by 147
- 2024Survey on Large Language Model-Enhanced Reinforcement Learning: Concept, Taxonomy, and Methodscited by 114
- 2024A Survey on Self-Evolution of Large Language Modelscited by 86
- 2025SPICE: Self-Play In Corpus Environments Improves Reasoningcited by 78
- 2026SkillClaw: Let Skills Evolve Collectively with Agentic Evolvercited by 76
- 2025Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoningcited by 68
- 2025Improving Data Efficiency for LLM Reinforcement Fine-tuning Through Difficulty-targeted Online Data Selection and Rollout Replaycited by 52
- 2025Vision-Zero: Scalable VLM Self-Improvement via Strategic Gamified Self-Playcited by 37
- 2025Guided Self-Evolving LLMs with Minimal Human Supervisioncited by 33
- 2024Exploring Perceptual Limitation of Multimodal Large Language Modelscited by 24
- 2025EvoLMM: Self-Evolving Large Multimodal Models with Continuous Rewardscited by 24
- 2024Surveying the MLLM Landscape: A Meta-Review of Current Surveyscited by 20
- 2026Harder Is Better: Boosting Mathematical Reasoning via Difficulty-Aware GRPO and Multi-Aspect Question Reformulationcited by 18
- 2023Vision-Language Instruction Tuning: A Review and Analysiscited by 17
- 2026CoEvolve: Training LLM Agents via Agent-Data Mutual Evolutioncited by 14
- 2025Self-Improvement in Multimodal Large Language Models: A Surveycited by 6
- 2026Ranking-aware Reinforcement Learning for Ordinal Rankingcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Trinity: Self-Evolving Vision-Language Models with a Self-Verifier
- 2026Self-Evolving Visual Questioner
- 2026Program-Verified Self-Evolution for Vision-Language Models
- 2025Agent0-VL: Exploring Self-Evolving Agent for Tool-Integrated Vision-Language Reasoning
- 2026Paying More Attention to Visual Tokens in Self-Evolving Large Multimodal Models
- 2025SE-VLN: A Self-Evolving Vision-Language Navigation Framework Based on Multimodal Large Language Models
- 2025See, Think, Learn: A Self-Taught Multimodal Reasoner
- 2026When Models Judge Themselves: Unsupervised Self-Evolution for Multimodal Reasoning