Active Zero: Self-Evolving Vision-Language Models through Active Environment Exploration
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
also in 1 more
Abstract (arXiv)
Self-play has enabled large language models to autonomously improve through self-generated challenges. However, existing self-play methods for vision-language models rely on passive interaction with static image collections, resulting in strong dependence on initial datasets and inefficient learning. Without the ability to actively seek visual data tailored to their evolving capabilities, agents waste computational effort on samples that are either trivial or beyond their current skill level. To address these limitations, we propose Active-Zero, a framework that shifts from passive interaction to active exploration of visual environments. Active-Zero employs three co-evolving agents: a Searcher that retrieves images from open-world repositories based on the model's capability frontier, a Questioner that synthesizes calibrated reasoning tasks, and a Solver refined through accuracy rewards. This closed loop enables self-scaffolding auto-curricula where the model autonomously constructs its learning trajectory. On Qwen2.5-VL-7B-Instruct across 12 benchmarks, Active-Zero achieves 53.97 average accuracy on reasoning tasks (5.7% improvement) and 59.77 on general understanding (3.9% improvement), consistently outperforming existing self-play baselines. These results highlight active exploration as a key ingredient for scalable and adaptive self-evolving vision-language systems.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 25 of its 43 references that are in the map. First posted on arXiv 11 Feb 2026.
Builds on
25 of 43 references.
Closest ancestors · 2
Same direction, newest first
- 2025VisPlay: Self-Evolving Vision-Language Models from Images19 Nov
- 2025Vision-Zero: Scalable VLM Self-Improvement via Strategic Gamified Self-Play29 Sep
Other references · 23
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 988
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2024Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Modelscited by 552
- 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 376
- 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 323
- 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contextscited by 240
- 2024Self-Play Preference Optimization for Language Model Alignmentcited by 228
- 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 210
11 more
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 155
- 2024DynaMath: A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Modelscited by 143
- 2022UniGeo: Unifying Geometry Logical Reasoning via Reformulating Mathematical Expressioncited by 137
- 2025Self-Evolving Curriculum for LLM Reasoningcited by 107
- 2025Perception-Aware Policy Optimization for Multimodal Reasoningcited by 95
- 2025SPICE: Self-Play In Corpus Environments Improves Reasoningcited by 78
- 2025SeRL: Self-Play Reinforcement Learning for Large Language Models with Limited Datacited by 50
- 2025SPELL: Self-Play Reinforcement Learning for Evolving Long-Context Language Modelscited by 27
- 2025EvoLMM: Self-Evolving Large Multimodal Models with Continuous Rewardscited by 24
- 2025VisNumBench: Evaluating Number Sense of Multimodal Large Language Modelscited by 12
- 2025SyncLoop: A Multimodal Dual-Loop Framework for Self-Improving Mathematical Reasoningcited by 8
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Visually-Guided Policy Optimization for Multimodal Reasoningcited by 10
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026Perception Before Supervision: Self-Contained Visual Distillation from Counterfactual Blind Spotscited by 2
- 2026ScoutVLA: UAV-Centric Active Perception via a Dual-Expert VLA Model for Open-World Embodied Question Answeringcited by 1
- 2026ForeDreamer: A Self-Evolving Dual-Agent Memory Architecture for Future Event Predictioncited by 0
- 2026V-Gym: Enhancing Agentic Visual Reasoning via Skill-Data Co-Evolutioncited by 0
- 2026VICO: Visual Environments Co-Evolving for Vision-Language Model Reasoningcited by 0
- 2026VICO: Visual Environments Co-Evolving for Vision-Language Model Reasoning7 Oct 2026
- 2026V-Gym: Enhancing Agentic Visual Reasoning via Skill-Data Co-Evolution28 Sep 2026
- 2026ForeDreamer: A Self-Evolving Dual-Agent Memory Architecture for Future Event Prediction21 Aug 2026
- 2026Perception Before Supervision: Self-Contained Visual Distillation from Counterfactual Blind Spots10 Aug 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026ScoutVLA: UAV-Centric Active Perception via a Dual-Expert VLA Model for Open-World Embodied Question Answering9 Jun 2026
- 2026Visually-Guided Policy Optimization for Multimodal Reasoning10 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026MM-Zero: Self-Evolving Multi-Model Vision Language Models From Zero Data
- 2025Agent0-VL: Exploring Self-Evolving Agent for Tool-Integrated Vision-Language Reasoning
- 2026ViThinker: Active Vision-Language Reasoning via Dynamic Perceptual Querying
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning
- 2026RISE: Reliable Improvement in Self-Evolving Vision-Language Models
- 2026Trinity: Self-Evolving Vision-Language Models with a Self-Verifier
- 2024TINA: Think, Interaction, and Action Framework for Zero-Shot Vision Language Navigation
- 2025Imagine, Verify, Execute: Memory-guided Agentic Exploration with Vision-Language Models