Agent0-VL: Exploring Self-Evolving Agent for Tool-Integrated Vision-Language Reasoning
On the map: LLM reasoning → Multimodal reasoning
also in 1 more
Abstract (arXiv)
Vision-language agents have achieved remarkable progress in a variety of multimodal reasoning tasks; however, their learning remains constrained by the limitations of human-annotated supervision. Recent self-rewarding approaches attempt to overcome this constraint by allowing models to act as their own critics or reward providers. Yet, purely text-based self-evaluation struggles to verify complex visual reasoning steps and often suffers from evaluation hallucinations. To address these challenges, inspired by recent advances in tool-integrated reasoning, we propose Agent0-VL, a self-evolving vision-language agent that achieves continual improvement with tool-integrated reasoning. Agent0-VL incorporates tool usage not only into reasoning but also into self-evaluation and self-repair, enabling the model to introspect, verify, and refine its reasoning through evidence-grounded analysis. It unifies two synergistic roles within a single LVLM: a Solver that performs multi-turn tool-integrated reasoning, and a Verifier that generates structured feedback and fine-grained self-rewards through tool-grounded critique. These roles interact through a Self-Evolving Reasoning Cycle, where tool-based verification and reinforcement learning jointly align the reasoning and evaluation distributions for stable self-improvement. Through this zero-external-reward evolution, Agent0-VL aligns its reasoning and verification behaviors without any human annotation or external reward models, achieving continual self-improvement. Experiments on geometric problem solving and visual scientific analysis show that Agent0-VL achieves an 12.5% improvement over the base model. Our code is available at https://github.com/aiming-lab/Agent0.
Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 65 of its 83 references that are in the map. First posted on arXiv 25 Nov 2025.
Builds on
65 of 83 references.
Closest ancestors · 20
Same direction, newest first
- 2025VisPlay: Self-Evolving Vision-Language Models from Images19 Nov
- 2025VAGEN: Reinforcing World Model Reasoning for Multi-Turn VLM Agents19 Oct
- 2025Self-Rewarding Vision-Language Model via Reasoning Decomposition27 Aug
- 2025Thyme: Think Beyond Images15 Aug
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontiers30 Jun
- 2025Sherlock: Self-Correcting Reasoning in Vision-Language Models28 May
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
- 2025GRIT: Teaching MLLMs to Think with Images21 May
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
- 2025OpenThinkIMG: Learning to Think with Images via Visual Tool Reinforcement Learning13 May
- 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models10 Apr
- 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvement10 Apr
8 more
- 2025Grounded Chain-of-Thought for Multimodal Large Language Models17 Mar
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
- 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?1 Jul
- 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models13 Jun
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
- 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Action20 Mar
Other references · 45
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
- 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 583
- 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 392
- 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 383
33 more
- 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 301
- 2023ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solvingcited by 282
- 2025TTRL: Test-Time Reinforcement Learningcited by 275
- 2021GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical Reasoningcited by 228
- 2025Learning to Reason without External Rewardscited by 210
- 2025Deep Think with Confidencecited by 205
- 2024Aligning Modalities in Vision Large Language Models via Preference Fine-tuningcited by 198
- 2023LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agentscited by 193
- 2025ToRL: Scaling Tool-Integrated RLcited by 169
- 2023MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical Reasoningcited by 156
- 2025SimpleTIR: End-to-End Reinforcement Learning for Multi-Turn Tool-Integrated Reasoningcited by 146
- 2024Multimodal ArXiv: A Dataset for Improving Scientific Comprehension of Large Vision-Language Modelscited by 139
- 2024StableToolBench: Towards Stable Large-Scale Benchmarking on Tool Learning of Large Language Modelscited by 132
- 2025Right Question is Already Half the Answer: Fully Unsupervised LLM Reasoning Incentivizationcited by 128
- 2025MMSearch-R1: Incentivizing LMMs to Searchcited by 124
- 2025WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agentcited by 119
- 2024ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Explorationcited by 103
- 2025MM-RLHF: The Next Step Forward in Multimodal LLM Alignmentcited by 83
- 2024Calibrated Self-Rewarding Vision Language Modelscited by 78
- 2024Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Modelscited by 76
- 2023Language Model Self-improvement by Reinforcement Learning Contemplationcited by 75
- 2025Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoningcited by 75
- 2025Self-rewarding correction for mathematical reasoningcited by 70
- 2025Can Large Reasoning Models Self-Train?cited by 68
- 2025Confidence Is All You Need: Few-Shot RL Fine-Tuning of Language Modelscited by 62
- 2025ReAgent-V: A Reward-Driven Multi-Agent Framework for Video Understandingcited by 50
- 2025DeepMMSearch-R1: Empowering Multimodal LLMs in Multimodal Web Searchcited by 42
- 2025Vision-Zero: Scalable VLM Self-Improvement via Strategic Gamified Self-Playcited by 37
- 2025LLaVA-Critic-R1: Your Critic Model is Secretly a Strong Policy Modelcited by 35
- 2025EvoLMM: Self-Evolving Large Multimodal Models with Continuous Rewardscited by 27
- 2025Incentivizing Agentic Reasoning in LLM Judges via Tool-Integrated Reinforcement Learningcited by 17
- 2025ViPER: Empowering the Self-Evolution of Visual Perception Abilities in Vision-Language Modelcited by 11
- 2025Mimicking the Physicist's Eye:A VLM-centric Approach for Physics Formula Discoverycited by 7
Built on by
Citing papers per year: 2025: 2; 2026: 29.
31 papers.
Sort:
By area:
- 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learningcited by 278
- 2026SimpleMem: Efficient Lifelong Memory for LLM Agentscited by 149
- 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanismscited by 21
- 2025Training Versatile Coding Agents in Synthetic Environmentscited by 13
- 2026ClawArena: Benchmarking AI Agents in Evolving Information Environmentscited by 11
- 2026iReasoner: Trajectory-Aware Intrinsic Reasoning Supervision for Self-Evolving Large Multimodal Modelscited by 7
- 2026One Model, All Roles: Multi-Turn, Multi-Agent Self-Play Reinforcement Learning for Conversational Social Intelligencecited by 7
- 2026Autonomous Continual Learning for Environment Adaptation of Computer-Use Agentscited by 6
- 2026Paying More Attention to Visual Tokens in Self-Evolving Large Multimodal Modelscited by 6
- 2026RewardHarness: Self-Evolving Agentic Post-Trainingcited by 5
- 2026TACO: Tool-Augmented Credit Optimization for Agentic Tool Usecited by 5
- 2026SkillForge: Evolving Verifiable Skills for Reinforcement Learning Agentscited by 4
19 more
- 2025Fed-SE: Federated Self-Evolution for Privacy-Constrained Multi-Environment LLM Agentscited by 3
- 2026LAST: Leveraging Tools as Hints to Enhance Spatial Reasoning for Multimodal Large Language Modelscited by 3
- 2026TRACER: Verifiable Generative Provenance for Multimodal Tool-Using Agentscited by 3
- 2026Self-evolving Embodied AIcited by 2
- 2026Agentic AI for Remote Sensing: Technical Challenges and Research Directionscited by 2
- 2026SimpleOCR: Rendering Visualized Questions to Teach MLLMs to Readcited by 1
- 2026From Blind Spots to Gains: Diagnostic-Driven Iterative Training for Large Multimodal Modelscited by 1
- 2026Seirenes: Adversarial Self-Play with Evolving Distractions for LLM Reasoningcited by 1
- 2026Cognitive-structured Multimodal Agent for Multimodal Understanding, Generation, and Editingcited by 1
- 2026MLToolBench: Learning Tool-Augmented Agents for Machine Learning Developmentcited by 1
- 2026Evaluation as Evolution: Transforming Adversarial Diffusion into Closed-Loop Curricula for Autonomous Vehiclescited by 0
- 2026Imperfect Visual Verification for Code Edition : A Case Study on TikZcited by 0
- 2026AdaTurn: Budget-Aware Test-Time Scaling for Active Visual Perception Agentscited by 0
- 2026DiffuseAgent-MI: Distributionally-Grounded,Tool-Integrated Self-Evolving Agents for Faithful Visual Reasoningcited by 0
- 2026ARISE-RL: Agentic Rubric-Grounded Iterative Self-Evolution with Reinforcement Learningcited by 0
- 2026V-Gym: Enhancing Agentic Visual Reasoning via Skill-Data Co-Evolutioncited by 0
- 2026Trinity: Self-Evolving Vision-Language Models with a Self-Verifiercited by 0
- 2026Evo2: Evolving the Evolver through Weight-Harness Co-Evolutioncited by 0
- 2026Self-Evolving Visual Agent via Margin Rewardcited by 0
- 2026Self-Evolving Visual Agent via Margin Reward10 Oct 2026
- 2026Evo2: Evolving the Evolver through Weight-Harness Co-Evolution9 Oct 2026
- 2026Trinity: Self-Evolving Vision-Language Models with a Self-Verifier3 Oct 2026
- 2026MLToolBench: Learning Tool-Augmented Agents for Machine Learning Development29 Sep 2026
- 2026V-Gym: Enhancing Agentic Visual Reasoning via Skill-Data Co-Evolution28 Sep 2026
- 2026ARISE-RL: Agentic Rubric-Grounded Iterative Self-Evolution with Reinforcement Learning1 Sep 2026
- 2026SkillForge: Evolving Verifiable Skills for Reinforcement Learning Agents25 Aug 2026
- 2026DiffuseAgent-MI: Distributionally-Grounded,Tool-Integrated Self-Evolving Agents for Faithful Visual Reasoning1 Aug 2026
- 2026AdaTurn: Budget-Aware Test-Time Scaling for Active Visual Perception Agents16 Jul 2026
- 2026Cognitive-structured Multimodal Agent for Multimodal Understanding, Generation, and Editing9 Jul 2026
- 2026TACO: Tool-Augmented Credit Optimization for Agentic Tool Use29 Jun 2026
- 2026Paying More Attention to Visual Tokens in Self-Evolving Large Multimodal Models25 Jun 2026
19 more
- 2026Seirenes: Adversarial Self-Play with Evolving Distractions for LLM Reasoning12 May 2026
- 2026TRACER: Verifiable Generative Provenance for Multimodal Tool-Using Agents11 May 2026
- 2026RewardHarness: Self-Evolving Agentic Post-Training9 May 2026
- 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms7 May 2026
- 2026Agentic AI for Remote Sensing: Technical Challenges and Research Directions27 Apr 2026
- 2026Imperfect Visual Verification for Code Edition : A Case Study on TikZ9 Apr 2026
- 2026LAST: Leveraging Tools as Hints to Enhance Spatial Reasoning for Multimodal Large Language Models8 Apr 2026
- 2026Evaluation as Evolution: Transforming Adversarial Diffusion into Closed-Loop Curricula for Autonomous Vehicles8 Apr 2026
- 2026ClawArena: Benchmarking AI Agents in Evolving Information Environments5 Apr 2026
- 2026From Blind Spots to Gains: Diagnostic-Driven Iterative Training for Large Multimodal Models26 Feb 2026
- 2026SimpleOCR: Rendering Visualized Questions to Teach MLLMs to Read25 Feb 2026
- 2026Autonomous Continual Learning for Environment Adaptation of Computer-Use Agents10 Feb 2026
- 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learning9 Feb 2026
- 2026Self-evolving Embodied AI4 Feb 2026
- 2026One Model, All Roles: Multi-Turn, Multi-Agent Self-Play Reinforcement Learning for Conversational Social Intelligence3 Feb 2026
- 2026iReasoner: Trajectory-Aware Intrinsic Reasoning Supervision for Self-Evolving Large Multimodal Models9 Jan 2026
- 2026SimpleMem: Efficient Lifelong Memory for LLM Agents5 Jan 2026
- 2025Training Versatile Coding Agents in Synthetic Environments13 Dec 2025
- 2025Fed-SE: Federated Self-Evolution for Privacy-Constrained Multi-Environment LLM Agents9 Dec 2025
- 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learningcited by 278
- 2026SimpleMem: Efficient Lifelong Memory for LLM Agentscited by 149
- 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanismscited by 21
- 2025Training Versatile Coding Agents in Synthetic Environmentscited by 13
- 2026ClawArena: Benchmarking AI Agents in Evolving Information Environmentscited by 11
- 2026Autonomous Continual Learning for Environment Adaptation of Computer-Use Agentscited by 6
- 2026RewardHarness: Self-Evolving Agentic Post-Trainingcited by 5
- 2026TACO: Tool-Augmented Credit Optimization for Agentic Tool Usecited by 5
- 2026SkillForge: Evolving Verifiable Skills for Reinforcement Learning Agentscited by 4
- 2025Fed-SE: Federated Self-Evolution for Privacy-Constrained Multi-Environment LLM Agentscited by 3
- 2026Agentic AI for Remote Sensing: Technical Challenges and Research Directionscited by 2
- 2026ARISE-RL: Agentic Rubric-Grounded Iterative Self-Evolution with Reinforcement Learningcited by 0
- 2026ARISE-RL: Agentic Rubric-Grounded Iterative Self-Evolution with Reinforcement Learning1 Sep 2026
- 2026SkillForge: Evolving Verifiable Skills for Reinforcement Learning Agents25 Aug 2026
- 2026TACO: Tool-Augmented Credit Optimization for Agentic Tool Use29 Jun 2026
- 2026RewardHarness: Self-Evolving Agentic Post-Training9 May 2026
- 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms7 May 2026
- 2026Agentic AI for Remote Sensing: Technical Challenges and Research Directions27 Apr 2026
- 2026ClawArena: Benchmarking AI Agents in Evolving Information Environments5 Apr 2026
- 2026Autonomous Continual Learning for Environment Adaptation of Computer-Use Agents10 Feb 2026
- 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learning9 Feb 2026
- 2026SimpleMem: Efficient Lifelong Memory for LLM Agents5 Jan 2026
- 2025Training Versatile Coding Agents in Synthetic Environments13 Dec 2025
- 2025Fed-SE: Federated Self-Evolution for Privacy-Constrained Multi-Environment LLM Agents9 Dec 2025
- 2026iReasoner: Trajectory-Aware Intrinsic Reasoning Supervision for Self-Evolving Large Multimodal Modelscited by 7
- 2026Paying More Attention to Visual Tokens in Self-Evolving Large Multimodal Modelscited by 6
- 2026LAST: Leveraging Tools as Hints to Enhance Spatial Reasoning for Multimodal Large Language Modelscited by 3
- 2026Seirenes: Adversarial Self-Play with Evolving Distractions for LLM Reasoningcited by 1
- 2026AdaTurn: Budget-Aware Test-Time Scaling for Active Visual Perception Agentscited by 0
- 2026DiffuseAgent-MI: Distributionally-Grounded,Tool-Integrated Self-Evolving Agents for Faithful Visual Reasoningcited by 0
- 2026V-Gym: Enhancing Agentic Visual Reasoning via Skill-Data Co-Evolutioncited by 0
- 2026Trinity: Self-Evolving Vision-Language Models with a Self-Verifiercited by 0
- 2026Trinity: Self-Evolving Vision-Language Models with a Self-Verifier3 Oct 2026
- 2026V-Gym: Enhancing Agentic Visual Reasoning via Skill-Data Co-Evolution28 Sep 2026
- 2026DiffuseAgent-MI: Distributionally-Grounded,Tool-Integrated Self-Evolving Agents for Faithful Visual Reasoning1 Aug 2026
- 2026AdaTurn: Budget-Aware Test-Time Scaling for Active Visual Perception Agents16 Jul 2026
- 2026Paying More Attention to Visual Tokens in Self-Evolving Large Multimodal Models25 Jun 2026
- 2026Seirenes: Adversarial Self-Play with Evolving Distractions for LLM Reasoning12 May 2026
- 2026LAST: Leveraging Tools as Hints to Enhance Spatial Reasoning for Multimodal Large Language Models8 Apr 2026
- 2026iReasoner: Trajectory-Aware Intrinsic Reasoning Supervision for Self-Evolving Large Multimodal Models9 Jan 2026
- 2026One Model, All Roles: Multi-Turn, Multi-Agent Self-Play Reinforcement Learning for Conversational Social Intelligencecited by 7
- 2026Self-evolving Embodied AIcited by 2
- 2026Cognitive-structured Multimodal Agent for Multimodal Understanding, Generation, and Editingcited by 1
- 2026MLToolBench: Learning Tool-Augmented Agents for Machine Learning Developmentcited by 1
- 2026Imperfect Visual Verification for Code Edition : A Case Study on TikZcited by 0
- 2026Evo2: Evolving the Evolver through Weight-Harness Co-Evolutioncited by 0
- 2026Self-Evolving Visual Agent via Margin Rewardcited by 0
- 2026Self-Evolving Visual Agent via Margin Reward10 Oct 2026
- 2026Evo2: Evolving the Evolver through Weight-Harness Co-Evolution9 Oct 2026
- 2026MLToolBench: Learning Tool-Augmented Agents for Machine Learning Development29 Sep 2026
- 2026Cognitive-structured Multimodal Agent for Multimodal Understanding, Generation, and Editing9 Jul 2026
- 2026Imperfect Visual Verification for Code Edition : A Case Study on TikZ9 Apr 2026
- 2026Self-evolving Embodied AI4 Feb 2026
- 2026One Model, All Roles: Multi-Turn, Multi-Agent Self-Play Reinforcement Learning for Conversational Social Intelligence3 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026Evaluating Self-Correcting Vision Agents Through Quantitative and Qualitative Metrics
- 2026RISE: Reliable Improvement in Self-Evolving Vision-Language Models
- 2026Dynamo: Dynamic Skill-Tool Evolution for Vision-Language Agents
- 2026MM-Zero: Self-Evolving Multi-Model Vision Language Models From Zero Data
- 2025SE-VLN: A Self-Evolving Vision-Language Navigation Framework Based on Multimodal Large Language Models
- 2026Active Zero: Self-Evolving Vision-Language Models through Active Environment Exploration
- 2026FaithEyes: Towards Faithful Tool Use via Multi-Agent Process-Image Verification
- 2026Beacon: Knowing When and How to Perform Agentic Visual Reasoning