EviRover: Reinforcing Agentic Perception Beyond a Glance
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Visual perception is conventionally formulated as a one-shot prediction from a single glance at the image, under the assumption that the image content and the model's parametric knowledge suffice to resolve the query. This assumption often fails in real-world scenarios that hinge on fine-grained visual details or require knowledge-intensive and up-to-date information. We term such cases textitperception under insufficient evidence and formulate perception as an agentic process that can obtain information beyond a single glance. To address the absence of data for this setting, we design two dedicated data generation pipelines, yielding EviRover-SFT-5K and EviRover-RL-12K for training. We further construct EviLens, a human-verified benchmark comprising 688 instances across five perception categories. Building on these data, we present EviRover, to our knowledge the first perception agent explicitly trained to resolve perceptual queries through interaction, using supervised fine-tuning followed by agentic reinforcement learning. Experiments show that the 4B EviRover outperforms its backbone by 30 points on average on EviLens, reaching performance comparable to advanced proprietary models. The gains transfer beyond EviLens to WebEyes, conventional perception benchmarks, and general multimodal benchmarks, including a 15-point improvement on BrowseComp-VL. All code, models, and data are released.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 53 of its 63 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
53 of 63 references.
Closest ancestors · 4
Same direction, newest first
- 2026From Web to Pixels: Bringing Agentic Search into Visual Perception12 May
- 2026Towards Long-horizon Agentic Multimodal Search14 Apr
- 2025DeepEyesV2: Toward Agentic Multimodal Model7 Nov
- 2025WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agent7 Aug
Other references · 49
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2015Generation and Comprehension of Unambiguous Object Descriptionscited by 904
- 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 819
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
- 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 512
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 410
- 2016Segmentation from Natural Language Expressionscited by 257
37 more
- 2016Modeling Context Between Objects for Referring Expression Understandingcited by 251
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcementcited by 239
- 2023Can Pre-trained Vision and Language Models Answer Visual Information-Seeking Questions?cited by 207
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 199
- 2025Thyme: Think Beyond Imagescited by 167
- 2025MMSearch-R1: Incentivizing LMMs to Searchcited by 124
- 2025Perception-R1: Pioneering Perception Policy with Reinforcement Learningcited by 120
- 2025Mini-o3: Scaling Up Reasoning Patterns and Interaction Turns for Visual Searchcited by 120
- 2025UniVG-R1: Reasoning Guided Universal Visual Grounding with Reinforcement Learningcited by 84
- 2024CountGD: Multi-Modal Open-World Countingcited by 59
- 2026Seed2.0 Model Card: Towards Intelligence Frontier for Real-World Complexitycited by 58
- 2025OneThinker: All-in-one Reasoning Model for Image and Videocited by 56
- 2026Seed1.8 Model Card: Towards Generalized Real-World Agencycited by 50
- 2026REDSearcher: A Scalable and Cost-Efficient Framework for Long-Horizon Search Agentscited by 49
- 2025SophiaVL-R1: Reinforcing MLLMs Reasoning with Thinking Rewardcited by 45
- 2025Seg-R1: Segmentation Can Be Surprisingly Simple with Reinforcement Learningcited by 44
- 2026MiniMax Sparse Attentioncited by 44
- 2023Open-world Text-specified Object Countingcited by 41
- 2026Vision-DeepResearch: Incentivizing DeepResearch Capability in Multimodal Large Language Modelscited by 37
- 2026Vision-DeepResearch Benchmark: Rethinking Visual and Textual Search for Multimodal Large Language Modelscited by 34
- 2025One RL to See Them All: Visual Triple Unified Reinforcement Learningcited by 30
- 2025X-SAM: From Segment Anything to Any Segmentationcited by 30
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decodingcited by 28
- 2026MM-DeepResearch: A Simple and Effective Multimodal Agentic Search Baselinecited by 20
- 2024SAM-E: Leveraging Visual Foundation Model with Sequence Imitation for Embodied Manipulationcited by 18
- 2025Visual Position Prompt for MLLM based Visual Groundingcited by 16
- 2025Thinking with Programming Vision: Towards a Unified View for Thinking with Imagescited by 15
- 2025GeoSAM2: Unleashing the Power of SAM2 for 3D Part Segmentationcited by 13
- 2026Ref-Adv: Exploring MLLM Visual Reasoning in Referring Expression Taskscited by 9
- 2025CountingDINO: A Training-free Pipeline for Class-Agnostic Counting using Unsupervised Backbonescited by 6
- 2025Referring Expression Comprehension for Small Objectscited by 6
- 2026Seg-ReSearch: Segmentation with Interleaved Reasoning and External Searchcited by 6
- 2026ProMMSearchAgent: A Generalizable Multimodal Search Agent Trained with Process-Oriented Rewardscited by 5
- 2026SearchEyes: Towards Frontier Multimodal Deep Search Intelligence via Search World Simulationcited by 5
- 2025FineRS: Fine-grained Reasoning and Segmentation of Small Objects with Reinforcement Learningcited by 4
- 2025Progressive Multimodal Search and Reasoning for Knowledge-Intensive Visual Question Answeringcited by 3
- 2026ROSE: Retrieval-Oriented Segmentation Enhancementcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Gym-V: A Unified Vision Environment System for Agentic Vision Research
- 2026Bad Seeing or Bad Thinking? Rewarding Perception for Multimodal Reasoning
- 2025DICEPTION: A Generalist Diffusion Model for Visual Perceptual Tasks
- 2026AdaTurn: Budget-Aware Test-Time Scaling for Active Visual Perception Agents
- 2026MNIST-PRO: MNIST is Back as a Partially Observable World for AI Agents
- 2026Waking Up Blind: Cold-Start Optimization of Supervision-Free Agentic Trajectories for Grounded Visual Perception
- 2026An Evolutionary Agentic Approach for Open-ended Image Quality Perception
- 2026Agentic Discovery with Active Hypothesis Exploration for Visual Recognition