Seeking and Updating with Live Visual Knowledge
Not on the map. Why?
Abstract (arXiv)
The visual world around us constantly evolves, from real-time news and social media trends to global infrastructure changes visible through satellite imagery and augmented reality enhancements. However, Multimodal Large Language Models (MLLMs), which automate many tasks, struggle to stay current, limited by the cutoff dates in their fixed training datasets. To quantify this stagnation, we introduce LiveVQA, the first-of-its-kind dataset featuring 107,143 samples and 12 categories data specifically designed to support research in both seeking and updating with live visual knowledge. Drawing from recent news articles, video platforms, and academic publications in April 2024-May 2025, LiveVQA enables evaluation of how models handle latest visual information beyond their knowledge boundaries and how current methods help to update them. Our comprehensive benchmarking of 17 state-of-the-art MLLMs reveals significant performance gaps on content beyond knowledge cutoff, and tool-use or agentic visual seeking framework drastically gain an average of 327% improvement. Furthermore, we explore parameter-efficient fine-tuning (PEFT) methods to update MLLMs with new visual knowledge. We dive deeply to the critical balance between adapter capacity and model capability when updating MLLMs with new visual knowledge. All the experimental dataset and source code are publicly available at: https://livevqa.github.io.
Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). First posted on arXiv 7 Apr 2025.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2025: 4; 2026: 20.
24 papers.
Sort:
By area:
- 2026Vision-DeepResearch Benchmark: Rethinking Visual and Textual Search for Multimodal Large Language Modelscited by 34
- 2025SenseNova-MARS: Empowering Multimodal Agentic Reasoning and Search via Reinforcement Learningcited by 33
- 2025Video-Browser: Towards Agentic Open-web Video Browsingcited by 10
- 2026HyperEyes: Dual-Grained Efficiency-Aware Reinforcement Learning for Parallel Multimodal Search Agentscited by 10
- 2026BrowseComp-V3: A Visual, Vertical, and Verifiable Benchmark for Multimodal Browsing Agentscited by 8
- 2026Visual-Seeker: Towards Visual-Native Multimodal Agentic Search via Active Visual Reasoningcited by 8
- 2025MINED: Probing and Updating with Multimodal Time-Sensitive Knowledge for Large Multimodal Modelscited by 7
- 2026MTA-Agent: An Open Recipe for Multimodal Deep Search Agentscited by 7
- 2026SUPERGLASSES: Benchmarking Vision Language Models as Intelligent Agents for AI Smart Glassescited by 6
- 2026MMKU-Bench: A Multimodal Update Benchmark for Diverse Visual Knowledgecited by 5
- 2026S1-DeepResearch: Beyond Search, Toward Real-World Long-Horizon Research Agentscited by 5
- 2026VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learningcited by 5
12 more
- 2026Glance-or-Gaze: Incentivizing LMMs to Adaptively Focus Search via Reinforcement Learningcited by 4
- 2025Progressive Multimodal Search and Reasoning for Knowledge-Intensive Visual Question Answeringcited by 3
- 2026PIXELRAG: Web Screenshots Beat Text for Retrieval-Augmented Generationcited by 2
- 2026DeepVoyager-VL: Incentivizing Vision-in-the-Loop Search for Long-Horizon Multimodal Agentscited by 2
- 2026POINTS-Seeker: An Open Recipe for Multimodal Search Agents with Visual Memory Managementcited by 1
- 2026Eliciting Self-Verification in Multimodal Reasoning Agents with Reinforcement Learningcited by 1
- 2026LiteSearch-VL: Small Multimodal Search Agents via Trajectory Distillation and Synthetic Step-DPOcited by 0
- 2026Dependency-Aware Trajectory Refinement for Efficient Multi-Turn Agent Fine-Tuningcited by 0
- 2026MM-ContextFold: Context Folding for Multimodal Agentic Retrievalcited by 0
- 2026SCAD: Structured Credit Assignment and Distillation for Long-Horizon Agentscited by 0
- 2026Harness Compilation: Which Decisions Should a Small Vision-Language Model Keep?cited by 0
- 2026OneSearch-VL: Unified Multimodal Deep Research Agent for Image and Videocited by 0
- 2026OneSearch-VL: Unified Multimodal Deep Research Agent for Image and Video8 Oct 2026
- 2026Harness Compilation: Which Decisions Should a Small Vision-Language Model Keep?8 Oct 2026
- 2026SCAD: Structured Credit Assignment and Distillation for Long-Horizon Agents2 Oct 2026
- 2026MM-ContextFold: Context Folding for Multimodal Agentic Retrieval19 Sep 2026
- 2026Dependency-Aware Trajectory Refinement for Efficient Multi-Turn Agent Fine-Tuning16 Sep 2026
- 2026Eliciting Self-Verification in Multimodal Reasoning Agents with Reinforcement Learning7 Sep 2026
- 2026LiteSearch-VL: Small Multimodal Search Agents via Trajectory Distillation and Synthetic Step-DPO29 Aug 2026
- 2026DeepVoyager-VL: Incentivizing Vision-in-the-Loop Search for Long-Horizon Multimodal Agents3 Aug 2026
- 2026VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learning3 Jul 2026
- 2026S1-DeepResearch: Beyond Search, Toward Real-World Long-Horizon Research Agents13 Jun 2026
- 2026Visual-Seeker: Towards Visual-Native Multimodal Agentic Search via Active Visual Reasoning13 Jun 2026
- 2026PIXELRAG: Web Screenshots Beat Text for Retrieval-Augmented Generation1 Jun 2026
12 more
- 2026HyperEyes: Dual-Grained Efficiency-Aware Reinforcement Learning for Parallel Multimodal Search Agents8 May 2026
- 2026POINTS-Seeker: An Open Recipe for Multimodal Search Agents with Visual Memory Management15 Apr 2026
- 2026MTA-Agent: An Open Recipe for Multimodal Deep Search Agents7 Apr 2026
- 2026MMKU-Bench: A Multimodal Update Benchmark for Diverse Visual Knowledge16 Mar 2026
- 2026SUPERGLASSES: Benchmarking Vision Language Models as Intelligent Agents for AI Smart Glasses26 Feb 2026
- 2026BrowseComp-V3: A Visual, Vertical, and Verifiable Benchmark for Multimodal Browsing Agents13 Feb 2026
- 2026Vision-DeepResearch Benchmark: Rethinking Visual and Textual Search for Multimodal Large Language Models2 Feb 2026
- 2026Glance-or-Gaze: Incentivizing LMMs to Adaptively Focus Search via Reinforcement Learning20 Jan 2026
- 2025SenseNova-MARS: Empowering Multimodal Agentic Reasoning and Search via Reinforcement Learning30 Dec 2025
- 2025Video-Browser: Towards Agentic Open-web Video Browsing28 Dec 2025
- 2025MINED: Probing and Updating with Multimodal Time-Sensitive Knowledge for Large Multimodal Models22 Oct 2025
- 2025Progressive Multimodal Search and Reasoning for Knowledge-Intensive Visual Question Answering31 Aug 2025
- 2026BrowseComp-V3: A Visual, Vertical, and Verifiable Benchmark for Multimodal Browsing Agentscited by 8
- 2025MINED: Probing and Updating with Multimodal Time-Sensitive Knowledge for Large Multimodal Modelscited by 7
- 2026MTA-Agent: An Open Recipe for Multimodal Deep Search Agentscited by 7
- 2026SUPERGLASSES: Benchmarking Vision Language Models as Intelligent Agents for AI Smart Glassescited by 6
- 2026Glance-or-Gaze: Incentivizing LMMs to Adaptively Focus Search via Reinforcement Learningcited by 4
- 2026DeepVoyager-VL: Incentivizing Vision-in-the-Loop Search for Long-Horizon Multimodal Agentscited by 2
- 2026POINTS-Seeker: An Open Recipe for Multimodal Search Agents with Visual Memory Managementcited by 1
- 2026Harness Compilation: Which Decisions Should a Small Vision-Language Model Keep?cited by 0
- 2026Harness Compilation: Which Decisions Should a Small Vision-Language Model Keep?8 Oct 2026
- 2026DeepVoyager-VL: Incentivizing Vision-in-the-Loop Search for Long-Horizon Multimodal Agents3 Aug 2026
- 2026POINTS-Seeker: An Open Recipe for Multimodal Search Agents with Visual Memory Management15 Apr 2026
- 2026MTA-Agent: An Open Recipe for Multimodal Deep Search Agents7 Apr 2026
- 2026SUPERGLASSES: Benchmarking Vision Language Models as Intelligent Agents for AI Smart Glasses26 Feb 2026
- 2026BrowseComp-V3: A Visual, Vertical, and Verifiable Benchmark for Multimodal Browsing Agents13 Feb 2026
- 2026Glance-or-Gaze: Incentivizing LMMs to Adaptively Focus Search via Reinforcement Learning20 Jan 2026
- 2025MINED: Probing and Updating with Multimodal Time-Sensitive Knowledge for Large Multimodal Models22 Oct 2025
- 2025Video-Browser: Towards Agentic Open-web Video Browsingcited by 10
- 2026S1-DeepResearch: Beyond Search, Toward Real-World Long-Horizon Research Agentscited by 5
- 2026LiteSearch-VL: Small Multimodal Search Agents via Trajectory Distillation and Synthetic Step-DPOcited by 0
- 2026Dependency-Aware Trajectory Refinement for Efficient Multi-Turn Agent Fine-Tuningcited by 0
- 2026MM-ContextFold: Context Folding for Multimodal Agentic Retrievalcited by 0
- 2026OneSearch-VL: Unified Multimodal Deep Research Agent for Image and Videocited by 0
- 2026OneSearch-VL: Unified Multimodal Deep Research Agent for Image and Video8 Oct 2026
- 2026MM-ContextFold: Context Folding for Multimodal Agentic Retrieval19 Sep 2026
- 2026Dependency-Aware Trajectory Refinement for Efficient Multi-Turn Agent Fine-Tuning16 Sep 2026
- 2026LiteSearch-VL: Small Multimodal Search Agents via Trajectory Distillation and Synthetic Step-DPO29 Aug 2026
- 2026S1-DeepResearch: Beyond Search, Toward Real-World Long-Horizon Research Agents13 Jun 2026
- 2025Video-Browser: Towards Agentic Open-web Video Browsing28 Dec 2025
- 2026Vision-DeepResearch Benchmark: Rethinking Visual and Textual Search for Multimodal Large Language Modelscited by 34
- 2025SenseNova-MARS: Empowering Multimodal Agentic Reasoning and Search via Reinforcement Learningcited by 33
- 2026Visual-Seeker: Towards Visual-Native Multimodal Agentic Search via Active Visual Reasoningcited by 8
- 2026VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learningcited by 5
- 2026Eliciting Self-Verification in Multimodal Reasoning Agents with Reinforcement Learningcited by 1
- 2026Eliciting Self-Verification in Multimodal Reasoning Agents with Reinforcement Learning7 Sep 2026
- 2026VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learning3 Jul 2026
- 2026Visual-Seeker: Towards Visual-Native Multimodal Agentic Search via Active Visual Reasoning13 Jun 2026
- 2026Vision-DeepResearch Benchmark: Rethinking Visual and Textual Search for Multimodal Large Language Models2 Feb 2026
- 2025SenseNova-MARS: Empowering Multimodal Agentic Reasoning and Search via Reinforcement Learning30 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025VKnowU: Evaluating Visual Knowledge Understanding in Multimodal LLMs
- 2026WorldVQA: Measuring Atomic World Knowledge in Multimodal Large Language Models
- 2026MMBench-Live: A Continuously Evolving Benchmark for Multimodal Models
- 2026V-DyKnow: A Dynamic Benchmark for Time-Sensitive Knowledge in Vision Language Models
- 2025MAC: A Live Benchmark for Multimodal Large Language Models in Scientific Understanding
- 2025A Survey of State of the Art Large Vision Language Models: Alignment, Benchmark, Evaluations and Challenges
- 2024Exploring the Frontier of Vision-Language Models: A Survey of Current Methodologies and Future Directions
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling