LensWalk: Agentic Video Understanding by Planning How You See in Videos
On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs
also in 1 more
Abstract (arXiv)
The dense, temporal nature of video presents a profound challenge for automated analysis. Despite the use of powerful Vision-Language Models, prevailing methods for video understanding are limited by the inherent disconnect between reasoning and perception: they rely on static, pre-processed information and cannot actively seek raw evidence from video as their understanding evolves. To address this, we introduce LensWalk, a flexible agentic framework that empowers a Large Language Model reasoner to control its own visual observation actively. LensWalk establishes a tight reason-plan-observe loop where the agent dynamically specifies, at each step, the temporal scope and sampling density of the video it observes. Using a suite of versatile, Vision-Language Model based tools parameterized by these specifications, the agent can perform broad scans for cues, focus on specific segments for fact extraction, and stitch evidence from multiple moments for holistic verification. This design allows for progressive, on-demand evidence gathering that directly serves the agent's evolving chain of thought. Without requiring any model fine-tuning, LensWalk delivers substantial, plug-and-play performance gains on multiple model recipes, boosting their accuracy by over 5% on challenging long-video benchmarks like LVBench and Video-MME. Our analysis reveals that enabling an agent to control how it sees is key to unlocking more accurate, robust, and interpretable video reasoning.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 55 of its 66 references that are in the map. First posted on arXiv 25 Mar 2026.
Builds on
55 of 66 references.
Closest ancestors · 11
Same direction, newest first
- 2025Q-Frame: Query-aware Frame Selection and Multi-Resolution Adaptation for Video-LLMs27 Jun
- 2025CyberV: Cybernetics for Test-time Scaling in Video Understanding9 Jun
- 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
- 2025BOLT: Boost Large Vision-Language Model Without Training for Long-form Video Understanding27 Mar
- 2025AdaReTaKe: Adaptive Redundancy Reduction to Perceive Longer for Video-language Understanding16 Mar
- 2025Adaptive Keyframe Sampling for Long Video Understanding28 Feb
- 2025M-LLM Based Video Frame Selection for Efficient Video Understanding27 Feb
- 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understanding22 Oct
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understanding22 Jul
- 2024LVBench: An Extreme Long Video Understanding Benchmark12 Jun
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis31 May
Other references · 44
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Visual Instruction Tuningcited by 7,792
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
- 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,033
- 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 666
- 2023ViperGPT: Visual Inference via Python Execution for Reasoningcited by 591
- 2023MovieChat: From Dense Token to Sparse Memory for Long Video Understandingcited by 536
32 more
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 398
- 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 377
- 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agentcited by 323
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 267
- 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 225
- 2025OpenThinkIMG: Learning to Think with Images via Visual Tool Reinforcement Learningcited by 163
- 2025Thyme: Think Beyond Imagescited by 160
- 2024Aria: An Open Multimodal Native Mixture-of-Experts Modelcited by 136
- 2025MMVU: Measuring Expert-Level Multi-Discipline Video Understandingcited by 131
- 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawingcited by 130
- 2025MMSearch-R1: Incentivizing LMMs to Searchcited by 120
- 2024MMSearch: Benchmarking the Potential of Large Models as Multi-modal Search Enginescited by 98
- 2025Deep Video Discovery: Agentic Search with Tool Use for Long-form Video Understandingcited by 94
- 2025Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memorycited by 88
- 2025Visual Planning: Let's Think Only with Imagescited by 85
- 2025VTool-R1: VLMs Learn to Think with Images via Reinforcement Learning on Multimodal Tool Usecited by 84
- 2024Frame-Voyager: Learning to Query Frames for Video Large Language Modelscited by 80
- 2025VideoRAG: Retrieval-Augmented Generation with Extreme Long-Context Videoscited by 76
- 2024Too Many Frames, Not All Useful: Efficient Strategies for Long-Form Video QAcited by 68
- 2025VRAG-RL: Empower Vision-Perception-Based RAG for Visually Rich Information Understanding via Iterative Reasoning with Reinforcement Learningcited by 68
- 2025Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoningcited by 67
- 2024MindSearch: Mimicking Human Minds Elicits Deep AI Searchercited by 65
- 2024VCA: Video Curious Agent for Long Video Understandingcited by 54
- 2025Visual Agentic Reinforcement Fine-Tuningcited by 53
- 2025ReAgent-V: A Reward-Driven Multi-Agent Framework for Video Understandingcited by 50
- 2025VLM-R3: Region Recognition, Reasoning, and Refinement for Enhanced Multimodal Chain-of-Thoughtcited by 47
- 2025Ground-R1: Incentivizing Grounded Visual Reasoning via Reinforcement Learningcited by 46
- 2025Video-RTS: Rethinking Reinforcement Learning and Test-Time Scaling for Efficient and Enhanced Video Reasoningcited by 29
- 2024PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language Modelscited by 25
- 2025MR. Video: "MapReduce" is the Principle for Long Video Understandingcited by 23
- 2025FlexSelect: Flexible Token Selection for Efficient Long Video Understandingcited by 17
- 2025M2IO-R1: An Efficient RL-Enhanced Reasoning Framework for Multimodal Retrieval Augmented Multimodal Generationcited by 7
Built on by
Citing papers per year: 2026: 14.
14 papers.
Sort:
By area:
- 2026Personal Visual Context Learning in Large Multimodal Modelscited by 2
- 2026Sandboxed Coding Agents are Competitive Omni-modal Task Solverscited by 2
- 2026TRACE: Temporal Retrieval with Anchored and Convergent Evidence for Long-Horizon Video Understandingcited by 2
- 2026Routing Before Looking: Query-Adaptive Evidence Acquisition for Long-form Video Understandingcited by 1
- 2026AgenticVAU: Multi-Agent Explore-Verify Reasoning for Video Anomaly Understandingcited by 0
- 2026VeriPhy: Agentic Physical Reasoning for World Model Evaluation and Refinementcited by 0
- 2026VideoResearcher: Self-Improving Tool Design for Long-Video Understandingcited by 0
- 2026Agentic Video Understanding: A Surveycited by 0
- 2026Probe to Act: Elevating Browser-Use Agent via Active Visual Probingcited by 0
- 2026S4VY: Segment Anything in Feed-Forward 4D Visual Geometrycited by 0
- 2026VideoLoop: Looped Working Memory Against Semantic Thrashing in Long-Form Video Agentscited by 0
- 2026VidHarness: Evolving Agent Harnesses for Cost-Efficient Long Video Understandingcited by 0
- 2026VAMR: Multi-Question Agentic Reasoning for Efficient Long-Form Video Understanding8 Oct 2026
- 2026Video Evidence Indexing: Learning Where to Look from Video Previews for Token-Budgeted Long-Video Question Answering30 Sep 2026
- 2026VidHarness: Evolving Agent Harnesses for Cost-Efficient Long Video Understanding29 Sep 2026
- 2026VideoLoop: Looped Working Memory Against Semantic Thrashing in Long-Form Video Agents29 Sep 2026
- 2026S4VY: Segment Anything in Feed-Forward 4D Visual Geometry29 Sep 2026
- 2026Probe to Act: Elevating Browser-Use Agent via Active Visual Probing27 Sep 2026
- 2026Agentic Video Understanding: A Survey21 Sep 2026
- 2026VideoResearcher: Self-Improving Tool Design for Long-Video Understanding17 Sep 2026
- 2026VeriPhy: Agentic Physical Reasoning for World Model Evaluation and Refinement2 Sep 2026
- 2026TRACE: Temporal Retrieval with Anchored and Convergent Evidence for Long-Horizon Video Understanding23 Aug 2026
- 2026Routing Before Looking: Query-Adaptive Evidence Acquisition for Long-form Video Understanding21 Aug 2026
- 2026AgenticVAU: Multi-Agent Explore-Verify Reasoning for Video Anomaly Understanding4 Aug 2026
2 more
- 2026Agentic Video Understanding: A Surveycited by 0
- 2026Agentic Video Understanding: A Survey21 Sep 2026
- 2026TRACE: Temporal Retrieval with Anchored and Convergent Evidence for Long-Horizon Video Understandingcited by 2
- 2026Routing Before Looking: Query-Adaptive Evidence Acquisition for Long-form Video Understandingcited by 1
- 2026AgenticVAU: Multi-Agent Explore-Verify Reasoning for Video Anomaly Understandingcited by 0
- 2026VideoResearcher: Self-Improving Tool Design for Long-Video Understandingcited by 0
- 2026Probe to Act: Elevating Browser-Use Agent via Active Visual Probingcited by 0
- 2026S4VY: Segment Anything in Feed-Forward 4D Visual Geometrycited by 0
- 2026Video Evidence Indexing: Learning Where to Look from Video Previews for Token-Budgeted Long-Video Question Answeringcited by 0
- 2026VAMR: Multi-Question Agentic Reasoning for Efficient Long-Form Video Understandingcited by 0
- 2026VAMR: Multi-Question Agentic Reasoning for Efficient Long-Form Video Understanding8 Oct 2026
- 2026Video Evidence Indexing: Learning Where to Look from Video Previews for Token-Budgeted Long-Video Question Answering30 Sep 2026
- 2026S4VY: Segment Anything in Feed-Forward 4D Visual Geometry29 Sep 2026
- 2026Probe to Act: Elevating Browser-Use Agent via Active Visual Probing27 Sep 2026
- 2026VideoResearcher: Self-Improving Tool Design for Long-Video Understanding17 Sep 2026
- 2026TRACE: Temporal Retrieval with Anchored and Convergent Evidence for Long-Horizon Video Understanding23 Aug 2026
- 2026Routing Before Looking: Query-Adaptive Evidence Acquisition for Long-form Video Understanding21 Aug 2026
- 2026AgenticVAU: Multi-Agent Explore-Verify Reasoning for Video Anomaly Understanding4 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2025Agentic Video Intelligence: A Flexible Framework for Advanced Video Exploration and Understanding
- 2026VideoSeeker: Incentivizing Instance-level Video Understanding via Native Agentic Tool Invocation
- 2026Scaling Video Understanding via Compact Latent Multi-Agent Collaboration
- 2026VideoScout: Learning Agentic Active Exploration with Adaptive Reasoning Pacing for Long Video Understanding
- 2025Active Video Perception: Iterative Evidence Seeking for Agentic Long Video Understanding
- 2026VideoSeek: Long-Horizon Video Agent with Tool-Guided Seeking
- 2026VideoThinker: Building Agentic VideoLLMs with LLM-Guided Tool Reasoning
- 2025VideoZoomer: Reinforcement-Learned Temporal Focusing for Long Video Reasoning