mlsanityData to 7 Oct 2026

LensWalk: Agentic Video Understanding by Planning How You See in Videos

arXiv 2603.24558 ↗First posted 25 Mar 2026cs.CV cs.AIcited by 14

On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs

also in 1 more
Abstract (arXiv)

The dense, temporal nature of video presents a profound challenge for automated analysis. Despite the use of powerful Vision-Language Models, prevailing methods for video understanding are limited by the inherent disconnect between reasoning and perception: they rely on static, pre-processed information and cannot actively seek raw evidence from video as their understanding evolves. To address this, we introduce LensWalk, a flexible agentic framework that empowers a Large Language Model reasoner to control its own visual observation actively. LensWalk establishes a tight reason-plan-observe loop where the agent dynamically specifies, at each step, the temporal scope and sampling density of the video it observes. Using a suite of versatile, Vision-Language Model based tools parameterized by these specifications, the agent can perform broad scans for cues, focus on specific segments for fact extraction, and stitch evidence from multiple moments for holistic verification. This design allows for progressive, on-demand evidence gathering that directly serves the agent's evolving chain of thought. Without requiring any model fine-tuning, LensWalk delivers substantial, plug-and-play performance gains on multiple model recipes, boosting their accuracy by over 5% on challenging long-video benchmarks like LVBench and Video-MME. Our analysis reveals that enabling an agent to control how it sees is key to unlocking more accurate, robust, and interpretable video reasoning.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 55 of its 66 references that are in the map. First posted on arXiv 25 Mar 2026.

Builds on

55 of 66 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025Q-Frame: Query-aware Frame Selection and Multi-Resolution Adaptation for Video-LLMs27 Jun
  2. 2025CyberV: Cybernetics for Test-time Scaling in Video Understanding9 Jun
  3. 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
  4. 2025BOLT: Boost Large Vision-Language Model Without Training for Long-form Video Understanding27 Mar
  5. 2025AdaReTaKe: Adaptive Redundancy Reduction to Perceive Longer for Video-language Understanding16 Mar
  6. 2025Adaptive Keyframe Sampling for Long Video Understanding28 Feb
  7. 2025M-LLM Based Video Frame Selection for Efficient Video Understanding27 Feb
  8. 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understanding22 Oct
  9. 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understanding22 Jul
  10. 2024LVBench: An Extreme Long Video Understanding Benchmark12 Jun
  11. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis31 May

Other references · 44

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2023Visual Instruction Tuningcited by 7,792
  3. 2025Qwen2.5-VL Technical Reportcited by 5,418
  4. 2024GPT-4o System Cardcited by 4,467
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  6. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  7. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
  8. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
  9. 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,033
  10. 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 666
  11. 2023ViperGPT: Visual Inference via Python Execution for Reasoningcited by 591
  12. 2023MovieChat: From Dense Token to Sparse Memory for Long Video Understandingcited by 536
32 more
  1. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 398
  2. 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 377
  3. 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agentcited by 323
  4. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 267
  5. 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 225
  6. 2025OpenThinkIMG: Learning to Think with Images via Visual Tool Reinforcement Learningcited by 163
  7. 2025Thyme: Think Beyond Imagescited by 160
  8. 2024Aria: An Open Multimodal Native Mixture-of-Experts Modelcited by 136
  9. 2025MMVU: Measuring Expert-Level Multi-Discipline Video Understandingcited by 131
  10. 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawingcited by 130
  11. 2025MMSearch-R1: Incentivizing LMMs to Searchcited by 120
  12. 2024MMSearch: Benchmarking the Potential of Large Models as Multi-modal Search Enginescited by 98
  13. 2025Deep Video Discovery: Agentic Search with Tool Use for Long-form Video Understandingcited by 94
  14. 2025Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memorycited by 88
  15. 2025Visual Planning: Let's Think Only with Imagescited by 85
  16. 2025VTool-R1: VLMs Learn to Think with Images via Reinforcement Learning on Multimodal Tool Usecited by 84
  17. 2024Frame-Voyager: Learning to Query Frames for Video Large Language Modelscited by 80
  18. 2025VideoRAG: Retrieval-Augmented Generation with Extreme Long-Context Videoscited by 76
  19. 2024Too Many Frames, Not All Useful: Efficient Strategies for Long-Form Video QAcited by 68
  20. 2025VRAG-RL: Empower Vision-Perception-Based RAG for Visually Rich Information Understanding via Iterative Reasoning with Reinforcement Learningcited by 68
  21. 2025Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoningcited by 67
  22. 2024MindSearch: Mimicking Human Minds Elicits Deep AI Searchercited by 65
  23. 2024VCA: Video Curious Agent for Long Video Understandingcited by 54
  24. 2025Visual Agentic Reinforcement Fine-Tuningcited by 53
  25. 2025ReAgent-V: A Reward-Driven Multi-Agent Framework for Video Understandingcited by 50
  26. 2025VLM-R3: Region Recognition, Reasoning, and Refinement for Enhanced Multimodal Chain-of-Thoughtcited by 47
  27. 2025Ground-R1: Incentivizing Grounded Visual Reasoning via Reinforcement Learningcited by 46
  28. 2025Video-RTS: Rethinking Reinforcement Learning and Test-Time Scaling for Efficient and Enhanced Video Reasoningcited by 29
  29. 2024PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language Modelscited by 25
  30. 2025MR. Video: "MapReduce" is the Principle for Long Video Understandingcited by 23
  31. 2025FlexSelect: Flexible Token Selection for Efficient Long Video Understandingcited by 17
  32. 2025M2IO-R1: An Efficient RL-Enhanced Reasoning Framework for Multimodal Retrieval Augmented Multimodal Generationcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 14.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025Agentic Video Intelligence: A Flexible Framework for Advanced Video Exploration and Understanding
  2. 2026VideoSeeker: Incentivizing Instance-level Video Understanding via Native Agentic Tool Invocation
  3. 2026Scaling Video Understanding via Compact Latent Multi-Agent Collaboration
  4. 2026VideoScout: Learning Agentic Active Exploration with Adaptive Reasoning Pacing for Long Video Understanding
  5. 2025Active Video Perception: Iterative Evidence Seeking for Agentic Long Video Understanding
  6. 2026VideoSeek: Long-Horizon Video Agent with Tool-Guided Seeking
  7. 2026VideoThinker: Building Agentic VideoLLMs with LLM-Guided Tool Reasoning
  8. 2025VideoZoomer: Reinforcement-Learned Temporal Focusing for Long Video Reasoning