mlsanityData to 7 Oct 2026

StreamingClaw Technical Report

arXiv 2603.22120 ↗First posted 23 Mar 2026cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Emerging applications such as embodied intelligence, AI hardware, autonomous driving, and intelligent cockpits rely on a real-time perception-decision-action closed loop, posing stringent challenges for streaming video understanding. However, current agents mostly suffer from fragmented capabilities, such as supporting only offline video understanding, lacking long-term multimodal memory mechanisms, or struggling to achieve real-time reasoning and proactive interaction under streaming input. These shortcomings have become a key bottleneck for preventing agents from sustaining perception, making real-time decisions, and executing closed-loop actions in complex real-world environments, constraining their deployment and potential in dynamic, open physical worlds. To alleviate these issues, we propose StreamingClaw, a unified agent framework for streaming video understanding and embodied intelligence. Beyond maintaining full compatibility with the OpenClaw framework, it natively supports real-time, multimodal streaming interactions. StreamingClaw integrates five core capabilities: (1) It supports real-time streaming reasoning. (2) It supports reasoning about future events and proactive interaction under the online evolution of interaction objectives. (3) It supports multimodal long-term memory storage, hierarchical memory evolution, efficient memory retrieval, and memory sharing across multiple agents. (4) It supports a closed loop of perception-decision-action. In addition to conventional tools and skills, it also provides streaming tools and action-centric skills tailored for real-world physical environments. (5) It is compatible with the OpenClaw framework, allowing it to leverage the resources and support of the open-source community.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 43 of its 49 references that are in the map. First posted on arXiv 23 Mar 2026.

Builds on

43 of 49 references.

References · 43

  1. 2017Attention Is All You Needcited by 59,932
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  4. 2025Qwen3-VL Technical Reportcited by 2,534
  5. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 398
  6. 2021A Survey of Embodied AI: From Simulators to Research Taskscited by 256
  7. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 193
  8. 2025MIRIX: Multi-Agent Memory System for LLM-Based Agentscited by 160
  9. 2025Adaptive Keyframe Sampling for Long Video Understandingcited by 153
  10. 2026SimpleMem: Efficient Lifelong Memory for LLM Agentscited by 140
  11. 2024A Survey on Large Language Model Acceleration based on KV Cache Managementcited by 125
  12. 2025Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reactioncited by 122
31 more
  1. 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 119
  2. 2025Beyond Binary Rewards: Training LMs to Reason About Their Uncertaintycited by 107
  3. 2024DyCoke: Dynamic Compression of Tokens for Fast Video Large Language Modelscited by 93
  4. 2025TimeChat-Online: 80% Visual Tokens are Naturally Redundant in Streaming Videoscited by 90
  5. 2025StreamingVLM: Real-Time Understanding for Infinite Video Streamscited by 89
  6. 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoningcited by 88
  7. 2025Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memorycited by 88
  8. 2025M-LLM Based Video Frame Selection for Efficient Video Understandingcited by 87
  9. 2024A Review of Prominent Paradigms for LLM-Based Agents: Tool Use (Including RAG), Planning, and Feedback Learningcited by 74
  10. 2025Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledgecited by 68
  11. 2024LLM With Tools: A Surveycited by 60
  12. 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Callingcited by 58
  13. 2025Embodied AI Agents: Modeling the Worldcited by 57
  14. 2025StreamBridge: Turning Your Offline Video Large Language Model into a Proactive Streaming Assistantcited by 56
  15. 2024Automatic Speech Recognition using Advanced Deep Learning Approaches: A surveycited by 50
  16. 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Modelscited by 50
  17. 2025Open-o3-Video: Grounded Video Reasoning with Explicit Spatio-Temporal Evidencecited by 43
  18. 2025StreamingTOM: Streaming Token Compression for Efficient Video Understandingcited by 41
  19. 2025Foundation Models in Autonomous Driving: A Survey on Scenario Generation and Scenario Analysiscited by 37
  20. 2025StreamAgent: Towards Anticipatory Agents for Streaming Video Understandingcited by 29
  21. 2025Streaming Video Instruction Tuningcited by 25
  22. 2024AIC MLLM: Autonomous Interactive Correction MLLM for Robust Robotic Manipulationcited by 20
  23. 2024AD-H: Language-guided Autonomous Driving with Hierarchical Agentscited by 15
  24. 2025Generative Multi-Agent Collaboration in Embodied AI: A Systematic Reviewcited by 13
  25. 2025Reinforcement Fine-Tuning Powers Reasoning Capability of Multimodal Large Language Modelscited by 13
  26. 2025CLiViS: Unleashing Cognitive Map through Linguistic-Visual Synergy for Embodied Visual Reasoningcited by 13
  27. 2025MindGPT-4ov: An Enhanced MLLM via a Multi-Stage Post-Training Paradigmcited by 9
  28. 2025SAGE: Training Smart Any-Horizon Agents for Long Video Reasoning with Reinforcement Learningcited by 6
  29. 2025MindWatcher: Toward Smarter Multimodal Tool-Integrated Reasoningcited by 6
  30. 2026Evolving from Tool User to Creator via Training-Free Experience Reuse in Multimodal Reasoningcited by 6
  31. 2025COPO: Consistency-Aware Policy Optimizationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.