StreamingClaw Technical Report
Not on the map. Why?
Abstract (arXiv)
Emerging applications such as embodied intelligence, AI hardware, autonomous driving, and intelligent cockpits rely on a real-time perception-decision-action closed loop, posing stringent challenges for streaming video understanding. However, current agents mostly suffer from fragmented capabilities, such as supporting only offline video understanding, lacking long-term multimodal memory mechanisms, or struggling to achieve real-time reasoning and proactive interaction under streaming input. These shortcomings have become a key bottleneck for preventing agents from sustaining perception, making real-time decisions, and executing closed-loop actions in complex real-world environments, constraining their deployment and potential in dynamic, open physical worlds. To alleviate these issues, we propose StreamingClaw, a unified agent framework for streaming video understanding and embodied intelligence. Beyond maintaining full compatibility with the OpenClaw framework, it natively supports real-time, multimodal streaming interactions. StreamingClaw integrates five core capabilities: (1) It supports real-time streaming reasoning. (2) It supports reasoning about future events and proactive interaction under the online evolution of interaction objectives. (3) It supports multimodal long-term memory storage, hierarchical memory evolution, efficient memory retrieval, and memory sharing across multiple agents. (4) It supports a closed loop of perception-decision-action. In addition to conventional tools and skills, it also provides streaming tools and action-centric skills tailored for real-world physical environments. (5) It is compatible with the OpenClaw framework, allowing it to leverage the resources and support of the open-source community.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 43 of its 49 references that are in the map. First posted on arXiv 23 Mar 2026.
Builds on
43 of 49 references.
References · 43
- 2017Attention Is All You Needcited by 59,932
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 398
- 2021A Survey of Embodied AI: From Simulators to Research Taskscited by 256
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 193
- 2025MIRIX: Multi-Agent Memory System for LLM-Based Agentscited by 160
- 2025Adaptive Keyframe Sampling for Long Video Understandingcited by 153
- 2026SimpleMem: Efficient Lifelong Memory for LLM Agentscited by 140
- 2024A Survey on Large Language Model Acceleration based on KV Cache Managementcited by 125
- 2025Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reactioncited by 122
31 more
- 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 119
- 2025Beyond Binary Rewards: Training LMs to Reason About Their Uncertaintycited by 107
- 2024DyCoke: Dynamic Compression of Tokens for Fast Video Large Language Modelscited by 93
- 2025TimeChat-Online: 80% Visual Tokens are Naturally Redundant in Streaming Videoscited by 90
- 2025StreamingVLM: Real-Time Understanding for Infinite Video Streamscited by 89
- 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoningcited by 88
- 2025Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memorycited by 88
- 2025M-LLM Based Video Frame Selection for Efficient Video Understandingcited by 87
- 2024A Review of Prominent Paradigms for LLM-Based Agents: Tool Use (Including RAG), Planning, and Feedback Learningcited by 74
- 2025Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledgecited by 68
- 2024LLM With Tools: A Surveycited by 60
- 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Callingcited by 58
- 2025Embodied AI Agents: Modeling the Worldcited by 57
- 2025StreamBridge: Turning Your Offline Video Large Language Model into a Proactive Streaming Assistantcited by 56
- 2024Automatic Speech Recognition using Advanced Deep Learning Approaches: A surveycited by 50
- 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Modelscited by 50
- 2025Open-o3-Video: Grounded Video Reasoning with Explicit Spatio-Temporal Evidencecited by 43
- 2025StreamingTOM: Streaming Token Compression for Efficient Video Understandingcited by 41
- 2025Foundation Models in Autonomous Driving: A Survey on Scenario Generation and Scenario Analysiscited by 37
- 2025StreamAgent: Towards Anticipatory Agents for Streaming Video Understandingcited by 29
- 2025Streaming Video Instruction Tuningcited by 25
- 2024AIC MLLM: Autonomous Interactive Correction MLLM for Robust Robotic Manipulationcited by 20
- 2024AD-H: Language-guided Autonomous Driving with Hierarchical Agentscited by 15
- 2025Generative Multi-Agent Collaboration in Embodied AI: A Systematic Reviewcited by 13
- 2025Reinforcement Fine-Tuning Powers Reasoning Capability of Multimodal Large Language Modelscited by 13
- 2025CLiViS: Unleashing Cognitive Map through Linguistic-Visual Synergy for Embodied Visual Reasoningcited by 13
- 2025MindGPT-4ov: An Enhanced MLLM via a Multi-Stage Post-Training Paradigmcited by 9
- 2025SAGE: Training Smart Any-Horizon Agents for Long Video Reasoning with Reinforcement Learningcited by 6
- 2025MindWatcher: Toward Smarter Multimodal Tool-Integrated Reasoningcited by 6
- 2026Evolving from Tool User to Creator via Training-Free Experience Reuse in Multimodal Reasoningcited by 6
- 2025COPO: Consistency-Aware Policy Optimizationcited by 1
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Self-Consistent Latent Reasoning: Long Latent Sequence Reasoning for Vision-Language Modelcited by 3
- 2026Don't Pause: Streaming Video-Language Synchrony for Online Video Understandingcited by 1
- 2026MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Interventioncited by 0
- 2026OpenClaw and Ollama in Agentic AI: Toward Fully Autonomous and Scalable AI Agent Systemscited by 0
- 2026Don't Pause: Streaming Video-Language Synchrony for Online Video Understanding5 Jun 2026
- 2026MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention31 May 2026
- 2026Self-Consistent Latent Reasoning: Long Latent Sequence Reasoning for Vision-Language Model12 May 2026
- 2026OpenClaw and Ollama in Agentic AI: Toward Fully Autonomous and Scalable AI Agent Systems16 Apr 2026