StreamingVLA: Streaming Vision-Language-Action Model with Action Flow Matching and Adaptive Early Observation
On the map: Vision-language-action models → Efficient VLA inference and adaptation
also in 1 more
Abstract (arXiv)
Vision-language-action (VLA) models have demonstrated exceptional performance in natural language-driven perception and control. However, the high computational cost of VLA models poses significant efficiency challenges, particularly for resource-constrained edge platforms in real-world deployments. However, since different stages of VLA (observation, action generation and execution) must proceed sequentially, and wait for the completion of the preceding stage, the system suffers from frequent halting and high latency. To address this, We conduct a systematic analysis to identify the challenges for fast and fluent generation, and propose enabling VLAs with the ability to asynchronously parallelize across VLA stages in a "streaming" manner. First, we eliminate the reliance on action chunking and adopt action flow matching, which learns the trajectory of action flows rather than denoising chunk-wise actions. It overlaps the latency of action generation and execution. Second, we design an action saliency-aware adaptive observation mechanism, thereby overlapping the latency of execution and observation. Without sacrificing performance, StreamingVLA achieves substantial speedup and improves the fluency of execution. It achieves a 2.4 × latency speedup and reduces execution halting by 6.5 ×.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 36 of its 42 references that are in the map. First posted on arXiv 30 Mar 2026.
Builds on
36 of 42 references.
Closest ancestors · 8
Same direction, newest first
- 2025Training-Time Action Conditioning for Efficient Real-Time Chunking5 Dec
- 2025VLASH: Real-Time VLAs via Future-State-Aware Asynchronous Inference30 Nov
- 2025AsyncVLA: Asynchronous Flow Matching for Vision-Language-Action Models18 Nov
- 2025EfficientVLA: Training-Free Acceleration and Compression for Vision-Language-Action Models11 Jun
- 2025MoLe-VLA: Dynamic Layer-skipping Vision Language Action Model via Mixture-of-Layers for Efficient Robot Manipulation26 Mar
- 2025PD-VLA: Accelerating Vision-Language-Action Model Integrated with Action Chunking via Parallel Decoding4 Mar
- 2025VLA-Cache: Efficient Vision-Language-Action Manipulation via Adaptive Token Caching4 Feb
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Models16 Jan
Other references · 28
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
16 more
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 331
- 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 320
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
- 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 201
- 2025Real-Time Execution of Action Chunking Flow Policiescited by 199
- 2023RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunkingcited by 167
- 2024Fit and Prune: Fast and Training-free Visual Token Pruning for Multi-modal Large Language Modelscited by 125
- 2025GR-3 Technical Reportcited by 110
- 2025Reinforcement Learning with Action Chunkingcited by 97
- 2025OpenHelix: A Short Survey, Empirical Analysis, and Open-Source Dual-System VLA Model for Robotic Manipulationcited by 79
- 2025Streaming Flow Policy: Simplifying diffusion/flow-matching policies by treating action trajectories as flow trajectoriescited by 34
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Surveycited by 25
- 2025RLRC: Reinforcement Learning-based Recovery for Compressed Vision-Language-Action Modelscited by 20
- 2023One ACT Play: Single Demonstration Behavior Cloning with Action Chunking Transformerscited by 17
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inferencecited by 3
- 2026FlashVLA: Streaming Action Decoding for Fast and Asynchronous VLA Inferencecited by 3
- 2026The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Taskscited by 0
- 2026StreamPI: Streaming Multimodal Temporal Modeling for Vision-Language-Action Modelscited by 0
- 2026Staircase Policy: Streaming Inference for World-Action Models with Large Action Chunkscited by 0
- 2026Toward Real-Time VLAs: Stage-Aware Two-Step Flow Denoising and System-Level Evaluationcited by 0
- 2026Toward Real-Time VLAs: Stage-Aware Two-Step Flow Denoising and System-Level Evaluation30 Sep 2026
- 2026Staircase Policy: Streaming Inference for World-Action Models with Large Action Chunks29 Sep 2026
- 2026FlashVLA: Streaming Action Decoding for Fast and Asynchronous VLA Inference27 Aug 2026
- 2026StreamPI: Streaming Multimodal Temporal Modeling for Vision-Language-Action Models26 Aug 2026
- 2026Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inference14 Jul 2026
- 2026The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Tasks26 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026CF-VLA: Efficient Coarse-to-Fine Action Generation for Vision-Language-Action Policies
- 2026One Token Per Frame: Reconsidering Visual Bandwidth in World Models for VLA Policy
- 2025ActionFlow: A Pipelined Action Acceleration for Vision Language Models on Edge
- 2026Reflex: Real-Time VLA Control through Streaming Inference
- 2025Think Twice, Act Once: Token-Aware Compression and Action Reuse for Efficient Inference in Vision-Language-Action Models
- 2026TurboVLA: Real-Time Vision-Language-Action Model at 32 Hz on an RTX 4090 with <1 GB VRAM
- 2026AdaVLA: Adaptive Step Flow Matching for Training-free Acceleration of Vision-Language-Action Models
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model