ActionFlow: A Pipelined Action Acceleration for Vision Language Models on Edge
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
also in 1 more
Abstract (arXiv)
Vision-Language-Action (VLA) models have emerged as a unified paradigm for robotic perception and control, enabling emergent generalization and long-horizon task execution. However, their deployment in dynamic, real-world environments is severely hin dered by high inference latency. While smooth robotic interaction requires control frequencies of 20 to 30 Hz, current VLA models typi cally operate at only 3-5 Hz on edge devices due to the memory bound nature of autoregressive decoding. Existing optimizations often require extensive retraining or compromise model accuracy. To bridge this gap, we introduce ActionFlow, a system-level inference framework tailored for resource-constrained edge plat forms. At the core of ActionFlow is a Cross-Request Pipelin ing strategy, a novel scheduler that redefines VLA inference as a macro-pipeline of micro-requests. The strategy intelligently batches memory-bound Decode phases with compute-bound Prefill phases across continuous time steps to maximize hardware utilization. Furthermore, to support this scheduling, we propose a Cross Request State Packed Forward operator and a Unified KV Ring Buffer, which fuse fragmented memory operations into efficient dense computations. Experimental results demonstrate that ActionFlow achieves a 2.55x improvement in FPS on the OpenVLA-7B model without retraining, enabling real-time dy namic manipulation on edge hardware. Our work is available at https://anonymous.4open.science/r/ActionFlow-1D47.
Key facts. Cited by 6 papers in the map (data through 13 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 19 of its 32 references that are in the map. First posted on arXiv 23 Dec 2025.
Builds on
19 of 32 references.
Closest ancestors · 1
Same direction, newest first
Other references · 18
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,637
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,823
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,570
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,344
- 2023Efficient Streaming Language Models with Attention Sinkscited by 2,137
- 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,323
- 2024Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Servecited by 514
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 418
- 2024SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inferencecited by 381
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 335
- 2025Real-Time Execution of Action Chunking Flow Policiescited by 206
- 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulationcited by 102
6 more
- 2024SpecExec: Massively Parallel Speculative Decoding for Interactive LLM Inference on Consumer Devicescited by 45
- 2025BitVLA: 1-bit Vision-Language-Action Models for Robotics Manipulationcited by 43
- 2025Spec-VLA: Speculative Decoding for Vision-Language-Action Models with Relaxed Acceptancecited by 31
- 2024RoboNurse-VLA: Robotic Scrub Nurse System based on Vision-Language-Action Modelcited by 29
- 2024EDGE-LLM: Enabling Efficient Large Language Model Adaptation on Edge Devices via Layerwise Unified Compression and Adaptive Layer Tuning and Votingcited by 27
- 2021Hybrid leg compliance enables robots to operate with sensorimotor delays and low control update frequenciescited by 3
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026FASTER: Rethinking Real-Time Flow VLAscited by 21
- 2026vla.cpp: A Unified Inference Runtime for Vision-Language-Action Modelscited by 4
- 2026Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inferencecited by 3
- 2026Reflex: Real-Time VLA Control through Streaming Inferencecited by 3
- 2026EcoVLA: Energy-Efficient Device-Edge Co-Inference for Vision-Language-Action Models under Real-Time Constraintscited by 1
- 2026REACT: Rolling Denoising and Dual Decoupling for Reactive Robot Control with VLA Modelscited by 0
- 2026REACT: Rolling Denoising and Dual Decoupling for Reactive Robot Control with VLA Models8 Oct 2026
- 2026EcoVLA: Energy-Efficient Device-Edge Co-Inference for Vision-Language-Action Models under Real-Time Constraints16 Aug 2026
- 2026Reflex: Real-Time VLA Control through Streaming Inference16 Jul 2026
- 2026Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inference14 Jul 2026
- 2026vla.cpp: A Unified Inference Runtime for Vision-Language-Action Models6 Jun 2026
- 2026FASTER: Rethinking Real-Time Flow VLAs19 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025EdgeVLA: Efficient Vision-Language-Action Models
- 2026Characterizing Vision-Language-Action Models across XPUs: Constraints and Acceleration for On-Robot Deployment
- 2025Think Twice, Act Once: Token-Aware Compression and Action Reuse for Efficient Inference in Vision-Language-Action Models
- 2026A1: A Fully Transparent Open-Source, Adaptive and Efficient Truncated Vision-Language-Action Model
- 2026Beyond LLM Serving: Characterizing Vision-Language-Action Workloads for Embodied AI System Design
- 2026FlashVLA: Streaming Action Decoding for Fast and Asynchronous VLA Inference
- 2026ElegantVLA: Learning When to Think for Efficient Vision-Language-Action Models
- 2025PD-VLA: Accelerating Vision-Language-Action Model Integrated with Action Chunking via Parallel Decoding