Characterizing Vision-Language-Action Models across XPUs: Constraints and Acceleration for On-Robot Deployment
On the map: Vision-language-action models → Efficient VLA inference and adaptation
Abstract (arXiv)
Vision-Language-Action (VLA) models are promising for generalist robot control, but on-robot deployment is bottlenecked by real-time inference under tight cost and energy budgets. Most prior evaluations rely on desktop-grade GPUs, obscuring the trade-offs and opportunities offered by heterogeneous edge accelerators (GPUs/XPUs/NPUs). We present a systematic analysis for low-cost VLA deployment via model-hardware co-characterization. First, we build a cross-accelerator leaderboard and evaluate model-hardware pairs under CET (Cost, Energy, Time), showing that right-sized edge devices can be more cost-/energy-efficient than flagship GPUs while meeting control-rate constraints. Second, using in-depth profiling, we uncover a consistent two-phase inference pattern: a compute-bound VLM backbone followed by a memory-bound Action Expert, which induces phase-dependent underutilization and hardware inefficiency. Finally, guided by these insights, we propose DP-Cache and V-AEFusion to reduce diffusion redundancy and enable asynchronous pipeline parallelism, achieving up to 2.9x speedup on GPUs and 6x on edge NPUs with only marginal success degradation. The example leaderboard website is available at: https://vla-leaderboard-01.vercel.app/.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 22 of its 30 references that are in the map. First posted on arXiv 27 Apr 2026.
Builds on
22 of 30 references.
Closest ancestors · 2
Same direction, newest first
- 2025Spec-VLA: Speculative Decoding for Vision-Language-Action Models with Relaxed Acceptance30 Jul
- 2025VLA-Cache: Efficient Vision-Language-Action Manipulation via Adaptive Token Caching4 Feb
Other references · 20
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
- 2024SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inferencecited by 378
- 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 377
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 331
8 more
- 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Modelcited by 245
- 2025Real-Time Execution of Action Chunking Flow Policiescited by 199
- 2024Real-Time Video Generation with Pyramid Attention Broadcastcited by 140
- 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulationcited by 102
- 2024xDiT: an Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelismcited by 55
- 2025Running VLAs at Real-time Speedcited by 42
- 2025A Survey on Efficient Vision-Language-Action Modelscited by 34
- 2025Block-wise Adaptive Caching for Accelerating Diffusion Policycited by 11
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026vla.cpp: A Unified Inference Runtime for Vision-Language-Action Modelscited by 4
- 2026The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Taskscited by 0
- 2026rMuscle: Robotic Muscle Memory for Efficient Vision-Language-Action Model Inferencecited by 0
- 2026vla.simd: Efficient CPU Inference for Language-Conditioned Manipulationcited by 0
- 2026Faster and Better? Benchmark Bugs and Design Limitations Distort the Evaluation of Vision-Language-Action Accelerationcited by 0
- 2026Multi-Link Safety Filtering for VLA Policies Around Moving Hazardscited by 0
- 2026Multi-Link Safety Filtering for VLA Policies Around Moving Hazards30 Sep 2026
- 2026Faster and Better? Benchmark Bugs and Design Limitations Distort the Evaluation of Vision-Language-Action Acceleration29 Sep 2026
- 2026vla.simd: Efficient CPU Inference for Language-Conditioned Manipulation21 Sep 2026
- 2026rMuscle: Robotic Muscle Memory for Efficient Vision-Language-Action Model Inference16 Sep 2026
- 2026The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Tasks26 Jun 2026
- 2026vla.cpp: A Unified Inference Runtime for Vision-Language-Action Models6 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2025Cross-Platform Scaling of Vision-Language-Action Models from Edge to Cloud GPUs
- 2026Efficient Vision-Language-Action Management and Serving for Robot Factories
- 2026Beyond LLM Serving: Characterizing Vision-Language-Action Workloads for Embodied AI System Design
- 2026KerColle: Unlocking Fine-Grained GPU Concurrency in Vision-Language-Action Models
- 2025ActionFlow: A Pipelined Action Acceleration for Vision Language Models on Edge
- 2026ActTune: Action-Aware Precision and GPU Operating-Point Adaptation for Energy-Efficient Vision-Language-Action Inference
- 2025EdgeVLA: Efficient Vision-Language-Action Models
- 2026Characterizing VLA Models: Identifying the Action Generation Bottleneck for Edge AI Architectures