EcoVLA: Energy-Efficient Device-Edge Co-Inference for Vision-Language-Action Models under Real-Time Constraints
On the map: Vision-language-action models → Efficient VLA inference and adaptation
Abstract (arXiv)
Vision-Language-Action (VLA) models have emerged as a promising foundation for Embodied AI, but their high inference cost poses significant challenges for deployment in robotic systems. In practice, on-device inference is constrained by limited compute capacity and energy budgets, struggling to simultaneously satisfy real-time control and energy efficiency requirements. Alternatively, offloading the inference workload to an edge server is susceptible to fluctuations in system conditions, introducing unpredictable latency risks. Device-edge co-inference offers a promising solution, but systematic research tailored to VLA models remains scarce, particularly a unified co-inference framework that jointly addresses real-time constraints and system-level energy efficiency. Thus, we propose EcoVLA, an adaptive device-edge co-inference framework for VLA models that maximizes system energy efficiency under real-time constraints. EcoVLA first introduces a unified stage-level abstraction over different VLA paradigms, establishing an architecture-agnostic co-inference design space. It then formulates a joint device-edge-network latency and energy prediction model to enable rapid runtime evaluation of candidate co-inference schemes. Building on this, EcoVLA continuously selects the energy-optimal scheme satisfying real-time constraints with millisecond-level overhead, adapting to runtime variations in network and system states. Furthermore, EcoVLA incorporates a lightweight transmission mechanism for inter-stage intermediate tensors to reduce the communication overhead incurred by cross-device collaboration. Experimental results across VLA models show that EcoVLA improves system energy efficiency by up to 236% over existing co-inference approaches under a 20 Hz action output frequency constraint, while consistently maintaining SLO satisfaction under dynamic network and edge workload conditions.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 19 of its 24 references that are in the map. First posted on arXiv 16 Aug 2026.
Builds on
19 of 24 references.
Closest ancestors · 5
Same direction, newest first
- 2026How Fast Can I Run My VLA? Demystifying VLA Inference Performance with VLA-Perf20 Feb
- 2025ActionFlow: A Pipelined Action Acceleration for Vision Language Models on Edge23 Dec
- 2025VLASH: Real-Time VLAs via Future-State-Aware Asynchronous Inference30 Nov
- 2025SP-VLA: A Joint Model Scheduling and Token Pruning Approach for VLA Model Acceleration15 Jun
- 2025EfficientVLA: Training-Free Acceleration and Compression for Vision-Language-Action Models11 Jun
Other references · 14
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 530
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 339
- 2024Mobile Edge Intelligence for Large Language Models: A Contemporary Surveycited by 128
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Surveycited by 49
- 2025Running VLAs at Real-time Speedcited by 43
- 2025Task-Oriented Feature Compression for Multimodal Understanding via Device-Edge Co-Inferencecited by 18
- 2025DSSD: Efficient Edge-Device LLM Deployment and Collaborative Inference via Distributed Split Speculative Decodingcited by 15
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Beyond LLM Serving: Characterizing Vision-Language-Action Workloads for Embodied AI System Design
- 2025EdgeVLA: Efficient Vision-Language-Action Models
- 2026Characterizing Vision-Language-Action Models across XPUs: Constraints and Acceleration for On-Robot Deployment
- 2026Seeing is Free, Speaking is Not: Uncovering the True Energy Bottleneck in Edge VLM Inference
- 2026Algorithm-Architecture Co-Design for Efficient VLA Inference via Speculative Inference and Verification
- 2026Deltoris: Enabling Real-time VLA Inference in Embodied AI via Bit-level Sparsity and Speculative Inference
- 2026RAPID: Redundancy-Aware and Compatibility-Optimal Edge-Cloud Partitioned Inference for Diverse VLA Models
- 2026vla.cpp: A Unified Inference Runtime for Vision-Language-Action Models