LiteVLA-Edge: Quantized On-Device Multimodal Control for Embedded Robotics
On the map: Vision-language-action models → Efficient VLA inference and adaptation
Abstract (arXiv)
Vision-Language-Action (VLA) models provide a unified framework for perception, language conditioning, and action generation, but many existing systems remain difficult to deploy in embedded robotic settings because of their computational requirements and inference latency. In this paper, we present LiteVLA-Edge, a deployment-oriented VLA pipeline for fully on-device inference on Jetson Orin-class hardware. Our approach combines supervised image-to-action fine-tuning in FP32 with post-training 4-bit GGUF quantization and GPU-accelerated inference through the textttllama.cpp runtime. Under our deployment configuration, LiteVLA-Edge achieves a mean end-to-end latency of 150.5,ms (approximately 6.6,Hz) while operating entirely offline within a ROS~2-integrated perception--reasoning--action pipeline. Rather than introducing a new policy objective, our contribution is a practical systems path for executing compact multimodal control models locally on embedded hardware while preserving modular interfaces between perception, reasoning, and actuation. These results establish timing feasibility for reactive language-conditioned control and provide a reproducible baseline for future task-level evaluation of on-device VLAs in robotics.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 9 of its 9 references that are in the map. First posted on arXiv 3 Mar 2026.
Builds on
9 of 9 references.
Closest ancestors · 1
Same direction, newest first
Other references · 8
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
- 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 204
- 2024TinyLLaVA: A Framework of Small-scale Large Multimodal Modelscited by 164
- 2025Lite VLA: Efficient Vision-Language-Action Control on CPU-Bound Edge Robotscited by 9
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026vla.cpp: A Unified Inference Runtime for Vision-Language-Action Modelscited by 4
- 2026LiteVLA-H: Dual-Rate Vision-Language-Action Inference for Onboard Aerial Guidance and Semantic Perceptioncited by 0
- 2026When Faster VLA Deployment Changes Closed-Loop Behavior: Task Success-Latency Analysis of SmolVLA Across PyTorch and ONNX Variantscited by 0
- 2026EdgeVLN: Runtime-Aware Deployment Ready Quantized Vision Language Navigation Modelcited by 0
- 2026EdgeVLN: Runtime-Aware Deployment Ready Quantized Vision Language Navigation Model28 Sep 2026
- 2026When Faster VLA Deployment Changes Closed-Loop Behavior: Task Success-Latency Analysis of SmolVLA Across PyTorch and ONNX Variants12 Sep 2026
- 2026vla.cpp: A Unified Inference Runtime for Vision-Language-Action Models6 Jun 2026
- 2026LiteVLA-H: Dual-Rate Vision-Language-Action Inference for Onboard Aerial Guidance and Semantic Perception27 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Characterizing Vision-Language-Action Models across XPUs: Constraints and Acceleration for On-Robot Deployment
- 2025ActionFlow: A Pipelined Action Acceleration for Vision Language Models on Edge
- 2026Beyond LLM Serving: Characterizing Vision-Language-Action Workloads for Embodied AI System Design
- 2025BitVLA: 1-bit Vision-Language-Action Models for Robotics Manipulation
- 2026EcoVLA: Energy-Efficient Device-Edge Co-Inference for Vision-Language-Action Models under Real-Time Constraints
- 2026QVLA: Not All Channels Are Equal in Vision-Language-Action Model's Quantization
- 2026Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inference
- 2026RhinoVLA Technical Report