LiteVLA-H: Dual-Rate Vision-Language-Action Inference for Onboard Aerial Guidance and Semantic Perception
On the map: Vision-language-action models → Aerial and drone VLA
Abstract (arXiv)
Vision-language-action (VLA) models have shown strong semantic grounding and task generalization in manipulation, but aerial deployment remains difficult because drones require low-latency closed-loop guidance under strict onboard compute and communication constraints. We present LiteVLA-H, a compact 256M-parameter VLA system designed for dual-rate operation on an NVIDIA Jetson AGX Orin: a fast outer-loop guidance mode for short action-token outputs and a slower semantic mode for scene understanding, hazard description, and operator-facing narration. The central empirical observation is that, in this compact edge regime, end-to-end latency is dominated by multimodal pre-fill rather than by the marginal cost of decoding a few extra tokens. This motivates a scheduler that issues reactive action tokens at 50.65,ms (19.74,Hz) while still supporting sentence-level semantic outputs at 149.90--164.57ms (6.08--6.67,Hz) on the same embedded platform. To specialize the model without collapsing its descriptive competence, we use a knowledge-preserving fine-tuning recipe that mixes reactive flight data, aerial semantic data, and generic caption/VQA supervision. Beyond reporting current latency measurements, we position the system against recent state-of-the-art architectures, including AnywhereVLA, FutureVLA, and ReMem-VLA, showing that the measured action branch reaches a higher edge inference rate under our deployment conditions while retaining periodic semantic awareness.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Aerial and drone VLA, one of 13 directions in Vision-language-action models. Builds on 16 of its 19 references that are in the map. First posted on arXiv 27 Apr 2026.
Builds on
16 of 19 references.
Closest ancestors · 4
Same direction, newest first
- 2026π, But Make It Fly: Physics-Guided Transfer of VLA Models to Aerial Manipulation26 Mar
- 2026AIR-VLA: Vision-Language-Action Systems for Aerial Manipulation29 Jan
- 2025VLA-AN: An Efficient and Onboard Vision-Language-Action Framework for Aerial Navigation in Complex Environments17 Dec
- 2025SINGER: An Onboard Generalist Vision-Language Navigation Policy for Drones23 Sep
Other references · 12
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2025Running VLAs at Real-time Speedcited by 42
- 2025The Better You Learn, The Smarter You Prune: Towards Efficient Vision-language-action Models via Differentiable Token Pruningcited by 34
- 2026ReMem-VLA: Empowering Vision-Language-Action Model with Memory via Dual-Level Recurrent Queriescited by 28
- 2026FASTER: Rethinking Real-Time Flow VLAscited by 20
- 2026How Fast Can I Run My VLA? Demystifying VLA Inference Performance with VLA-Perfcited by 17
- 2026FutureVLA: Joint Visuomotor Prediction for Vision-Language-Action Modelcited by 14
- 2026AerialVLA: A Vision-Language-Action Model for UAV Navigation via Minimalist End-to-End Controlcited by 11
- 2026LiteVLA-Edge: Quantized On-Device Multimodal Control for Embedded Roboticscited by 4
- 2025AnywhereVLA: Language-Conditioned Exploration and Mobile Manipulationcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026FSD-VLN: Fast-Slow Dual-System Modeling for Aerial Long-Horizon Vision-Language Navigation
- 2025GRaD-Nav++: Vision-Language Model Enabled Visual Drone Navigation with Gaussian Radiance Fields and Differentiable Dynamics
- 2026TurboVLA: Real-Time Vision-Language-Action Model at 32 Hz on an RTX 4090 with <1 GB VRAM
- 2026Memory-Augmented Multimodal Large Language Models for Small Object Understanding in Streaming Aerial Videos
- 2026Evaluating Multimodal LLMs as Generalist Vision-Language-Action Agents for Drone Control: Commanding, Approaching, Tracking and Searching
- 2026From Local Whole-Body VLA Behaviors to Scene-Scale Aerial Manipulation
- 2026Think Like a Pilot: Fine-Grained Long-Horizon UAV Navigation
- 2026OnFly: Onboard Zero-Shot Aerial Vision-Language Navigation toward Safety and Efficiency