LightVLN: Efficient Aerial Vision-and-Language Navigation with Compact Memory and History-Guided Local Aggregation
Not on the map. Why?
Abstract (arXiv)
Aerial vision-and-language navigation (VLN) enables unmanned aerial vehicles to execute long-horizon natural-language instructions from visual observations in complex three-dimensional environments. However, recent aerial VLN models often rely on large-scale vision-language backbones and dense visual histories, imposing substantial computation and memory costs that hinder onboard deployment. We propose LightVLN, a lightweight history-aware aerial VLN framework that combines a compact 0.5B language backbone with compact representations of both historical and current observations. LightVLN compresses each historical frame into a single token using visual features already computed by the policy. It further introduces history- and instruction-conditioned local aggregation to reduce the current observation from 256 to 32 visual tokens while preserving navigation-relevant spatial information. With up to 16 historical frames, the policy uses at most 48 observation-derived tokens. On the public OpenFly dataset, LightVLN achieves 50.93% Test-Seen and 36.14% Test-Unseen success rates (SR), outperforming the evaluated 7B language-backbone baselines on most reported metrics. It also achieves 25.83% SR on AerialVLN-S Val-Seen. In a reconstructed unseen campus, we deploy LightVLN on a DJI M350 RTK with an external Jetson Orin NX 16 GB for closed-loop onboard-compute real-to-sim hardware-in-the-loop (HIL) evaluation, achieving 14.61 Hz model inference and 11.13 Hz end-to-end decision updates. These results demonstrate the effectiveness and efficiency of LightVLN for aerial navigation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 25 references that are in the map. First posted on arXiv 4 Oct 2026.
Builds on
24 of 25 references.
References · 24
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 233
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
- 2024TokenPacker: Efficient Visual Projector for Multimodal LLMcited by 172
- 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 121
- 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 95
- 2025Openfly: A comprehensive platform for aerial vision-language navigationcited by 46
- 2025CityNavAgent: Aerial Vision-and-Language Navigation with Hierarchical Semantic Planning and Global Memorycited by 32
12 more
- 2025VLA-AN: An Efficient and Onboard Vision-Language-Action Framework for Aerial Navigation in Complex Environmentscited by 23
- 2024Exploring Spatial Representation to Enhance LLM Reasoning in Aerial Vision-Language Navigationcited by 20
- 2025LongFly: Long-Horizon UAV Vision-and-Language Navigation with Spatiotemporal Context Integrationcited by 14
- 2025Aerial Vision-Language Navigation with a Unified Framework for Spatial, Temporal and Embodied Reasoningcited by 8
- 2025History-Enhanced Two-Stage Transformer for Aerial Vision-and-Language Navigationcited by 6
- 2026NativeMEM: Native Memory Compression for Long-Horizon Robotic Manipulationcited by 6
- 2026EvoComp: Learning Visual Token Compression for Multimodal Large Language Models via Semantic-Guided Evolutionary Labelingcited by 5
- 2026Fly0: Persistent Metric Anchoring for Zero-Shot Aerial Vision-Language Navigationcited by 4
- 2026OnFly: Onboard Zero-Shot Aerial Vision-Language Navigation toward Safety and Efficiencycited by 4
- 2026FSD-VLN: Fast-Slow Dual-System Modeling for Aerial Long-Horizon Vision-Language Navigationcited by 3
- 2026From Semantic Grounding to Decision Optimization: A Unified Framework for Long-Horizon UAV Vision-Language Navigationcited by 1
- 2026DreamFly: Causal Memory and Receding-Horizon Diffusion Planning for Aerial Vision-Language Navigationcited by 1
Built on by
Not cited yet.