WareFly-VLA: A Vision-Language-Action Framework for UAV Navigation and Human Tracking in Smart Warehouses
On the map: Vision-language-action models → Aerial and drone VLA
Abstract (arXiv)
Vision-Language-Action (VLA) models have achieved impressive results in robotic manipulation and ground-mobile navigation, yet language-conditioned control of unmanned aerial vehicles (UAVs) in smart warehouses remains largely unexplored, hindered by the lack of benchmarks that jointly provide continuous low-level flight actions, fine-grained natural-language target descriptions, and realistic industrial environments. This paper introduces WareFly-VLA, a photorealistic UAV VLA framework and dataset for language-guided human search, localization, and tracking in warehouse environments. It contains 507 human-teleoperated flight episodes and 8,504 high-resolution RGB transitions collected in NVIDIA Isaac Sim, each paired with a human-written appearance description of the target worker and a synchronized four-degree-of-freedom control command. Two aerial tasks are covered: target approach and person following, under occlusion, long-range search, altitude variation, and clutter. A unified benchmark of four open-source VLA architectures (SmolVLA, GR00T N1.7, pi_0 and OpenVLA) is established under a leakage-free episode-level protocol at two control rates. The results show that language-conditioned aerial control in warehouses is far from solved: performance drops substantially under strict generalization settings, continuous action modeling consistently outperforms discrete action tokenization, only the forward channel is reliably learnable from a single frame, and current foundation-model interfaces transfer poorly from ground and humanoid embodiments to aerial platforms. The synchronized video, language, action, pose, and difficulty annotations further support world-model research. The dataset, baselines, and evaluation protocol are released to support language-grounded aerial autonomy in smart warehouses.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Aerial and drone VLA, one of 13 directions in Vision-language-action models. Builds on 30 of its 53 references that are in the map. First posted on arXiv 6 Oct 2026.
Builds on
30 of 53 references.
Closest ancestors · 1
Same direction, newest first
Other references · 29
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2018World Modelscited by 1,513
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
17 more
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 530
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 339
- 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 121
- 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 95
- 2023MC-JEPA: A Joint-Embedding Predictive Architecture for Self-Supervised Learning of Motion and Content Featurescited by 57
- 2022Aerial Vision-and-Dialog Navigationcited by 49
- 2025UAVs Meet LLMs: Overviews and Perspectives Toward Agentic Low-Altitude Mobilitycited by 49
- 2026Qwen-VLA: Unifying Vision-Language-Action Modeling across Tasks, Environments, and Robot Embodimentscited by 44
- 2023Towards Natural Language-Guided Drones: GeoText-1652 Benchmark with Spatial Relation Matchingcited by 42
- 2025UAV-VLA: Vision-Language-Action System for Large Scale Aerial Mission Generationcited by 28
- 2025RaceVLA: VLA-based Racing Drone Navigation with Human-like Behaviourcited by 23
- 2024Exploring Spatial Representation to Enhance LLM Reasoning in Aerial Vision-Language Navigationcited by 20
- 2026AirNav: A Large-Scale UAV Vision-and-Language Navigation Dataset with Natural and Diverse Instructionscited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Vision-and-Language Navigation for UAVs: Progress, Challenges, and a Research Roadmap
- 2025IndoorUAV: Benchmarking Vision-Language UAV Navigation in Continuous Indoor Environments
- 2026UAV-Track VLA: Embodied Aerial Tracking via Vision-Language-Action Models
- 2025Grounded Vision-Language Navigation for UAVs with Open-Vocabulary Goal Understanding
- 2025VLA-AN: An Efficient and Onboard Vision-Language-Action Framework for Aerial Navigation in Complex Environments
- 2026Vision-Language Navigation for Aerial Robots: Towards the Era of Large Language Models
- 2026Vision Language Action (VLA) Models for Unmanned Aerial Robotics and Bimanual Manipulation: A Review
- 2026AIR-VLA: Vision-Language-Action Systems for Aerial Manipulation