Towards Precise Intent-Aligned VLA Aerial Navigation via Expert-Guided GRPO
On the map: LLM reasoning → Reinforcement learning for reasoning
Abstract (arXiv)
Vision-Language-Action (VLA) models offer a promising end-to-end paradigm for unmanned aerial vehicles (UAVs) to accomplish complex tasks specified by fine-grained instructions. However, standard supervised fine-tuning (SFT) suffers from data scarcity, limited generalization, and weak supervision for nuanced and complicated human intents. Reinforcement fine-tuning offers a natural way to mitigate these challenges and align policy behaviors with human intents through designable feedback, but applying it to aerial navigation remains challenging due to inefficient exploration in expansive continuous spaces. To address these challenges, we introduce an efficient reinforcement learning (RL) framework for VLA-based aerial navigation. At its core, we propose EG-GRPO (Expert-Guided Group Relative Policy Optimization) to augment online rollouts with few-shot expert data. Additionally, we design a heterogeneous pipeline enabling parallel simulation and inference, which reduces rollout time by 43.5%. Across multiple tasks specified by complex human intents, EG-GRPO improves the success rate to 2.13x that of the SFT baseline, while improving intent alignment performance by 60.9%. These results demonstrate that our framework can move aerial navigation toward precise intent-aligned flight.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reinforcement learning for reasoning, one of 17 directions in LLM reasoning. Builds on 40 of its 41 references that are in the map. First posted on arXiv 1 Jun 2026.
Builds on
40 of 41 references.
Closest ancestors · 1
Same direction, newest first
- 2017Proximal Policy Optimization Algorithms20 Jul
Other references · 39
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2023Efficient Online Reinforcement Learning with Offline Datacited by 332
- 2025VLA-RL: Towards Masterful and General Robotic Manipulation with Scalable Reinforcement Learningcited by 166
- 2022Exploration in Deep Reinforcement Learning: A Surveycited by 158
- 2024Precise and Dexterous Robotic Manipulation via Human-in-the-Loop Reinforcement Learningcited by 153
- 2025SimpleVLA-RL: Scaling VLA Training via Reinforcement Learningcited by 141
- 2025ConRFT: A Reinforced Fine-tuning Method for VLA Models via Consistency Policycited by 139
- 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 117
- 2025Improving Vision-Language-Action Model with Online Reinforcement Learningcited by 107
- 2025What Can RL Bring to VLA Generalization? An Empirical Studycited by 102
27 more
- 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 92
- 2025Vision-Language-Action (VLA) Models: Concepts, Progress, Applications and Challengescited by 72
- 2025A Survey on Post-training of Large Language Modelscited by 53
- 2025TGRPO :Fine-tuning Vision-Language-Action Model via Trajectory-wise Group Relative Policy Optimizationcited by 47
- 2025ReinboT: Amplifying Robot Visual-Language Manipulation with Reinforcement Learningcited by 44
- 2019Learning to Map Natural Language Instructions to Physical Quadcopter Control using Simulated Flightcited by 43
- 2025Openfly: A comprehensive platform for aerial vision-language navigationcited by 43
- 2024CityNav: A Large-Scale Dataset for Real-World Aerial Navigationcited by 40
- 2025VLA-R1: Enhancing Reasoning in Vision-Language-Action Modelscited by 38
- 2018Mapping Navigation Instructions to Continuous Control Actions with Position-Visitation Predictioncited by 35
- 2024Efficient Data Collection for Robotic Manipulation via Compositional Generalizationcited by 35
- 2025UAV-Flow Colosseo: A Real-World Benchmark for Flying-on-a-Word UAV Imitation Learningcited by 30
- 2018Following High-level Navigation Instructions on a Simulated Quadcopter with Imitation Learningcited by 27
- 2025UAV-VLA: Vision-Language-Action System for Large Scale Aerial Mission Generationcited by 27
- 2025MoRE: Unlocking Scalability in Reinforcement Learning for Quadruped Vision-Language-Action Modelscited by 27
- 2025FlightGPT: Towards Generalizable and Interpretable UAV Vision-and-Language Navigation with Vision-Language Modelscited by 22
- 2025VLA-AN: An Efficient and Onboard Vision-Language-Action Framework for Aerial Navigation in Complex Environmentscited by 22
- 2025Robot-R1: Reinforcement Learning for Enhanced Embodied Reasoning in Roboticscited by 21
- 2022A Comprehensive Review on Autonomous Navigationcited by 16
- 2025A Survey of Robotic Navigation and Manipulation with Physics Simulators in the Era of Embodied AIcited by 16
- 2025OpenVLN: Open-world Aerial Vision-Language Navigationcited by 12
- 2025LongFly: Long-Horizon UAV Vision-and-Language Navigation with Spatiotemporal Context Integrationcited by 12
- 2025UAV-VLN: End-to-End Vision Language guided Navigation for UAVscited by 11
- 2019Reinforcement Learning for Robotic Manipulation using Simulated Locomotion Demonstrationscited by 10
- 2025LogisticsVLN: Vision-Language Navigation For Low-Altitude Terminal Delivery Based on Agentic UAVscited by 9
- 2026Trajectory-Diversity-Driven Robust Vision-and-Language Navigationcited by 4
- 2026Precise Aggressive Aerial Maneuvers with Sensorimotor Policiescited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026DiffWAM: A Fast and Efficient Navigation World Action Model30 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2025UAV-VL-R1: Generalizing Vision-Language Models via Supervised Fine-Tuning and Multi-Stage GRPO for UAV Visual Reasoning
- 2026Prism-GRPO: Faster VLA Policy Optimization via Splitting Same-outcome Groups
- 2026Exp2VLA: Enabling Vision-Language-Action for Drone Navigation from Expert Demonstrations
- 2026RecoverFly: A Failure-Aware Reinforcement Learning Post-Training Framework for Aerial Vision-Language Navigation
- 2026GROW: Aligning GRPO with State-Action Modeling for Open-World VLM Agents
- 2025GRaD-Nav++: Vision-Language Model Enabled Visual Drone Navigation with Gaussian Radiance Fields and Differentiable Dynamics
- 2026Learn Where Outcomes Diverge: Efficient VLA RL via Probabilistic Chunk Masking
- 2026PAPO-VLA: Planning-Aware Policy Optimization for Vision-Language-Action Models