mlsanityData to 14 Oct 2026

AeroDPO: Unleashing Lightweight UAV Navigation with High-Fidelity Perception and Automated Preference Optimization

arXiv 2608.07557 ↗First posted 2 Aug 2026cs.RO cs.AI cs.CVcited by 1

On the map: LLM alignment / RLHF / preference optimisation → Reward modeling and RLHF

Abstract (arXiv)

Vision-Language Navigation for Unmanned Aerial Vehicles (UAV-VLN) requires rapid and reactive control in complex 3D environments. Recent minimalist end-to-end paradigms show great promise but typically rely on massive language models containing billions of parameters, incurring prohibitive latency for real-world edge deployment. In this paper, we challenge this parameter-heavy reliance. Comprehensive cross-scale evaluations reveal the critical insight that perception quality fundamentally outweighs language reasoning capacity. We demonstrate that a lightweight 2B model equipped with high-fidelity visual inputs completely matches the overall success rates of massive 7B baselines. However, this minimalist policy exposes a fundamental robustness flaw inherent to pure Behavior Cloning (BC). Lacking explicit negative feedback, the agent fails to internalize robust spatial constraints and exhibits alarming collision rates in out-of-distribution (OOD) scenarios. To overcome this vulnerability without relying on unscalable human annotations, we propose AeroDPO, a zero-cost automated Direct Preference Optimization pipeline driven by deterministic physical simulation state rollback. Upon detecting collisions, the system autonomously rewinds the environment to extract causal reasoning errors as rejected actions, applies decoupled privileged interventions to synthesize collision-avoidance preferred maneuvers, and leverages an offline vision language inspector to filter visual ambiguities. By equipping our 2B model with this automated data flywheel, AeroDPO boosts success rates to 49.16% on unmapped scenarios while drastically suppressing collision rates, establishing a new SOTA for autonomous aerial agents.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reward modeling and RLHF, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 28 of its 37 references that are in the map. First posted on arXiv 2 Aug 2026.

Builds on

28 of 37 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Model29 May
  2. 2017Deep reinforcement learning from human preferences12 Jun

Other references · 26

  1. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  2. 2025Qwen3-VL Technical Reportcited by 2,793
  3. 2017Safe Reinforcement Learning via Shieldingcited by 449
  4. 2019Learning by Cheatingcited by 383
  5. 2018Safe Exploration in Continuous Action Spacescited by 247
  6. 2020Recovery RL: Safe Reinforcement Learning with Learned Recovery Zonescited by 175
  7. 2018RUDDER: Return Decomposition for Delayed Rewardscited by 173
  8. 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 121
  9. 2019Defensive Quantization: When Efficiency Meets Robustnesscited by 95
  10. 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 95
  11. 2025UAVs Meet LLMs: Overviews and Perspectives Toward Agentic Low-Altitude Mobilitycited by 49
  12. 2025CityNavAgent: Aerial Vision-and-Language Navigation with Hierarchical Semantic Planning and Global Memorycited by 32
14 more
  1. 2025UAV-Flow Colosseo: A Real-World Benchmark for Flying-on-a-Word UAV Imitation Learningcited by 31
  2. 2025RaceVLA: VLA-based Racing Drone Navigation with Human-like Behaviourcited by 23
  3. 2025VLA-AN: An Efficient and Onboard Vision-Language-Action Framework for Aerial Navigation in Complex Environmentscited by 23
  4. 2025CognitiveDrone: A VLA Model and Evaluation Benchmark for Real-Time Cognitive Task Solving and Reasoning in UAVscited by 22
  5. 2025See, Point, Fly: A Learning-Free VLM Framework for Universal Unmanned Aerial Navigationcited by 18
  6. 2025LongFly: Long-Horizon UAV Vision-and-Language Navigation with Spatiotemporal Context Integrationcited by 14
  7. 2025UAVs Meet Agentic AI: A Multidomain Survey of Autonomous Aerial Intelligence and Agentic UAVscited by 13
  8. 2025IndoorUAV: Benchmarking Vision-Language UAV Navigation in Continuous Indoor Environmentscited by 10
  9. 2026Vision-and-Language Navigation for UAVs: Progress, Challenges, and a Research Roadmapcited by 5
  10. 2023Neural Potential Field for Obstacle-Aware Local Motion Planningcited by 4
  11. 2026See-and-Reach: Precise Vision-Language Navigation for UAVs within the Field of Viewcited by 2
  12. 2025Prompt-responsive Object Retrieval with Memory-augmented Student-Teacher Learningcited by 1
  13. 2025Deployable Vision-driven UAV River Navigation via Human-in-the-loop Preference Alignmentcited by 1
  14. 2026Mitigating Error Accumulation in Continuous Navigation via Memory-Augmented Kalman Filteringcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026AerialVLA: A Vision-Language-Action Model for UAV Navigation via Minimalist End-to-End Control
  2. 2025UAV-VLN: End-to-End Vision Language guided Navigation for UAVs
  3. 2026VLM-MPPI: Grounding Natural Language in Behaviorally Diverse Trajectories for Aerial Navigation ↗
  4. 2026VLN on the Fly: An Onboard Vision-Language Navigation Stack for Aerial Robots
  5. 2026Guided Diffusion with Distilled Vision-Language Reliability for Aerial Navigation
  6. 2026Vision-Language Navigation for Aerial Robots: Towards the Era of Large Language Models
  7. 2025GRaD-Nav++: Vision-Language Model Enabled Visual Drone Navigation with Gaussian Radiance Fields and Differentiable Dynamics
  8. 2026FSD-VLN: Fast-Slow Dual-System Modeling for Aerial Long-Horizon Vision-Language Navigation