mlsanityData to 14 Oct 2026

SA-GCS: Semantic-Aware Gaussian Curriculum Scheduling for UAV Vision-Language Navigation

arXiv 2508.00390 ↗First posted 1 Aug 2025cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

Unmanned Aerial Vehicle (UAV) Vision-Language Navigation (VLN) aims to enable agents to accurately localize targets and plan flight paths in complex environments based on natural language instructions, with broad applications in intelligent inspection, disaster rescue, and urban monitoring. Recent progress in Vision-Language Models (VLMs) has provided strong semantic understanding for this task, while reinforcement learning (RL) has emerged as a promising post-training strategy to further improve generalization. However, existing RL methods often suffer from inefficient use of training data, slow convergence, and insufficient consideration of the difficulty variation among training samples, which limits further performance improvement. To address these challenges, we propose Semantic-Aware Gaussian Curriculum Scheduling (SA-GCS), a novel training framework that systematically integrates Curriculum Learning (CL) into RL. SA-GCS employs a Semantic-Aware Difficulty Estimator (SA-DE) to quantify the complexity of training samples and a Gaussian Curriculum Scheduler (GCS) to dynamically adjust the sampling distribution, enabling a smooth progression from easy to challenging tasks. This design significantly improves training efficiency, accelerates convergence, and enhances overall model performance. Extensive experiments on the CityNav benchmark demonstrate that SA-GCS consistently outperforms strong baselines across all metrics, achieves faster and more stable convergence, and generalizes well across models of different scales, highlighting its robustness and scalability. The implementation of our approach is publicly available.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 16 of its 22 references that are in the map. First posted on arXiv 1 Aug 2025.

Builds on

16 of 22 references.

References · 16

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
  3. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
  4. 2022GIT: A Generative Image-to-text Transformer for Vision and Languagecited by 537
  5. 2017Reverse Curriculum Generation for Reinforcement Learningcited by 198
  6. 2018Acquisition of Localization Confidence for Accurate Object Detectioncited by 176
  7. 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 121
  8. 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 95
  9. 2025Efficient Reinforcement Finetuning via Adaptive Curriculum Learningcited by 93
  10. 2025Curriculum Reinforcement Learning from Easy to Hard Tasks Improves LLM Reasoningcited by 92
  11. 2024CityNav: A Large-Scale Dataset for Real-World Aerial Navigationcited by 42
  12. 2025SkyVLN: Vision-and-Language Navigation and NMPC Control for UAVs in Urban Environmentscited by 14
4 more
  1. 2020Guided Curriculum Learning for Walking Over Complex Terraincited by 10
  2. 2025LogisticsVLN: Vision-Language Navigation For Low-Altitude Terminal Delivery Based on Agentic UAVscited by 9
  3. 2025Multimodal Large Language Models-Enabled UAV Swarm: Towards Efficient and Intelligent Autonomous Aerial Systemscited by 7
  4. 2024Q-GroundCAM: Quantifying Grounding in Vision Language Models via GradCAMcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025UAV-VL-R1: Generalizing Vision-Language Models via Supervised Fine-Tuning and Multi-Stage GRPO for UAV Visual Reasoning
  2. 2025OpenVLN: Open-world Aerial Vision-Language Navigation
  3. 2026RecoverFly: A Failure-Aware Reinforcement Learning Post-Training Framework for Aerial Vision-Language Navigation
  4. 2025GRaD-Nav++: Vision-Language Model Enabled Visual Drone Navigation with Gaussian Radiance Fields and Differentiable Dynamics
  5. 2025UAV-VLN: End-to-End Vision Language guided Navigation for UAVs
  6. 2024Exploring Spatial Representation to Enhance LLM Reasoning in Aerial Vision-Language Navigation
  7. 2026Vision-and-Language Navigation for UAVs: Progress, Challenges, and a Research Roadmap
  8. 2025FlightGPT: Towards Generalizable and Interpretable UAV Vision-and-Language Navigation with Vision-Language Models