mlsanityData to 7 Oct 2026

HTNav: A Hybrid Navigation Framework with Tiered Structure for Urban Aerial Vision-and-Language Navigation

arXiv 2604.08883 ↗First posted 10 Apr 2026cs.RO cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Inspired by the general Vision-and-Language Navigation (VLN) task, aerial VLN has attracted widespread attention, owing to its significant practical value in applications such as logistics delivery and urban inspection. However, existing methods face several challenges in complex urban environments, including insufficient generalization to unseen scenes, suboptimal performance in long-range path planning, and inadequate understanding of spatial continuity. To address these challenges, we propose HTNav, a new collaborative navigation framework that integrates Imitation Learning (IL) and Reinforcement Learning (RL) within a hybrid IL-RL framework. This framework adopts a staged training mechanism to ensure the stability of the basic navigation strategy while enhancing its environmental exploration capability. By integrating a tiered decision-making mechanism, it achieves collaborative interaction between macro-level path planning and fine-grained action control. Furthermore, a map representation learning module is introduced to deepen its understanding of spatial continuity in open domains. On the CityNav benchmark, our method achieves state-of-the-art performance across all scene levels and task difficulties. Experimental results demonstrate that this framework significantly improves navigation precision and robustness in complex urban environments.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 30 of its 43 references that are in the map. First posted on arXiv 10 Apr 2026.

Builds on

30 of 43 references.

References · 30

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2017Proximal Policy Optimization Algorithmscited by 14,441
  4. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  5. 2017Decoupled Weight Decay Regularizationcited by 1,722
  6. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
  7. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
  8. 2018On Evaluation of Embodied Navigation Agentscited by 526
  9. 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 517
  10. 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 429
  11. 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 401
  12. 2023Faster Segment Anything: Towards Lightweight SAM for Mobile Applicationscited by 345
18 more
  1. 2017Embodied Question Answeringcited by 335
  2. 2019REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environmentscited by 330
  3. 2018Touchdown: Natural Language Navigation and Spatial Reasoning in Visual Street Environmentscited by 238
  4. 2019Stay on the Path: Instruction Fidelity in Vision-and-Language Navigationcited by 129
  5. 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 117
  6. 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 92
  7. 2022SensatUrban: Learning Semantics from Urban-Scale Photogrammetric Point Cloudscited by 49
  8. 2022Aerial Vision-and-Dialog Navigationcited by 48
  9. 2025Openfly: A comprehensive platform for aerial vision-language navigationcited by 43
  10. 2024CityNav: A Large-Scale Dataset for Real-World Aerial Navigationcited by 40
  11. 2020Large-Scale Object Detection in the Wild from Imbalanced Multi-Labelscited by 35
  12. 2021GAIA: A Transfer Learning System of Object Detection that Fits Your Needscited by 27
  13. 2025FlightGPT: Towards Generalizable and Interpretable UAV Vision-and-Language Navigation with Vision-Language Modelscited by 22
  14. 2024CityX: Controllable Procedural Content Generation for Unbounded 3D Citiescited by 20
  15. 2024NavAgent: Multi-scale Urban Street View Fusion For UAV Embodied Vision-and-Language Navigationcited by 18
  16. 2023CityRefer: Geography-aware 3D Visual Grounding Dataset on City-scale Point Cloud Datacited by 15
  17. 2025SA-GCS: Semantic-Aware Gaussian Curriculum Scheduling for UAV Vision-Language Navigationcited by 3
  18. 2022Hybrid Supervised and Reinforcement Learning for the Design and Optimization of Nanophotonic Structurescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025CityNavAgent: Aerial Vision-and-Language Navigation with Hierarchical Semantic Planning and Global Memory
  2. 2026AirAnchor: Bridging Local and Global Spatial Information for Zero-Shot Aerial Vision-and-Language Navigation
  3. 2025Aerial Vision-Language Navigation with a Unified Framework for Spatial, Temporal and Embodied Reasoning
  4. 2025OpenVLN: Open-world Aerial Vision-Language Navigation
  5. 2025UrbanVLA: A Vision-Language-Action Model for Urban Micromobility
  6. 2026LookasideVLN: Direction-Aware Aerial Vision-and-Language Navigation
  7. 2026Vision-Language Navigation for Aerial Robots: Towards the Era of Large Language Models
  8. 2025CompassNav: Steering From Path Imitation To Decision Understanding In Navigation