mlsanityData to 14 Oct 2026

FineCog-Nav: Integrating Fine-grained Cognitive Modules for Zero-shot Multimodal UAV Navigation

arXiv 2604.16298 ↗First posted 17 Apr 2026cs.CV cs.ROcited by 4

Not on the map. Why?

Abstract (arXiv)

UAV vision-language navigation (VLN) requires an agent to navigate complex 3D environments from an egocentric perspective while following ambiguous multi-step instructions over long horizons. Existing zero-shot methods remain limited, as they often rely on large base models, generic prompts, and loosely coordinated modules. In this work, we propose FineCog-Nav, a top-down framework inspired by human cognition that organizes navigation into fine-grained modules for language processing, perception, attention, memory, imagination, reasoning, and decision-making. Each module is driven by a moderate-sized foundation model with role-specific prompts and structured input-output protocols, enabling effective collaboration and improved interpretability. To support fine-grained evaluation, we construct AerialVLN-Fine, a curated benchmark of 300 trajectories derived from AerialVLN, with sentence-level instruction-trajectory alignment and refined instructions containing explicit visual endpoints and landmark references. Experiments show that FineCog-Nav consistently outperforms zero-shot baselines in instruction adherence, long-horizon planning, and generalization to unseen environments. These results suggest the effectiveness of fine-grained cognitive modularization for zero-shot aerial navigation. Project page: https://smartdianlab.github.io/projects-FineCogNav.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 44 of its 51 references that are in the map. First posted on arXiv 17 Apr 2026.

Builds on

44 of 51 references.

References · 44

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  3. 2024Qwen2.5 Technical Reportcited by 4,942
  4. 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
  5. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
  6. 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
  7. 2018Speaker-Follower Models for Vision-and-Language Navigationcited by 340
  8. 2023Recognize Anything: A Strong Image Tagging Modelcited by 309
  9. 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Modelscited by 280
  10. 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 271
  11. 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 233
  12. 2020Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-trainingcited by 231
32 more
  1. 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 157
  2. 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 156
  3. 2019Stay on the Path: Instruction Fidelity in Vision-and-Language Navigationcited by 130
  4. 2023ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigationcited by 127
  5. 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 124
  6. 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 121
  7. 2023L3MVN: Leveraging Large Language Models for Visual Target Navigationcited by 120
  8. 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 118
  9. 2023Discuss Before Moving: Visual Language Navigation via Multi-expert Discussionscited by 110
  10. 2019General Evaluation for Instruction Conditioned Navigation using Dynamic Time Warpingcited by 105
  11. 2018Mapping Instructions to Actions in 3D Environments with Visual Goal Predictioncited by 101
  12. 2024NavGPT-2: Unleashing Navigational Reasoning Capability for Large Vision-Language Modelscited by 98
  13. 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 95
  14. 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigationcited by 89
  15. 2025Embodied Navigation Foundation Modelcited by 72
  16. 2023A2Nav: Action-Aware Zero-Shot Robot Navigation by Exploiting Vision-and-Language Ability of Foundation Modelscited by 62
  17. 2024VoroNav: Voronoi-based Zero-shot Object Navigation with Large Language Modelcited by 57
  18. 2022Aerial Vision-and-Dialog Navigationcited by 49
  19. 2025OctoNav: Towards Generalist Embodied Navigationcited by 34
  20. 2025UAV-ON: A Benchmark for Open-World Object Goal Navigation with Aerial Agentscited by 33
  21. 2025CityNavAgent: Aerial Vision-and-Language Navigation with Hierarchical Semantic Planning and Global Memorycited by 32
  22. 2025UAV-Flow Colosseo: A Real-World Benchmark for Flying-on-a-Word UAV Imitation Learningcited by 31
  23. 2024AeroVerse: UAV-Agent Benchmark Suite for Simulating, Pre-training, Finetuning, and Evaluating Aerospace Embodied World Modelscited by 25
  24. 2025FlightGPT: Towards Generalizable and Interpretable UAV Vision-and-Language Navigation with Vision-Language Modelscited by 22
  25. 2025Grounded Vision-Language Navigation for UAVs with Open-Vocabulary Goal Understandingcited by 19
  26. 2024NavAgent: Multi-scale Urban Street View Fusion For UAV Embodied Vision-and-Language Navigationcited by 18
  27. 2024TopV-Nav: Unlocking the Top-View Spatial Reasoning Potential of MLLM for Zero-shot Object Navigationcited by 15
  28. 2025SkyVLN: Vision-and-Language Navigation and NMPC Control for UAVs in Urban Environmentscited by 14
  29. 2025AeroDuo: Aerial Duo for UAV-based Vision and Language Navigationcited by 13
  30. 2025UAV-VLN: End-to-End Vision Language guided Navigation for UAVscited by 11
  31. 2025LogisticsVLN: Vision-Language Navigation For Low-Altitude Terminal Delivery Based on Agentic UAVscited by 9
  32. 2025VLM-RRT: Vision Language Model Guided RRT Search for Autonomous UAV Navigationcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.