mlsanityData to 14 Oct 2026

Parse, Search, and Confirmation: Training-Free Aerial Vision-and-Dialog Navigation with Chain-of-Thought Reasoning and Structured Spatial Memory

arXiv 2607.11529 ↗First posted 13 Jul 2026cs.CVcited by 1

On the map: LLM reasoning → Spatial and embodied reasoning

Abstract (arXiv)

In this paper, we tackle the Aerial Vision-and-Dialog Navigation (AVDN) task in the training-free setting for resource-efficient high-altitude UAV navigation.Naively applying MLLMs leads to unreliable navigation due to weak directional grounding and the lack of explicit spatial memory.To address these issues, we propose PSC-AVDN, a training-free framework that tightly couples a three-stage Parsing-Search-Confirmation reasoning pipeline with a Structured Spatial Memory (SSM).The parsing stage uses an LLM to convert ambiguous dialogue instructions into stable geometric directional and destination cues.A Search Chain-of-Thought (S-CoT) then performs stepwise target exploration under high-altitude observations, and a Confirmation Chain-of-Thought (C-CoT) conducts fine-grained verification around candidate regions to resolve visual ambiguity.Meanwhile, SSM integrates three complementary sources of spatial cues, including multi-scale visual observation, spatial visual memory, and structured geometric memory to provide global spatial context and long-horizon consistency.Extensive experiments on ANDH and ANDH-Full show that PSC-AVDN establishes new state-of-the-art performance in the training-free setting, matching or surpassing several finetuned methods.Code will be publicly available at: https://github.com/QY6616/PSC-AVDN

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 44 of its 49 references that are in the map. First posted on arXiv 13 Jul 2026.

Builds on

44 of 49 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025Open-World 3D Scene Graph Generation for Retrieval-Augmented Reasoning8 Nov
  2. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
  3. 2024TopV-Nav: Unlocking the Top-View Spatial Reasoning Potential of MLLM for Zero-shot Object Navigation25 Nov
  4. 2024Exploring Spatial Representation to Enhance LLM Reasoning in Aerial Vision-Language Navigation11 Oct
  5. 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models3 Jun
  6. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan

Other references · 38

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  3. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
  4. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
  5. 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
  6. 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
  7. 2025Seed1.5-VL Technical Reportcited by 373
  8. 2015LSTM: A Search Space Odysseycited by 316
  9. 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoningcited by 280
  10. 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Modelscited by 268
  11. 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thoughtcited by 206
  12. 2023OneLLM: One Framework to Align All Modalities with Languagecited by 187
26 more
  1. 2021Episodic Transformer for Vision-and-Language Navigationcited by 156
  2. 2024Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Modelscited by 116
  3. 2023Discuss Before Moving: Visual Language Navigation via Multi-expert Discussionscited by 110
  4. 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 95
  5. 2024Mono-InternVL: Pushing the Boundaries of Monolithic Multimodal Large Language Models with Endogenous Visual Pre-trainingcited by 82
  6. 2024Open-Nav: Exploring Zero-Shot Vision-and-Language Navigation in Continuous Environment with Open-Source LLMscited by 62
  7. 2025LLaVA-ST: A Multimodal Large Language Model for Fine-Grained Spatial-Temporal Understandingcited by 59
  8. 2021SOAT: A Scene- and Object-Aware Transformer for Vision-and-Language Navigationcited by 53
  9. 2022Aerial Vision-and-Dialog Navigationcited by 49
  10. 2025UAVs Meet LLMs: Overviews and Perspectives Toward Agentic Low-Altitude Mobilitycited by 49
  11. 2023Learning Vision-and-Language Navigation from YouTube Videoscited by 47
  12. 2024GeoGround: A Unified Large Vision-Language Model for Remote Sensing Visual Groundingcited by 47
  13. 2025Openfly: A comprehensive platform for aerial vision-language navigationcited by 46
  14. 2024CityNav: A Large-Scale Dataset for Real-World Aerial Navigationcited by 42
  15. 2025RemoteSAM: Towards Segment Anything for Earth Observationcited by 39
  16. 2023Visual cognition in multimodal large language modelscited by 38
  17. 2025UrbanVideo-Bench: Benchmarking Vision-Language Models on Embodied Intelligence with Video Data in Urban Spacescited by 36
  18. 2025UAV-ON: A Benchmark for Open-World Object Goal Navigation with Aerial Agentscited by 33
  19. 2024Putting GPT-4o to the Sword: A Comprehensive Evaluation of Language, Vision, Speech, and Multimodal Proficiencycited by 31
  20. 2024Unleashing the Temporal-Spatial Reasoning Capacity of GPT for Training-Free Audio and Language Referenced Video Object Segmentationcited by 19
  21. 2024NavAgent: Multi-scale Urban Street View Fusion For UAV Embodied Vision-and-Language Navigationcited by 18
  22. 2024Video2BEV: Transforming Drone Videos to BEVs for Video-based Geo-localizationcited by 17
  23. 2025Advancing Audio-Visual Navigation Through Multi-Agent Collaboration in 3D Environmentscited by 14
  24. 2025Multimodal Large Language Models-Enabled UAV Swarm: Towards Efficient and Intelligent Autonomous Aerial Systemscited by 7
  25. 2023Target-Grounded Graph-Aware Transformer for Aerial Vision-and-Dialog Navigationcited by 2
  26. 2026From Instruction to Event: Sound-Triggered Mobile Manipulationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026LookasideVLN: Direction-Aware Aerial Vision-and-Language Navigation
  2. 2026Dual-Layer Semantic-Spatial Belief Mapping for Aerial Object Goal Navigation
  3. 2026CLOSER-VLN: Closed-Loop Self-Verified Retrieval-Augmented Reasoning for Aerial Vision-Language Navigation
  4. 2025Aerial Vision-Language Navigation with a Unified Framework for Spatial, Temporal and Embodied Reasoning
  5. 2026AirAnchor: Bridging Local and Global Spatial Information for Zero-Shot Aerial Vision-and-Language Navigation
  6. 2026APEX: A Decoupled Memory-based Explorer for Asynchronous Aerial Object Goal Navigation
  7. 2025GeoNav: Empowering MLLMs with dual-scale geospatial reasoning for language-goal aerial navigation
  8. 2025UAV-VLN: End-to-End Vision Language guided Navigation for UAVs