mlsanityData to 14 Oct 2026

DreamFly: Causal Memory and Receding-Horizon Diffusion Planning for Aerial Vision-Language Navigation

arXiv 2608.12308 ↗First posted 12 Aug 2026cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Aerial vision-language navigation (VLN) requires an embodied agent to integrate visual evidence over time, plan future actions, and determine when it has reached a navigation goal under partial observability. Although recent VLA models offer a promising perception-to-action paradigm, adapting them to aerial navigation remains challenging due to limited historical context, short planning horizons, and unreliable implicit termination. To address these challenges, we propose DreamFly, a diffusion-based aerial VLN framework built on Dream-VLA. DreamFly introduces a causally aligned historical memory that augments the current visual representation using only observations preceding the current decision step, enabling temporal reasoning without future information leakage. We further formulate navigation as receding-horizon diffusion planning, where the policy predicts a K-step action chunk but executes only the first action before replanning. This plan-K, execute-one strategy uses future actions as auxiliary planning targets while preserving closed-loop visual feedback. Finally, LiteStop estimates the stop probability directly from action logits at the initial all-mask state, decoupling explicit termination from action generation. Experiments on the OpenFly benchmark demonstrate consistent improvements in seen and unseen environments. DreamFly achieves 32.04%/29.46% SR and 28.22%/23.54% SPL on the test-seen/test-unseen splits, respectively, outperforming all compared methods on both metrics while attaining the lowest navigation error. These results demonstrate the effectiveness of jointly modeling historical context, future action structure, and explicit termination for aerial VLN.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 32 of its 33 references that are in the map. First posted on arXiv 12 Aug 2026.

Builds on

32 of 33 references.

References · 32

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  2. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  3. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  4. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  5. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
  6. 2018Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigationcited by 305
  7. 2020A Recurrent Vision-and-Language BERT for Navigationcited by 302
  8. 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 271
  9. 2025Real-Time Execution of Action Chunking Flow Policiescited by 216
  10. 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 213
  11. 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 124
  12. 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 121
20 more
  1. 2021Structured Scene Memory for Vision-Language Navigationcited by 95
  2. 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 95
  3. 2024Bidirectional Decoding: Improving Action Chunking via Guided Test-Time Samplingcited by 52
  4. 2022Aerial Vision-and-Dialog Navigationcited by 49
  5. 2025Openfly: A comprehensive platform for aerial vision-language navigationcited by 46
  6. 2024CityNav: A Large-Scale Dataset for Real-World Aerial Navigationcited by 42
  7. 2025FlightGPT: Towards Generalizable and Interpretable UAV Vision-and-Language Navigation with Vision-Language Modelscited by 22
  8. 2020Learning to Stop: A Simple yet Effective Approach to Urban Vision-Language Navigationcited by 20
  9. 2024Exploring Spatial Representation to Enhance LLM Reasoning in Aerial Vision-Language Navigationcited by 20
  10. 2025Dream-VL & Dream-VLA: Open Vision-Language and Vision-Language-Action Models with Diffusion Language Model Backbonecited by 18
  11. 2025LongFly: Long-Horizon UAV Vision-and-Language Navigation with Spatiotemporal Context Integrationcited by 14
  12. 2026WorldVLN: Autoregressive World Action Model for Aerial Vision-Language Navigationcited by 14
  13. 2025Aerial Vision-and-Language Navigation with Grid-based View Selection and Map Constructioncited by 12
  14. 2026AerialVLA: A Vision-Language-Action Model for UAV Navigation via Minimalist End-to-End Controlcited by 11
  15. 2026AirNav: A Large-Scale UAV Vision-and-Language Navigation Dataset with Natural and Diverse Instructionscited by 7
  16. 2025History-Enhanced Two-Stage Transformer for Aerial Vision-and-Language Navigationcited by 6
  17. 2026ImagineUAV: Aerial Vision-Language Navigation via World-Action Modeling and Kinodynamic Planningcited by 6
  18. 2026FineCog-Nav: Integrating Fine-grained Cognitive Modules for Zero-shot Multimodal UAV Navigationcited by 4
  19. 2026LookasideVLN: Direction-Aware Aerial Vision-and-Language Navigationcited by 3
  20. 2026FSD-VLN: Fast-Slow Dual-System Modeling for Aerial Long-Horizon Vision-Language Navigationcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026ForeFly: A Dual-Horizon World Action Model for Aerial Vision-Language Navigation
  2. 2026Guided Diffusion with Distilled Vision-Language Reliability for Aerial Navigation
  3. 2025CityNavAgent: Aerial Vision-and-Language Navigation with Hierarchical Semantic Planning and Global Memory
  4. 2026LatentPilot: Scene-Aware Vision-and-Language Navigation by Dreaming Ahead with Latent Visual Reasoning
  5. 2026APEX: A Decoupled Memory-based Explorer for Asynchronous Aerial Object Goal Navigation
  6. 2026CLOSER-VLN: Closed-Loop Self-Verified Retrieval-Augmented Reasoning for Aerial Vision-Language Navigation
  7. 2026WorldFly: A World-Model-Based Vision-Language-Action Model for UAV Navigation
  8. 2026VLN on the Fly: An Onboard Vision-Language Navigation Stack for Aerial Robots