mlsanityData to 7 Oct 2026

Mitigating Error Accumulation in Continuous Navigation via Memory-Augmented Kalman Filtering

arXiv 2602.11183 ↗First posted 30 Jan 2026cs.RO cs.CV cs.SYcited by 1

Not on the map. Why?

Abstract (arXiv)

Continuous navigation in complex environments is critical for Unmanned Aerial Vehicle (UAV). However, the existing Vision-Language Navigation (VLN) models follow the dead-reckoning, which iteratively updates its position for the next waypoint prediction, and subsequently construct the complete trajectory. Then, such stepwise manner will inevitably lead to accumulated errors of position over time, resulting in misalignment between internal belief and objective coordinates, which is known as "state drift" and ultimately compromises the full trajectory prediction. Drawing inspiration from classical control theory, we propose to correct for errors by formulating such sequential prediction as a recursive Bayesian state estimation problem. In this paper, we design NeuroKalman, a novel framework that decouples navigation into two complementary processes: a Prior Prediction, based on motion dynamics and a Likelihood Correction, from historical observation. We first mathematically associate Kernel Density Estimation of the measurement likelihood with the attention-based retrieval mechanism, which then allows the system to rectify the latent representation using retrieved historical anchors without gradient updates. Comprehensive experiments on TravelUAV benchmark demonstrate that, with only 10% of the training data fine-tuning, our method clearly outperforms strong baselines and regulates drift accumulation.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 41 of its 51 references that are in the map. First posted on arXiv 30 Jan 2026.

Builds on

41 of 51 references.

References · 41

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
  4. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  5. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
  6. 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,830
  7. 2020Rethinking Attention with Performerscited by 1,584
  8. 2021Improving language models by retrieving from trillions of tokenscited by 1,278
  9. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
  10. 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 788
  11. 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 786
  12. 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 517
29 more
  1. 2022Efficient Test-Time Model Adaptation without Forgettingcited by 467
  2. 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 430
  3. 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 429
  4. 2018Speaker-Follower Models for Vision-and-Language Navigationcited by 337
  5. 2020A Recurrent Vision-and-Language BERT for Navigationcited by 300
  6. 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 268
  7. 2018Semi-parametric Topological Memory for Navigationcited by 203
  8. 2022Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigationcited by 187
  9. 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 183
  10. 2019Stay on the Path: Instruction Fidelity in Vision-and-Language Navigationcited by 129
  11. 2021KalmanNet: Neural Network Aided Kalman Filtering for Partially Known Dynamicscited by 128
  12. 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 117
  13. 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 92
  14. 2022Cross-modal Map Learning for Vision and Language Navigationcited by 91
  15. 2024SAMURAI: Adapting Segment Anything Model for Zero-Shot Visual Tracking with Motion-Aware Memorycited by 91
  16. 2018Stable Recurrent Modelscited by 65
  17. 2025Embodied Navigation Foundation Modelcited by 65
  18. 2019Recurrent Kalman Networks: Factorized Inference in High-Dimensional Deep Feature Spacescited by 64
  19. 2024Vision-and-Language Navigation via Causal Learningcited by 51
  20. 2022Aerial Vision-and-Dialog Navigationcited by 48
  21. 2016Backprop KF: Learning Discriminative Deterministic State Estimatorscited by 47
  22. 2025Openfly: A comprehensive platform for aerial vision-language navigationcited by 43
  23. 2024CityNav: A Large-Scale Dataset for Real-World Aerial Navigationcited by 40
  24. 2025CityNavAgent: Aerial Vision-and-Language Navigation with Hierarchical Semantic Planning and Global Memorycited by 30
  25. 2023Fast-Slow Test-Time Adaptation for Online Vision-and-Language Navigationcited by 25
  26. 2020How to Train Your Differentiable Filtercited by 23
  27. 2025FlightGPT: Towards Generalizable and Interpretable UAV Vision-and-Language Navigation with Vision-Language Modelscited by 22
  28. 2025SkyVLN: Vision-and-Language Navigation and NMPC Control for UAVs in Urban Environmentscited by 14
  29. 2025OpenVLN: Open-world Aerial Vision-Language Navigationcited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.