Mitigating Error Accumulation in Continuous Navigation via Memory-Augmented Kalman Filtering
Not on the map. Why?
Abstract (arXiv)
Continuous navigation in complex environments is critical for Unmanned Aerial Vehicle (UAV). However, the existing Vision-Language Navigation (VLN) models follow the dead-reckoning, which iteratively updates its position for the next waypoint prediction, and subsequently construct the complete trajectory. Then, such stepwise manner will inevitably lead to accumulated errors of position over time, resulting in misalignment between internal belief and objective coordinates, which is known as "state drift" and ultimately compromises the full trajectory prediction. Drawing inspiration from classical control theory, we propose to correct for errors by formulating such sequential prediction as a recursive Bayesian state estimation problem. In this paper, we design NeuroKalman, a novel framework that decouples navigation into two complementary processes: a Prior Prediction, based on motion dynamics and a Likelihood Correction, from historical observation. We first mathematically associate Kernel Density Estimation of the measurement likelihood with the attention-based retrieval mechanism, which then allows the system to rectify the latent representation using retrieved historical anchors without gradient updates. Comprehensive experiments on TravelUAV benchmark demonstrate that, with only 10% of the training data fine-tuning, our method clearly outperforms strong baselines and regulates drift accumulation.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 41 of its 51 references that are in the map. First posted on arXiv 30 Jan 2026.
Builds on
41 of 51 references.
References · 41
- 2017Attention Is All You Needcited by 59,932
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
- 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,830
- 2020Rethinking Attention with Performerscited by 1,584
- 2021Improving language models by retrieving from trillions of tokenscited by 1,278
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
- 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 788
- 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 786
- 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 517
29 more
- 2022Efficient Test-Time Model Adaptation without Forgettingcited by 467
- 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 430
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 429
- 2018Speaker-Follower Models for Vision-and-Language Navigationcited by 337
- 2020A Recurrent Vision-and-Language BERT for Navigationcited by 300
- 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 268
- 2018Semi-parametric Topological Memory for Navigationcited by 203
- 2022Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigationcited by 187
- 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 183
- 2019Stay on the Path: Instruction Fidelity in Vision-and-Language Navigationcited by 129
- 2021KalmanNet: Neural Network Aided Kalman Filtering for Partially Known Dynamicscited by 128
- 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 117
- 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 92
- 2022Cross-modal Map Learning for Vision and Language Navigationcited by 91
- 2024SAMURAI: Adapting Segment Anything Model for Zero-Shot Visual Tracking with Motion-Aware Memorycited by 91
- 2018Stable Recurrent Modelscited by 65
- 2025Embodied Navigation Foundation Modelcited by 65
- 2019Recurrent Kalman Networks: Factorized Inference in High-Dimensional Deep Feature Spacescited by 64
- 2024Vision-and-Language Navigation via Causal Learningcited by 51
- 2022Aerial Vision-and-Dialog Navigationcited by 48
- 2016Backprop KF: Learning Discriminative Deterministic State Estimatorscited by 47
- 2025Openfly: A comprehensive platform for aerial vision-language navigationcited by 43
- 2024CityNav: A Large-Scale Dataset for Real-World Aerial Navigationcited by 40
- 2025CityNavAgent: Aerial Vision-and-Language Navigation with Hierarchical Semantic Planning and Global Memorycited by 30
- 2023Fast-Slow Test-Time Adaptation for Online Vision-and-Language Navigationcited by 25
- 2020How to Train Your Differentiable Filtercited by 23
- 2025FlightGPT: Towards Generalizable and Interpretable UAV Vision-and-Language Navigation with Vision-Language Modelscited by 22
- 2025SkyVLN: Vision-and-Language Navigation and NMPC Control for UAVs in Urban Environmentscited by 14
- 2025OpenVLN: Open-world Aerial Vision-Language Navigationcited by 12
Built on by
Citing papers per year: 2026: 1.
1 paper.