Lifelong Embodied Navigation Learning
Not on the map. Why?
Abstract (arXiv)
Embodied navigation agents powered by large language models have shown strong performance on individual tasks but struggle to continually acquire new navigation skills, which suffer from catastrophic forgetting. We formalize this challenge as lifelong embodied navigation learning (LENL), where an agent is required to adapt to a sequence of navigation tasks spanning multiple scenes and diverse user instruction styles, while retaining previously learned knowledge. To tackle this problem, we propose Uni-Walker, a lifelong embodied navigation framework that decouples navigation knowledge into task-shared and task-specific components with Decoder Extension LoRA (DE-LoRA). To learn the shared knowledge, we design a knowledge inheritance strategy and an experts co-activation strategy to facilitate shared knowledge transfer and refinement across multiple navigation tasks. To learn the specific knowledge, we propose an expert subspace orthogonality constraint together and a navigation-specific chain-of-thought reasoning mechanism to capture specific knowledge and enhance instruction-style understanding. Extensive experiments demonstrate the superiority of Uni-Walker for building universal navigation agents with lifelong learning.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 52 of its 66 references that are in the map. First posted on arXiv 6 Mar 2026.
Builds on
52 of 66 references.
References · 52
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Visual Instruction Tuningcited by 7,792
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
- 2016Learning without Forgettingcited by 2,465
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
- 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 786
- 2023A Comprehensive Overview of Large Language Modelscited by 639
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 429
- 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 401
38 more
- 2019REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environmentscited by 330
- 2023Orthogonal Subspace Learning for Language Model Continual Learningcited by 296
- 2021Rainbow Memory: Continual Learning with a Memory of Diverse Samplescited by 273
- 2024Navigation World Modelscited by 262
- 2019Vision-and-Dialog Navigationcited by 246
- 2023Towards Learning a Generalist Model for Embodied Navigationcited by 135
- 2023Language Models Meet World Models: Embodied Experiences Enhance Language Modelscited by 123
- 2024HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuningcited by 118
- 2020Topological Planning with Transformers for Vision-and-Language Navigationcited by 115
- 2023Scaling Data Generation in Vision-and-Language Navigationcited by 115
- 2020Continual Learning with Node-Importance based Adaptive Group Sparse Regularizationcited by 102
- 2024Higher Layers Need More LoRA Expertscited by 101
- 2020Language and Visual Entity Relationship Graph for Agent Navigationcited by 100
- 2021Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environmentscited by 87
- 2022Weakly-Supervised Multi-Granularity Map Learning for Vision-and-Language Navigationcited by 86
- 2025Universal Actions for Enhanced Embodied Foundation Modelscited by 80
- 2023LOTUS: Continual Imitation Learning for Robot Manipulation Through Unsupervised Skill Discoverycited by 63
- 2024CoIN: A Benchmark of Continual Instruction tuNing for Multimodel Large Language Modelcited by 60
- 2024Towards Lifelong Learning of Large Language Models: A Surveycited by 60
- 2024Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learningcited by 53
- 2024GaussNav: Gaussian Splatting for Visual Navigationcited by 49
- 2024Recent Advances of Foundation Language Models-based Continual Learning: A Surveycited by 46
- 2022Exploring Example Influence in Continual Learningcited by 44
- 2022CoSCL: Cooperation of Small Continual Learners is Stronger than a Big Onecited by 43
- 2025WMNav: Integrating Vision-Language Models into World Models for Object Goal Navigationcited by 42
- 2025OctoNav: Towards Generalist Embodied Navigationcited by 33
- 2020Incremental Learning via Rate Reductioncited by 31
- 2021Kernel Continual Learningcited by 27
- 2025NavBench: Probing Multimodal Large Language Models for Embodied Navigationcited by 24
- 2024RoomTour3D: Geometry-Aware Video-Instruction Tuning for Embodied Navigationcited by 23
- 2024Unleashing the Power of Continual Learning on Non-Centralized Devices: A Surveycited by 23
- 2025Locate 3D: Real-World Object Localization via Self-Supervised Learning in 3Dcited by 23
- 2024SAME: Learning Generic Language-Guided Visual Navigation with State-Adaptive Mixture of Expertscited by 16
- 2025PixelVLA: Advancing Pixel-level Understanding in Vision-Language-Action Modelcited by 16
- 2025Enhancing Multimodal Continual Instruction Tuning with BranchLoRAcited by 14
- 2025NavA3: Understanding Any Instruction, Navigating Anywhere, Finding Anythingcited by 14
- 2025Think Small, Act Big: Primitive Prompt Learning for Lifelong Robot Manipulationcited by 13
- 2024Never-Ending Behavior-Cloning Agent for Robotic Manipulationcited by 10
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026All-day Multi-scenes Lifelong Vision-and-Language Navigation with Tucker Adaptationcited by 1
- 2026SAB-LVLM: Significance-Aware Binarization for Large Vision-Language Modelscited by 1
- 2026Robo-Cortex: A Self-Evolving Embodied Agent via Dual-Grain Cognitive Memory and Autonomous Knowledge Inductioncited by 0
- 2026SAB-LVLM: Significance-Aware Binarization for Large Vision-Language Models2 Jul 2026
- 2026Robo-Cortex: A Self-Evolving Embodied Agent via Dual-Grain Cognitive Memory and Autonomous Knowledge Induction18 May 2026
- 2026All-day Multi-scenes Lifelong Vision-and-Language Navigation with Tucker Adaptation15 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026NavHarness: Towards Lifelong Embodied Navigation
- 2026HarnessVLN: Unifying Training-Free Embodied Navigation through an Agent Harness
- 2026Scaffolding Foundation Models into Physical-World Agents Pushes the Frontier of Long-Horizon Navigation
- 2026ABot-N0: Technical Report on the VLA Foundation Model for Versatile Embodied Navigation
- 2026VLingNav: Embodied Navigation with Adaptive Reasoning and Visual-Assisted Linguistic Memory
- 2026Explore with Long-term Memory: A Benchmark and Multimodal LLM-based Reinforcement Learning Framework for Embodied Exploration
- 2024TANGO: Training-free Embodied AI Agents for Open-world Tasks
- 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Models