mlsanityData to 14 Oct 2026

Turning Adaptation into Assets: Cross-Domain Bridging for Online Vision-Language Navigation

arXiv 2605.23257 ↗First posted 22 May 2026cs.RO cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Navigating under non-stationary environment shifts poses a critical challenge for a Vision-and-Language Navigation (VLN) agent deployed in the wild. Yet, existing Test-Time Adaptation (TTA) methods for VLN largely treat online adaptation as transient, isolated updates, leading to catastrophic forgetting and negative transfer. To overcome these issues, we propose Inter-Domain BridgE with Historical Assets (IDEA), a novel TTA framework that transforms adaptation into the accumulation and composition of assets. Specifically, IDEA introduces soft prompts optimized via a Fisher-guided weighting scheme to capture the transferable knowledge. These optimized prompts are then augmented with domain coordinates to form a dynamic asset library. Leveraging this library, IDEA constructs a cross-domain bridge by projecting the target domain onto the convex hull of historical knowledge. These designs form a complementary loop: the evolving library underpins bridge construction, while the bridge provides superior initialization to accelerate asset optimization. Extensive experiments across REVERIE, R2R, and R2R-CE benchmarks demonstrate the consistent superiority of IDEA over existing methods, showcasing its ability to enable training-free adaptation via asset sharing.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 41 of its 48 references that are in the map. First posted on arXiv 22 May 2026.

Builds on

41 of 48 references.

References · 41

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
  3. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  4. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
  5. 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
  6. 2023Towards Stable Test-Time Adaptation in Dynamic Wild Worldcited by 415
  7. 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 359
  8. 2018Speaker-Follower Models for Vision-and-Language Navigationcited by 340
  9. 2019REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environmentscited by 333
  10. 2020A Recurrent Vision-and-Language BERT for Navigationcited by 302
  11. 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 271
  12. 2020Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-trainingcited by 231
29 more
  1. 2022Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigationcited by 193
  2. 2022Parameter-free Online Test-time Adaptationcited by 189
  3. 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 169
  4. 2021The Norm Must Go On: Dynamic Unsupervised Domain Adaptation by Normalizationcited by 131
  5. 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 124
  6. 2022BEVBert: Multimodal Map Pre-training for Language-guided Navigationcited by 122
  7. 2022Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directionscited by 117
  8. 2024Entropy is not Enough for Test-Time Adaptation: From the Perspective of Disentangled Factorscited by 106
  9. 2023TTN: A Domain-Shift Aware Batch Normalization in Test-Time Adaptationcited by 101
  10. 2020Language and Visual Entity Relationship Graph for Agent Navigationcited by 100
  11. 2023DELTA: degradation-free fully test-time adaptationcited by 72
  12. 2024Towards Long-Horizon Vision-Language Navigation: Platform, Benchmark and Methodcited by 67
  13. 2024Volumetric Environment Representation for Vision-Language Navigationcited by 63
  14. 2022Learning from Unlabeled 3D Environments for Vision-and-Language Navigationcited by 50
  15. 2023Towards Open-Set Test-Time Adaptation Utilizing the Wisdom of Crowds in Entropy Minimizationcited by 39
  16. 2023Test-Time Adaptation with CLIP Reward for Zero-Shot Generalization in Vision-Language Modelscited by 38
  17. 2022Reinforced Structured State-Evolution for Vision-Language Navigationcited by 37
  18. 2025OctoNav: Towards Generalist Embodied Navigationcited by 34
  19. 2023Continual-MAE: Adaptive Distribution Masked Autoencoders for Continual Test-Time Adaptationcited by 30
  20. 2023Fast-Slow Test-Time Adaptation for Online Vision-and-Language Navigationcited by 25
  21. 2023GeoVLN: Learning Geometry-Enhanced Visual Representation with Slot Attention for Vision-and-Language Navigationcited by 24
  22. 2022MATE: Masked Autoencoders are Online 3D Test-Time Learnerscited by 23
  23. 2024Uncertainty-Calibrated Test-Time Model Adaptation without Forgettingcited by 20
  24. 2023Evaluation of Test-Time Adaptation Under Computational Time Constraintscited by 15
  25. 2025Beyond Entropy: Region Confidence Proxy for Wild Test-Time Adaptationcited by 11
  26. 2025Active Test-time Vision-Language Navigationcited by 7
  27. 2025NavQ: Learning a Q-Model for Foresighted Vision-and-Language Navigationcited by 6
  28. 2025LEAD: Exploring Logit Space Evolution for Model Selectioncited by 3
  29. 2025Adaptive Dual Uncertainty Optimization: Boosting Monocular 3D Object Detection under Test-Time Shiftscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.