Turning Adaptation into Assets: Cross-Domain Bridging for Online Vision-Language Navigation
Not on the map. Why?
Abstract (arXiv)
Navigating under non-stationary environment shifts poses a critical challenge for a Vision-and-Language Navigation (VLN) agent deployed in the wild. Yet, existing Test-Time Adaptation (TTA) methods for VLN largely treat online adaptation as transient, isolated updates, leading to catastrophic forgetting and negative transfer. To overcome these issues, we propose Inter-Domain BridgE with Historical Assets (IDEA), a novel TTA framework that transforms adaptation into the accumulation and composition of assets. Specifically, IDEA introduces soft prompts optimized via a Fisher-guided weighting scheme to capture the transferable knowledge. These optimized prompts are then augmented with domain coordinates to form a dynamic asset library. Leveraging this library, IDEA constructs a cross-domain bridge by projecting the target domain onto the convex hull of historical knowledge. These designs form a complementary loop: the evolving library underpins bridge construction, while the bridge provides superior initialization to accelerate asset optimization. Extensive experiments across REVERIE, R2R, and R2R-CE benchmarks demonstrate the consistent superiority of IDEA over existing methods, showcasing its ability to enable training-free adaptation via asset sharing.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 41 of its 48 references that are in the map. First posted on arXiv 22 May 2026.
Builds on
41 of 48 references.
References · 41
- 2017Attention Is All You Needcited by 60,361
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
- 2023Towards Stable Test-Time Adaptation in Dynamic Wild Worldcited by 415
- 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 359
- 2018Speaker-Follower Models for Vision-and-Language Navigationcited by 340
- 2019REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environmentscited by 333
- 2020A Recurrent Vision-and-Language BERT for Navigationcited by 302
- 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 271
- 2020Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-trainingcited by 231
29 more
- 2022Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigationcited by 193
- 2022Parameter-free Online Test-time Adaptationcited by 189
- 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 169
- 2021The Norm Must Go On: Dynamic Unsupervised Domain Adaptation by Normalizationcited by 131
- 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 124
- 2022BEVBert: Multimodal Map Pre-training for Language-guided Navigationcited by 122
- 2022Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directionscited by 117
- 2024Entropy is not Enough for Test-Time Adaptation: From the Perspective of Disentangled Factorscited by 106
- 2023TTN: A Domain-Shift Aware Batch Normalization in Test-Time Adaptationcited by 101
- 2020Language and Visual Entity Relationship Graph for Agent Navigationcited by 100
- 2023DELTA: degradation-free fully test-time adaptationcited by 72
- 2024Towards Long-Horizon Vision-Language Navigation: Platform, Benchmark and Methodcited by 67
- 2024Volumetric Environment Representation for Vision-Language Navigationcited by 63
- 2022Learning from Unlabeled 3D Environments for Vision-and-Language Navigationcited by 50
- 2023Towards Open-Set Test-Time Adaptation Utilizing the Wisdom of Crowds in Entropy Minimizationcited by 39
- 2023Test-Time Adaptation with CLIP Reward for Zero-Shot Generalization in Vision-Language Modelscited by 38
- 2022Reinforced Structured State-Evolution for Vision-Language Navigationcited by 37
- 2025OctoNav: Towards Generalist Embodied Navigationcited by 34
- 2023Continual-MAE: Adaptive Distribution Masked Autoencoders for Continual Test-Time Adaptationcited by 30
- 2023Fast-Slow Test-Time Adaptation for Online Vision-and-Language Navigationcited by 25
- 2023GeoVLN: Learning Geometry-Enhanced Visual Representation with Slot Attention for Vision-and-Language Navigationcited by 24
- 2022MATE: Masked Autoencoders are Online 3D Test-Time Learnerscited by 23
- 2024Uncertainty-Calibrated Test-Time Model Adaptation without Forgettingcited by 20
- 2023Evaluation of Test-Time Adaptation Under Computational Time Constraintscited by 15
- 2025Beyond Entropy: Region Confidence Proxy for Wild Test-Time Adaptationcited by 11
- 2025Active Test-time Vision-Language Navigationcited by 7
- 2025NavQ: Learning a Q-Model for Foresighted Vision-and-Language Navigationcited by 6
- 2025LEAD: Exploring Logit Space Evolution for Model Selectioncited by 3
- 2025Adaptive Dual Uncertainty Optimization: Boosting Monocular 3D Object Detection under Test-Time Shiftscited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.