textscNaVIDA: Vision-Language Navigation with Inverse Dynamics Augmentation
Not on the map. Why?
Abstract (arXiv)
Vision-and-Language Navigation (VLN) requires agents to interpret natural language instructions and act coherently in visually rich environments. However, most existing methods rely on reactive state-action mappings without explicitly action-grounded visual dynamics modeling. Lacking awareness of how actions transform subsequent visual observations, agents cannot plan actions rationally, leading to unstable behaviors, weak generalization, and cumulative error along trajectory. To address these issues, we introduce textscNaVIDA (Navigation with Inverse Dynamics Augmentation), a lightweight VLN framework that incorporates inverse dynamics supervision (IDS) as an explicit objective to embed action-grounded visual dynamics into policy learning. By jointly optimizing this visual dynamics with instruction-conditioned action prediction in a shared representation and action space, textscNaVIDA provides additional structured supervision that regularizes learning and leads to more stable and consistent navigation. To structure this supervision and extend the effective planning range, textscNaVIDA employs hierarchical probabilistic action chunking (HPAC), which organizes trajectories into multi-step chunks and provides discriminative, longer-range visual-change cues. Extensive experiments show that textscNaVIDA achieves superior navigation performance compared to state-of-the-art methods with fewer parameters (3B vs. 8B). Real-world robot evaluations further validate the practical feasibility and effectiveness of our approach.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 46 of its 51 references that are in the map. First posted on arXiv 26 Jan 2026.
Builds on
46 of 51 references.
References · 46
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 429
- 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 401
- 2020A Recurrent Vision-and-Language BERT for Navigationcited by 300
- 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 268
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 222
- 2024NVILA: Efficient Frontier Visual Language Modelscited by 206
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 201
34 more
- 2025Real-Time Execution of Action Chunking Flow Policiescited by 199
- 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 165
- 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 150
- 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 146
- 2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigationcited by 127
- 2021Waypoint Models for Instruction-guided Navigation in Continuous Environmentscited by 125
- 2022BEVBert: Multimodal Map Pre-training for Language-guided Navigationcited by 117
- 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 117
- 2023Scaling Data Generation in Vision-and-Language Navigationcited by 115
- 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 107
- 2022Cross-modal Map Learning for Vision and Language Navigationcited by 91
- 2021Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environmentscited by 87
- 2023DREAMWALKER: Mental Planning for Continuous Vision-Language Navigationcited by 82
- 2022Sim-2-Sim Transfer for Vision-and-Language Navigation in Continuous Environmentscited by 80
- 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigationcited by 80
- 2018Vision-based Navigation with Language-based Assistance via Imitation Learning with Indirect Interventioncited by 77
- 2023Bird's-Eye-View Scene Graph for Vision-Language Navigationcited by 71
- 2023VELMA: Verbalization Embodiment of LLM Agents for Vision and Language Navigation in Street Viewcited by 67
- 2025Embodied Navigation Foundation Modelcited by 65
- 2024Lookahead Exploration with Neural Radiance Representation for Continuous Vision-Language Navigationcited by 63
- 2023Improving Vision-and-Language Navigation by Generating Future-View Image Semanticscited by 46
- 2025NavDP: Learning Sim-to-Real Navigation Diffusion Policy with Privileged Information Guidancecited by 46
- 2025NavMorph: A Self-Evolving World Model for Vision-and-Language Navigation in Continuous Environmentscited by 41
- 2024Sim-to-Real Transfer via 3D Feature Fields for Vision-and-Language Navigationcited by 34
- 2022Towards Versatile Embodied Navigationcited by 26
- 2025Rethinking the Embodied Gap in Vision-and-Language Navigation: A Holistic Study of Physical and Visual Disparitiescited by 24
- 2025Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigationcited by 19
- 2025Cross from Left to Right Brain: Adaptive Text Dreamer for Vision-and-Language Navigationcited by 16
- 2025MonoDream: Monocular Vision-Language Navigation with Panoramic Dreamingcited by 15
- 2020Towards Target-Driven Visual Navigation in Indoor Scenes via Generative Imitation Learningcited by 14
- 2025ActiveVLN: Towards Active Exploration via Multi-Turn RL in Vision-and-Language Navigationcited by 11
- 2024UnitedVLN: Generalizable Gaussian Splatting for Continuous Vision-Language Navigationcited by 9
- 2025VISTA: Generative Visual Imagination for Vision-and-Language Navigationcited by 8
- 2023Masked Path Modeling for Vision-and-Language Navigationcited by 4
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026PanoWorld: Towards Spatial Supersensing in 360^circ Panorama Worldcited by 5
- 2026Continue or Replan? Bernoulli-Continuation Policy Learning for Adaptive Horizon Executioncited by 3
- 2026From Routes to Steps: Separating Semantic Progress from Local Execution in Vision-and-Language Navigationcited by 1
- 2026What Limits Vision-and-Language Navigation ?cited by 0
- 2026RECAST: Recasting Vision-Language Semantics into an Actionable Cost Map for Robot Navigationcited by 0
- 2026RECAST: Recasting Vision-Language Semantics into an Actionable Cost Map for Robot Navigation26 Sep 2026
- 2026Continue or Replan? Bernoulli-Continuation Policy Learning for Adaptive Horizon Execution4 Aug 2026
- 2026From Routes to Steps: Separating Semantic Progress from Local Execution in Vision-and-Language Navigation4 Aug 2026
- 2026What Limits Vision-and-Language Navigation ?13 May 2026
- 2026PanoWorld: Towards Spatial Supersensing in 360^circ Panorama World13 May 2026