mlsanityData to 7 Oct 2026

textscNaVIDA: Vision-Language Navigation with Inverse Dynamics Augmentation

arXiv 2601.18188 ↗First posted 26 Jan 2026cs.CV cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

Vision-and-Language Navigation (VLN) requires agents to interpret natural language instructions and act coherently in visually rich environments. However, most existing methods rely on reactive state-action mappings without explicitly action-grounded visual dynamics modeling. Lacking awareness of how actions transform subsequent visual observations, agents cannot plan actions rationally, leading to unstable behaviors, weak generalization, and cumulative error along trajectory. To address these issues, we introduce textscNaVIDA (Navigation with Inverse Dynamics Augmentation), a lightweight VLN framework that incorporates inverse dynamics supervision (IDS) as an explicit objective to embed action-grounded visual dynamics into policy learning. By jointly optimizing this visual dynamics with instruction-conditioned action prediction in a shared representation and action space, textscNaVIDA provides additional structured supervision that regularizes learning and leads to more stable and consistent navigation. To structure this supervision and extend the effective planning range, textscNaVIDA employs hierarchical probabilistic action chunking (HPAC), which organizes trajectories into multi-step chunks and provides discriminative, longer-range visual-change cues. Extensive experiments show that textscNaVIDA achieves superior navigation performance compared to state-of-the-art methods with fewer parameters (3B vs. 8B). Real-world robot evaluations further validate the practical feasibility and effectiveness of our approach.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 46 of its 51 references that are in the map. First posted on arXiv 26 Jan 2026.

Builds on

46 of 51 references.

References · 46

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  4. 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
  5. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
  6. 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 429
  7. 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 401
  8. 2020A Recurrent Vision-and-Language BERT for Navigationcited by 300
  9. 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 268
  10. 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 222
  11. 2024NVILA: Efficient Frontier Visual Language Modelscited by 206
  12. 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 201
34 more
  1. 2025Real-Time Execution of Action Chunking Flow Policiescited by 199
  2. 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 165
  3. 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 150
  4. 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 146
  5. 2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigationcited by 127
  6. 2021Waypoint Models for Instruction-guided Navigation in Continuous Environmentscited by 125
  7. 2022BEVBert: Multimodal Map Pre-training for Language-guided Navigationcited by 117
  8. 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 117
  9. 2023Scaling Data Generation in Vision-and-Language Navigationcited by 115
  10. 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 107
  11. 2022Cross-modal Map Learning for Vision and Language Navigationcited by 91
  12. 2021Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environmentscited by 87
  13. 2023DREAMWALKER: Mental Planning for Continuous Vision-Language Navigationcited by 82
  14. 2022Sim-2-Sim Transfer for Vision-and-Language Navigation in Continuous Environmentscited by 80
  15. 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigationcited by 80
  16. 2018Vision-based Navigation with Language-based Assistance via Imitation Learning with Indirect Interventioncited by 77
  17. 2023Bird's-Eye-View Scene Graph for Vision-Language Navigationcited by 71
  18. 2023VELMA: Verbalization Embodiment of LLM Agents for Vision and Language Navigation in Street Viewcited by 67
  19. 2025Embodied Navigation Foundation Modelcited by 65
  20. 2024Lookahead Exploration with Neural Radiance Representation for Continuous Vision-Language Navigationcited by 63
  21. 2023Improving Vision-and-Language Navigation by Generating Future-View Image Semanticscited by 46
  22. 2025NavDP: Learning Sim-to-Real Navigation Diffusion Policy with Privileged Information Guidancecited by 46
  23. 2025NavMorph: A Self-Evolving World Model for Vision-and-Language Navigation in Continuous Environmentscited by 41
  24. 2024Sim-to-Real Transfer via 3D Feature Fields for Vision-and-Language Navigationcited by 34
  25. 2022Towards Versatile Embodied Navigationcited by 26
  26. 2025Rethinking the Embodied Gap in Vision-and-Language Navigation: A Holistic Study of Physical and Visual Disparitiescited by 24
  27. 2025Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigationcited by 19
  28. 2025Cross from Left to Right Brain: Adaptive Text Dreamer for Vision-and-Language Navigationcited by 16
  29. 2025MonoDream: Monocular Vision-Language Navigation with Panoramic Dreamingcited by 15
  30. 2020Towards Target-Driven Visual Navigation in Indoor Scenes via Generative Imitation Learningcited by 14
  31. 2025ActiveVLN: Towards Active Exploration via Multi-Turn RL in Vision-and-Language Navigationcited by 11
  32. 2024UnitedVLN: Generalizable Gaussian Splatting for Continuous Vision-Language Navigationcited by 9
  33. 2025VISTA: Generative Visual Imagination for Vision-and-Language Navigationcited by 8
  34. 2023Masked Path Modeling for Vision-and-Language Navigationcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.