mlsanityData to 14 Oct 2026

Efficient and Generalizable Environmental Understanding for Visual Navigation

arXiv 2506.15377 ↗First posted 18 Jun 2025cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Visual Navigation is a core task in Embodied AI, enabling agents to navigate complex environments toward given objectives. Across diverse settings within Navigation tasks, many necessitate the modelling of sequential data accumulated from preceding time steps. While existing methods perform well, they typically process all historical observations simultaneously, overlooking the internal association structure within the data, which may limit the potential for further improvements in task performance. We address this by examining the unique characteristics of Navigation tasks through the lens of causality, introducing a causal framework to highlight the limitations of conventional sequential methods. Leveraging this insight, we propose Causality-Aware Navigation (CAN), which incorporates a Causal Understanding Module to enhance the agent's environmental understanding capability. Empirical evaluations show that our approach consistently outperforms baselines across various tasks and simulation environments. Extensive ablations studies attribute these gains to the Causal Understanding Module, which generalizes effectively in both Reinforcement and Supervised Learning settings without computational overhead.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 57 of its 63 references that are in the map. First posted on arXiv 18 Jun 2025.

Builds on

57 of 63 references.

References · 57

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2017Proximal Policy Optimization Algorithmscited by 15,215
  6. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  7. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  8. 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,194
  9. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
  10. 2018Gibson Env: Real-World Perception for Embodied Agentscited by 481
  11. 2020Learning Invariant Representations for Reinforcement Learning without Reconstructioncited by 436
  12. 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
38 more
  1. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 380
  2. 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 362
  3. 2018Speaker-Follower Models for Vision-and-Language Navigationcited by 340
  4. 2019REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environmentscited by 333
  5. 2019Causal Confusion in Imitation Learningcited by 288
  6. 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Modelscited by 280
  7. 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 271
  8. 2021A Survey of Embodied AI: From Simulators to Research Taskscited by 261
  9. 2019Learning to Navigate Unseen Environments: Back Translation with Environmental Dropoutcited by 244
  10. 2020RoboTHOR: An Open Simulation-to-Real Embodied AI Platformcited by 193
  11. 2022Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigationcited by 193
  12. 2021Simple but Effective: CLIP Embeddings for Embodied AIcited by 191
  13. 2017CausalGAN: Learning Causal Implicit Generative Models with Adversarial Trainingcited by 152
  14. 2023Towards Learning a Generalist Model for Embodied Navigationcited by 138
  15. 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 124
  16. 2022Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scalecited by 117
  17. 2020Interventional Few-Shot Learningcited by 112
  18. 2023Discuss Before Moving: Visual Language Navigation via Multi-expert Discussionscited by 110
  19. 2023PIRLNav: Pretraining with Imitation and RL Finetuning for ObjectNavcited by 93
  20. 2021A Persistent Spatial Semantic Representation for High-level Natural Language Instruction Executioncited by 91
  21. 2018Look Before You Leap: Bridging Model-Free and Model-Based Reinforcement Learning for Planned-Ahead Vision-and-Language Navigationcited by 84
  22. 2024Robust agents learn causal world modelscited by 81
  23. 2024NavCoT: Boosting LLM-Based Vision-and-Language Navigation via Learning Disentangled Reasoningcited by 79
  24. 2023Bridging Zero-shot Object Navigation and Foundation Models through Pixel-Guided Navigation Skillcited by 77
  25. 2021Auxiliary Tasks and Exploration Enable ObjectNavcited by 74
  26. 2021Causal Influence Detection for Improving Efficiency in Reinforcement Learningcited by 71
  27. 2022Causal Dynamics Learning for Task-Independent State Abstractioncited by 65
  28. 2022Target-Driven Structured Transformer Planner for Vision-Language Navigationcited by 58
  29. 2020AllenAct: A Framework for Embodied AI Researchcited by 54
  30. 2020Causal Curiosity: RL Agents Discovering Self-supervised Experiments for Causal Representation Learningcited by 53
  31. 2023LangNav: Language as a Perceptual Representation for Navigationcited by 47
  32. 2023KERM: Knowledge Enhanced Reasoning for Vision-and-Language Navigationcited by 39
  33. 2022Prompter: Utilizing Large Language Model Prompting for a Data Efficient Embodied Instruction Followingcited by 33
  34. 2022Stubborn: A Strong Baseline for Indoor Object Navigationcited by 32
  35. 2024The Essential Role of Causality in Foundation World Models for Embodied AIcited by 32
  36. 2022Zero-shot object goal visual navigationcited by 31
  37. 2021Core Challenges in Embodied Vision-Language Planningcited by 30
  38. 2023Causal Reinforcement Learning: A Surveycited by 23

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.