Efficient and Generalizable Environmental Understanding for Visual Navigation
Not on the map. Why?
Abstract (arXiv)
Visual Navigation is a core task in Embodied AI, enabling agents to navigate complex environments toward given objectives. Across diverse settings within Navigation tasks, many necessitate the modelling of sequential data accumulated from preceding time steps. While existing methods perform well, they typically process all historical observations simultaneously, overlooking the internal association structure within the data, which may limit the potential for further improvements in task performance. We address this by examining the unique characteristics of Navigation tasks through the lens of causality, introducing a causal framework to highlight the limitations of conventional sequential methods. Leveraging this insight, we propose Causality-Aware Navigation (CAN), which incorporates a Causal Understanding Module to enhance the agent's environmental understanding capability. Empirical evaluations show that our approach consistently outperforms baselines across various tasks and simulation environments. Extensive ablations studies attribute these gains to the Causal Understanding Module, which generalizes effectively in both Reinforcement and Supervised Learning settings without computational overhead.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 57 of its 63 references that are in the map. First posted on arXiv 18 Jun 2025.
Builds on
57 of 63 references.
References · 57
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023GPT-4 Technical Reportcited by 18,396
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,194
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2018Gibson Env: Real-World Perception for Embodied Agentscited by 481
- 2020Learning Invariant Representations for Reinforcement Learning without Reconstructioncited by 436
- 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
38 more
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 380
- 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 362
- 2018Speaker-Follower Models for Vision-and-Language Navigationcited by 340
- 2019REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environmentscited by 333
- 2019Causal Confusion in Imitation Learningcited by 288
- 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Modelscited by 280
- 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 271
- 2021A Survey of Embodied AI: From Simulators to Research Taskscited by 261
- 2019Learning to Navigate Unseen Environments: Back Translation with Environmental Dropoutcited by 244
- 2020RoboTHOR: An Open Simulation-to-Real Embodied AI Platformcited by 193
- 2022Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigationcited by 193
- 2021Simple but Effective: CLIP Embeddings for Embodied AIcited by 191
- 2017CausalGAN: Learning Causal Implicit Generative Models with Adversarial Trainingcited by 152
- 2023Towards Learning a Generalist Model for Embodied Navigationcited by 138
- 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 124
- 2022Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scalecited by 117
- 2020Interventional Few-Shot Learningcited by 112
- 2023Discuss Before Moving: Visual Language Navigation via Multi-expert Discussionscited by 110
- 2023PIRLNav: Pretraining with Imitation and RL Finetuning for ObjectNavcited by 93
- 2021A Persistent Spatial Semantic Representation for High-level Natural Language Instruction Executioncited by 91
- 2018Look Before You Leap: Bridging Model-Free and Model-Based Reinforcement Learning for Planned-Ahead Vision-and-Language Navigationcited by 84
- 2024Robust agents learn causal world modelscited by 81
- 2024NavCoT: Boosting LLM-Based Vision-and-Language Navigation via Learning Disentangled Reasoningcited by 79
- 2023Bridging Zero-shot Object Navigation and Foundation Models through Pixel-Guided Navigation Skillcited by 77
- 2021Auxiliary Tasks and Exploration Enable ObjectNavcited by 74
- 2021Causal Influence Detection for Improving Efficiency in Reinforcement Learningcited by 71
- 2022Causal Dynamics Learning for Task-Independent State Abstractioncited by 65
- 2022Target-Driven Structured Transformer Planner for Vision-Language Navigationcited by 58
- 2020AllenAct: A Framework for Embodied AI Researchcited by 54
- 2020Causal Curiosity: RL Agents Discovering Self-supervised Experiments for Causal Representation Learningcited by 53
- 2023LangNav: Language as a Perceptual Representation for Navigationcited by 47
- 2023KERM: Knowledge Enhanced Reasoning for Vision-and-Language Navigationcited by 39
- 2022Prompter: Utilizing Large Language Model Prompting for a Data Efficient Embodied Instruction Followingcited by 33
- 2022Stubborn: A Strong Baseline for Indoor Object Navigationcited by 32
- 2024The Essential Role of Causality in Foundation World Models for Embodied AIcited by 32
- 2022Zero-shot object goal visual navigationcited by 31
- 2021Core Challenges in Embodied Vision-Language Planningcited by 30
- 2023Causal Reinforcement Learning: A Surveycited by 23
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.