Data to 7 Oct 2026

Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation

arXiv 1903.02547 ↗First posted 6 Mar 2019cs.CL cs.CV cs.LGcited by 81

Not on the map. Why?

Abstract (arXiv)

We present the Frontier Aware Search with backTracking (FAST) Navigator, a general framework for action decoding, that achieves state-of-the-art results on the Room-to-Room (R2R) Vision-and-Language navigation challenge of Anderson et. al. (2018). Given a natural language instruction and photo-realistic image views of a previously unseen environment, the agent was tasked with navigating from source to target location as quickly as possible. While all current approaches make local action decisions or score entire trajectories using beam search, ours balances local and global signals when exploring an unobserved environment. Importantly, this lets us act greedily but use global signals to backtrack when necessary. Applying FAST framework to existing state-of-the-art models achieved a 17% relative gain, an absolute 6% gain on Success rate weighted by Path Length (SPL).

Key facts. Cited by 81 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Mar 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 23; 2022: 15; 2023: 19; 2024: 12; 2025: 7; 2026: 5.

81 papers.

Sort:

By area:

2021How Much Can CLIP Benefit Vision-and-Language Tasks?cited by 321
2023Automatically Correcting Large Language Models: Surveying the landscape of diverse self-correction strategiescited by 236
2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 222
2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 201
2021Episodic Transformer for Vision-and-Language Navigationcited by 155
2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigationcited by 127
2021FILM: Following Instructions in Language with Modular Methodscited by 119
2021SOON: Scenario Oriented Object Navigation with Graph-based Explorationcited by 118
2023AerialVLN: Vision-and-Language Navigation for UAVscited by 117
2022Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directionscited by 116
2023Scaling Data Generation in Vision-and-Language Navigationcited by 115
2024NavGPT-2: Unleashing Navigational Reasoning Capability for Large Vision-Language Modelscited by 96

38 more

2021Structured Scene Memory for Vision-Language Navigationcited by 95
2021LanguageRefer: Spatial-Language Model for 3D Visual Groundingcited by 88
2023DREAMWALKER: Mental Planning for Continuous Vision-Language Navigationcited by 82
2023Bird's-Eye-View Scene Graph for Vision-Language Navigationcited by 71
2021Vision-Language Navigation with Random Environmental Mixupcited by 70
2022HOP: History-and-Order Aware Pre-training for Vision-and-Language Navigationcited by 69
2024Lookahead Exploration with Neural Radiance Representation for Continuous Vision-Language Navigationcited by 63
2021The Road to Know-Where: An Object-and-Room Informed Sequential BERT for Indoor Vision-Language Navigationcited by 60
2022Target-Driven Structured Transformer Planner for Vision-Language Navigationcited by 58
2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
2021Hierarchical Task Learning from Language Instructions with Unified Transformers and Self-Monitoringcited by 53
2021SOAT: A Scene- and Object-Aware Transformer for Vision-and-Language Navigationcited by 53
2022Counterfactual Cycle-Consistent Learning for Instruction Following and Generation in Vision-Language Navigationcited by 50
2021Scene-Intuitive Agent for Remote Embodied Visual Groundingcited by 49
2024Constraint-Aware Zero-Shot Vision-Language Navigation in Continuous Environmentscited by 49
2021SASRA: Semantically-aware Spatio-temporal Reasoning Agent for Vision-and-Language Navigation in Continuous Environmentscited by 48
2025Openfly: A comprehensive platform for aerial vision-language navigationcited by 43
2023Lana: A Language-Capable Navigator for Instruction Following and Generationcited by 39
2021Diagnosing Vision-and-Language Navigation: What Really Matterscited by 36
2021Vision-Language Navigation: A Survey and Taxonomycited by 33
2022Simple and Effective Synthesis of Indoor 3D Scenescited by 33
2021Improving Cross-Modal Alignment in Vision Language Navigation via Syntactic Informationcited by 31
2021Core Challenges in Embodied Vision-Language Planningcited by 30
2022Zero-shot object goal visual navigationcited by 29
2022One Step at a Time: Long-Horizon Vision-and-Language Navigation with Milestonescited by 26
2022AVLEN: Audio-Visual-Language Embodied Navigation in 3D Environmentscited by 26
2023Grounded Entity-Landmark Adaptive Pre-training for Vision-and-Language Navigationcited by 25
2023Fast-Slow Test-Time Adaptation for Online Vision-and-Language Navigationcited by 25
2024MC-GPT: Empowering Vision-and-Language Navigation with Memory Map and Reasoning Chainscited by 25
2023VLN-PETL: Parameter-Efficient Transfer Learning for Vision-and-Language Navigationcited by 22
2021Multimodal Transformer with Variable-length Memory for Vision-and-Language Navigationcited by 20
2024Vision-Language Navigation with Energy-Based Policycited by 19
2023Meta-Explore: Exploratory Hierarchical Vision-and-Language Navigation Using Scene Object Spectrum Groundingcited by 18
2023Scene-Driven Multimodal Knowledge Graph Construction for Embodied AIcited by 17
2021Contrastive Instruction-Trajectory Learning for Vision-Language Navigationcited by 16
2024Correctable Landmark Discovery via Large Models for Vision-Language Navigationcited by 16
2024SAME: Learning Generic Language-Guided Visual Navigation with State-Adaptive Mixture of Expertscited by 16
2025Cross from Left to Right Brain: Adaptive Text Dreamer for Vision-and-Language Navigationcited by 16

50 most cited of 81 All 81 (JSON)