mlsanityData to 14 Oct 2026

VISTA: Scale-Aware Visual Navigation via Action History Conditioning

arXiv 2606.17294 ↗First posted 15 Jun 2026cs.RO cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Vision Navigation Foundation Models (VNMs) promise end-to-end learned navigation policies capable of zero-shot deployment across diverse embodiments and environments. To maintain generality, many vision-based navigation models predict normalized actions. However, this normalization introduces a critical deployment vulnerability: applying different scaling factors to the same normalized trajectory alters its physical geometry, which degrades navigation performance and increases collision risks. We address this vulnerability by conditioning the model on normalized action histories alongside image observations, providing explicit context on the relationship between the model's predictions and the robot's actual physical displacement. Furthermore, current VNMs often struggle in visually repetitive environments that lack distinct features. To resolve this issue, we integrate a DINOv3 encoder, whose richer representations enable our model to capture both spatial and geometric dimensions between observations. VISTA generalizes robustly to out-of-distribution environments, achieving 100% goal prediction accuracy in zero-shot, real-world deployment in Outdoor, Forest and Office settings, and an average of 95% checkpoints crossed, demonstrating consistent path following in unseen environments.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 24 references that are in the map. First posted on arXiv 15 Jun 2026.

Builds on

22 of 24 references.

References · 22

  1. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  2. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  3. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
  4. 2024Navigation World Modelscited by 272
  5. 2023NoMaD: Goal Masked Diffusion Policies for Navigation and Explorationcited by 248
  6. 2023ViNT: A Foundation Model for Visual Navigationcited by 222
  7. 2022GNM: A General Navigation Model to Drive Any Robotcited by 171
  8. 2023RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunkingcited by 169
  9. 2022Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of Demonstrations for Social Navigationcited by 127
  10. 2021Rapid Exploration for Open-World Navigation with Latent Goal Modelscited by 121
  11. 2024Open-Nav: Exploring Zero-Shot Vision-and-Language Navigation in Continuous Environment with Open-Source LLMscited by 62
  12. 2023SACSoN: Scalable Autonomous Control for Social Navigationcited by 61
10 more
  1. 2025UniGoal: Towards Universal Zero-shot Goal-oriented Navigationcited by 57
  2. 2019Deep Visual MPC-Policy Learning for Navigationcited by 56
  3. 2025NavDP: Learning Sim-to-Real Navigation Diffusion Policy with Privileged Information Guidancecited by 49
  4. 2021Super Odometry: IMU-centric LiDAR-Visual-Inertial Estimator for Challenging Environmentscited by 26
  5. 2025NaviDiffusor: Cost-Guided Diffusion Model for Visual Navigationcited by 25
  6. 2024NavFormer: A Transformer Architecture for Robot Target-Driven Navigation in Unknown and Dynamic Environmentscited by 20
  7. 2024Zero-shot Object Navigation with Vision-Language Models Reasoningcited by 19
  8. 2025CARE: Enhancing Safety of Visual Navigation through Collision Avoidance via Repulsive Estimationcited by 4
  9. 2025MetricNet: Recovering Metric Scale in Generative Navigation Policiescited by 3
  10. 2026Can Vision Foundation Models Navigate? Zero-Shot Real-World Evaluation and Lessons Learnedcited by 3

Built on by

Not cited yet.