IROS: A Dual-Process Architecture for Real-Time VLM-Based Indoor Navigation
Not on the map. Why?
Abstract (arXiv)
Indoor mobile robot navigation requires fast responsiveness and robust semantic understanding, yet existing methods struggle to provide both. Classical geometric approaches such as SLAM offer reliable localization but depend on detailed maps and cannot interpret human-targeted cues (e.g., signs, room numbers) essential for indoor reasoning. Vision-Language-Action (VLA) models introduce semantic grounding but remain strictly reactive, basing decisions only on visible frames and failing to anticipate unseen intersections or reason about distant textual cues. Vision-Language Models (VLMs) provide richer contextual inference but suffer from high computational latency, making them unsuitable for real-time operation on embedded platforms. In this work, we present IROS, a real-time navigation framework that combines VLM-level contextual reasoning with the efficiency of lightweight perceptual modules on low-cost, on-device hardware. Inspired by Dual Process Theory, IROS separates fast reflexive decisions (System One) from slow deliberative reasoning (System Two), invoking the VLM only when necessary. Furthermore, by augmenting compact VLMs with spatial and textual cues, IROS delivers robust, human-like navigation with minimal latency. Across five real-world buildings, IROS improves decision accuracy and reduces latency by 66% compared to continuous VLM-based navigation.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 Jan 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026AsyncShield: A Plug-and-Play Edge Adapter for Asynchronous Cloud-based VLA Navigationcited by 2
- 2026Temperature Scaling Attack Disrupting Model Confidence in Federated Learningcited by 0
- 2026SignNav: Leveraging Signage for Semantic Visual Navigation in Large-Scale Indoor Environmentscited by 0
- 2026A Semantic Autonomy Framework for VLM-Integrated Indoor Mobile Robots: Hybrid Deterministic Reasoning and Cross-Robot Adaptive Memorycited by 0
- 2026A Semantic Autonomy Framework for VLM-Integrated Indoor Mobile Robots: Hybrid Deterministic Reasoning and Cross-Robot Adaptive Memory4 May 2026
- 2026AsyncShield: A Plug-and-Play Edge Adapter for Asynchronous Cloud-based VLA Navigation27 Apr 2026
- 2026SignNav: Leveraging Signage for Semantic Visual Navigation in Large-Scale Indoor Environments17 Mar 2026
- 2026Temperature Scaling Attack Disrupting Model Confidence in Federated Learning6 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026OptiSight: Bridging Semantic Reasoning and Geometric Control for Embodied Navigation
- 2024CoNVOI: Context-aware Navigation using Vision Language Models in Outdoor and Indoor Environments
- 2026CapNav: Benchmarking Vision Language Models on Capability-conditioned Indoor Navigation
- 2025FSR-VLN: Fast and Slow Reasoning for Vision-Language Navigation with Hierarchical Multi-modal Scene Graph
- 2025Think, Remember, Navigate: Zero-Shot Object-Goal Navigation with VLM-Powered Reasoning
- 2026AnchorVLN: Geometry-Anchored Vision-Language Grounding Reasoning for Open-Vocabulary Navigation
- 2026A Deployable Embodied Vision-Language Navigation System with Hierarchical Cognition and Context-Aware Exploration ↗
- 2025Efficient Navigation in Unknown Indoor Environments with Vision-Language Models