ADAPT: Audio-Depth Action Planning with Transition-Aware Rewards for Lights-Out Industrial Navigation
New in Vision-language-action models; no direction yet. Vision-language-action models
Abstract (arXiv)
Vision-language-action models for embodied navigation typically rely on RGB observations, limiting their applicability in lights-out industrial environments where visible illumination may be unavailable. We study illumination-independent navigation using spatial audio for target localization and depth for obstacle-aware geometry. To support this setting, we introduce DarkNav-Bench, a benchmark with 24 industrial scenes and four progressively challenging acoustic conditions. We further propose ADAPT, an audio-depth action-planning framework equipped with spatial-audio perception and optimized for closed-loop navigation through reinforcement learning (RL). Our key RL contribution, transition-aware reward shaping (TARS), defines a pose-aware shortest-action potential over a position-heading graph. Unlike conventional geodesic-progress rewards, TARS accounts for both feasible movements and in-place rotations, providing action-consistent feedback for policy optimization. Experiments show that ADAPT consistently outperforms training-based navigation baselines and zero-shot multimodal models on both seen and unseen scenes. On unseen environments, it achieves 90.6% success under Clean conditions and retains 60.0% success under the most challenging Localized Noise setting. These results demonstrate the potential of spatial audio and depth as complementary modalities for reliable RGB-free navigation in lights-out industrial environments.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 58 references that are in the map. First posted on arXiv 11 Oct 2026.
Builds on
17 of 58 references.
References · 17
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2025Qwen3-Omni Technical Reportcited by 497
- 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 146
- 2020Semantic Audio-Visual Navigationcited by 82
- 2019MIMII Dataset: Sound Dataset for Malfunctioning Industrial Machine Investigation and Inspectioncited by 58
- 2020VisualEchoes: Spatial Image Representation Learning through Echolocationcited by 55
- 2026Qwen-VLA: Unifying Vision-Language-Action Modeling across Tasks, Environments, and Robot Embodimentscited by 44
- 2025OmniVLA: An Omni-Modal Vision-Language-Action Model for Robot Navigationcited by 38
- 2025IndustryEQA: Pushing the Frontiers of Embodied Question Answering in Industrial Scenarioscited by 13
5 more
- 2026AsyncVLA: An Asynchronous VLA for Fast and Robust Navigation on the Edgecited by 10
- 2025SPUR: A Plug-and-Play Framework for Integrating Spatial Audio Understanding and Reasoning into Large Audio-Language Modelscited by 8
- 2023Multi-goal Audio-visual Navigation using Sound Direction Mapcited by 6
- 2026Semantic Audio-Visual Navigation in Continuous Environmentscited by 2
- 2026NightSight: Passive Computation for Navigation in Dark Using Eventscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026What Limits Vision-and-Language Navigation ?
- 2025Rethinking the Embodied Gap in Vision-and-Language Navigation: A Holistic Study of Physical and Visual Disparities
- 2025Audio-Guided Dynamic Modality Fusion with Stereo-Aware Attention for Audio-Visual Navigation
- 2026BCNav: Bearing-Conditioned Depth Policies for Sound Source Navigation ↗
- 2026SpaAct: Spatially-Activated Transition Learning with Curriculum Adaptation for Vision-Language Navigation
- 2026LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation
- 2026Listen Before Act: Audio-Conditioned Robot Manipulation with ListenVLA
- 2025IndustryNav: Exploring Spatial Reasoning of Embodied Agents in Dynamic Industrial Navigation