Learning Adaptive Safety Margins for Visual Navigation
Not on the map. Why?
Abstract (arXiv)
Robots in cluttered indoor spaces often fail not because they cannot generate collision-free paths, but because a fixed safety margin is mis-calibrated: conservative margins cause detours and timeouts, while permissive margins lead to near-boundary shortcuts under perception bias. Diffusion-based planners propose diverse trajectory candidates from egocentric RGB-D, yet reliable selection remains the bottleneck. We propose a context-conditioned safety critic that learns an adaptive clearance preference for ranking diffusion proposals, decomposed into three complementary terms: (i) a safety term with a clearance-budget penalty and a control-barrier-function residual for waypoint- and transition-wise safety, (ii) an efficiency term combining a smoothness penalty with a safety-gated detour-ratio penalty that avoids detours without incentivizing risky shortcuts, and (iii) a distance-constraint matching term that anchors the learned budget to realized ESDF clearances to prevent margin collapse. We train the critic with privileged ESDF geometry in simulation and distill it into a perception-only selector via a two-stage teacher-student procedure. On PointGoal navigation in HM3D and MP3D, including cross-dataset transfer, our method achieves the highest success rate (SR) and success weighted by path length (SPL) among strong diffusion, optimization, and RL baselines. Trained purely in simulation, it transfers to a Unitree G1 humanoid and navigates cluttered indoor scenes without task-specific tuning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 14 references that are in the map. First posted on arXiv 20 Jul 2026.
Builds on
13 of 14 references.
References · 13
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
- 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 362
- 2020Learning to Explore using Active Neural SLAMcited by 316
- 2023Diffusion-based Generation, Optimization, and Planning in 3D Scenescited by 239
- 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 205
- 2016Voxblox: Incremental 3D Euclidean Signed Distance Fields for On-Board MAV Planningcited by 150
- 2020EGO-Planner: An ESDF-free Gradient-based Local Planner for Quadrotorscited by 55
- 2025NavDP: Learning Sim-to-Real Navigation Diffusion Policy with Privileged Information Guidancecited by 49
- 2023ViPlanner: Visual Semantic Imperative Learning for Local Navigationcited by 46
1 more
- 2023iPlanner: Imperative Path Planningcited by 37
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Dynamic Control Barrier Function Regulation with Vision-Language Models for Safe, Adaptive, and Realtime Visual Navigation
- 2026Distilling Privileged Control Barrier Functions into RGB-Only Safety Filters for Dynamic Visual Navigation
- 2026RVN-Bench: A Benchmark for Reactive Visual Navigation
- 2026DODGER: Safety-Guided Reinforcement Learning for Robot Navigation Among Dynamic Obstacles
- 2025Learning to Navigate Under Imperfect Perception: Conformalised Segmentation for Safe Reinforcement Learning
- 2026Less Is More: Scalable Visual Navigation from Limited Data
- 2026BridgeGuard: Explicit Safety Drift for Diffusion-based Autonomous Driving
- 2026Safety-Constrained Reinforcement Learning with Post-Training Reachability Verification for Robot Navigation