GUIDEd Agents: Enhancing Navigation Policies through Task-Specific Uncertainty Abstraction in Localization-Limited Environments
Not on the map. Why?
Abstract (arXiv)
Autonomous vehicles performing navigation tasks in complex environments face significant challenges due to uncertainty in state estimation. In many scenarios, such as stealth operations or resource-constrained settings, accessing high-precision localization comes at a significant cost, forcing robots to rely primarily on less precise state estimates. Our key observation is that different tasks require varying levels of precision in different regions: a robot navigating a crowded space might need precise localization near obstacles but can operate effectively with less precision elsewhere. In this paper, we present a planning method for integrating task-specific uncertainty requirements directly into navigation policies. We introduce Task-Specific Uncertainty Maps (TSUMs), which abstract the acceptable levels of state estimation uncertainty across different regions. TSUMs align task requirements and environmental features using a shared representation space, generated via a domain-adapted encoder. Using TSUMs, we propose Generalized Uncertainty Integration for Decision-Making and Execution (GUIDE), a policy conditioning framework that incorporates these uncertainty requirements into robot decision-making. We find that TSUMs provide an effective way to abstract task-specific uncertainty requirements, and conditioning policies on TSUMs enables the robot to reason about the context-dependent value of certainty and adapt its behavior accordingly. We show how integrating GUIDE into reinforcement learning frameworks allows the agent to learn navigation policies that effectively balance task completion and uncertainty management without explicit reward engineering. We evaluate GUIDE on various real-world robotic navigation tasks and find that it demonstrates significant improvement in task completion rates compared to baseline methods that do not explicitly consider task-specific uncertainty.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 19 of its 41 references that are in the map. First posted on arXiv 19 Oct 2024.
Builds on
19 of 41 references.
References · 19
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
- 2019Stabilizing Off-Policy Q-Learning via Bootstrapping Error Reductioncited by 833
- 2020MOPO: Model-based Offline Policy Optimizationcited by 630
- 2016Deep Exploration via Bootstrapped DQNcited by 518
- 2022LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Actioncited by 435
- 2019Improving Sample Efficiency in Model-Free Reinforcement Learning from Imagescited by 268
- 2018Visual Reinforcement Learning with Imagined Goalscited by 248
- 2022GNM: A General Navigation Model to Drive Any Robotcited by 161
- 2020Learning to be Safe: Deep RL with a Safety Criticcited by 109
- 2017Uncertainty-Aware Reinforcement Learning for Collision Avoidancecited by 86
7 more
- 2017Intrinsically Motivated Goal Exploration Processes with Automatic Curriculum Learningcited by 79
- 2018Safe Reinforcement Learning with Model Uncertainty Estimatescited by 70
- 2024Partially Observable Task and Motion Planning with Uncertainty and Risk Awarenesscited by 17
- 2022Benchmarking Reinforcement Learning Techniques for Autonomous Navigationcited by 15
- 2020Dynamically Feasible Deep Reinforcement Learning Policy for Robot Navigation in Dense Mobile Crowdscited by 12
- 2024ComTraQ-MPC: Meta-Trained DQN-MPC Integration for Trajectory Tracking with Limited Active Localization Updatescited by 4
- 2023Robust Path Following on Rivers Using Bootstrapped Reinforcement Learningcited by 3
Built on by
Citing papers per year: 2025: 2.
2 papers.