Value Iteration Networks on Multiple Levels of Abstraction
Not on the map. Why?
Abstract (arXiv)
Learning-based methods are promising to plan robot motion without performing extensive search, which is needed by many non-learning approaches. Recently, Value Iteration Networks (VINs) received much interest since---in contrast to standard CNN-based architectures---they learn goal-directed behaviors which generalize well to unseen domains. However, VINs are restricted to small and low-dimensional domains, limiting their applicability to real-world planning problems. To address this issue, we propose to extend VINs to representations with multiple levels of abstraction. While the vicinity of the robot is represented in sufficient detail, the representation gets spatially coarser with increasing distance from the robot. The information loss caused by the decreasing resolution is compensated by increasing the number of features representing a cell. We show that our approach is capable of solving significantly larger 2D grid world planning tasks than the original VIN implementation. In contrast to a multiresolution coarse-to-fine VIN implementation which does not employ additional descriptive features, our approach is capable of solving challenging environments, which demonstrates that the proposed method learns to encode useful information in the additional features. As an application for solving real-world planning tasks, we successfully employ our method to plan omnidirectional driving for a search-and-rescue robot in cluttered terrain.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 1; 2023: 1; 2024: 3; 2025: 1.
11 papers.
- 2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphscited by 144
- 2021Differentiable Spatial Planning using Transformerscited by 25
- 2021High-Accuracy Model-Based Reinforcement Learning, a Surveycited by 13
- 2021Hierarchies of Planning and Reinforcement Learning for Robot Navigationcited by 11
- 2022Scaling up and Stabilizing Differentiable Planning with Implicit Differentiationcited by 6
- 2024Versatile Navigation under Partial Observability via Value-guided Diffusion Policycited by 5
- 2025When Can Model-Free Reinforcement Learning be Enough for Thinking?cited by 5
- 2021Towards real-world navigation with deep differentiable plannerscited by 4
- 2024Scaling Value Iteration Networks to 5000 Layers for Extreme Long-Term Planningcited by 3
- 2024Highway Value Iteration Networkscited by 2
- 2023Value Iteration Networks with Gated Summarization Modulecited by 1
- 2025When Can Model-Free Reinforcement Learning be Enough for Thinking?20 Jun 2025
- 2024Scaling Value Iteration Networks to 5000 Layers for Extreme Long-Term Planning12 Jun 2024
- 2024Highway Value Iteration Networks5 Jun 2024
- 2024Versatile Navigation under Partial Observability via Value-guided Diffusion Policy1 Apr 2024
- 2023Value Iteration Networks with Gated Summarization Module11 May 2023
- 2022Scaling up and Stabilizing Differentiable Planning with Implicit Differentiation24 Oct 2022
- 2021Differentiable Spatial Planning using Transformers2 Dec 2021
- 2021Hierarchies of Planning and Reinforcement Learning for Robot Navigation23 Sep 2021
- 2021Towards real-world navigation with deep differentiable planners8 Aug 2021
- 2021High-Accuracy Model-Based Reinforcement Learning, a Survey17 Jul 2021
- 2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphs18 Jan 2021