Intention-Net: Integrating Planning and Deep Learning for Goal-Directed Autonomous Navigation
Not on the map. Why?
Abstract (arXiv)
How can a delivery robot navigate reliably to a destination in a new office building, with minimal prior information? To tackle this challenge, this paper introduces a two-level hierarchical approach, which integrates model-free deep learning and model-based path planning. At the low level, a neural-network motion controller, called the intention-net, is trained end-to-end to provide robust local navigation. The intention-net maps images from a single monocular camera and "intentions" directly to robot controls. At the high level, a path planner uses a crude map, e.g., a 2-D floor plan, to compute a path from the robot's current location to the goal. The planned path provides intentions to the intention-net. Preliminary experiments suggest that the learned motion controller is robust against perceptual uncertainty and by integrating with a path planner, it generalizes effectively to new environments and goals.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Oct 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 4; 2023: 3; 2024: 3.
20 papers.
Sort:
By area:
- 2021Learning Interpretable End-to-End Vision-Based Motion Planning for Autonomous Driving with Optical Flow Distillationcited by 25
- 2021Subgoal Search For Complex Reasoning Taskscited by 21
- 2021End-to-End Interactive Prediction and Planning with Optical Flow Distillation for Autonomous Drivingcited by 17
- 2023Real-time Neural Network Inference on Extremely Weak Devices: Agile Offloading with Explainable AIcited by 17
- 2022Fast and Precise: Adjusting Planning Horizon with Adaptive Subgoal Searchcited by 12
- 2021REGRAD: A Large-Scale Relational Grasp Dataset for Safe and Object-Specific Robotic Grasping in Cluttercited by 11
- 2021Carl-Lead: Lidar-based End-to-End Autonomous Driving with Contrastive Deep Reinforcement Learningcited by 11
- 2021Visual Perspective Taking for Opponent Behavior Modelingcited by 6
- 2021Deep Visual Navigation under Partial Observabilitycited by 6
- 2023Hybrid Search for Efficient Planning with Completeness Guaranteescited by 6
- 2021Hierarchical Robot Navigation in Novel Environments using Rough 2-D Mapscited by 4
- 2021Hierarchically Integrated Models: Learning to Navigate from Heterogeneous Robotscited by 3
8 more
- 2022MLNav: Learning to Safely Navigate on Martian Terrainscited by 3
- 2022Hybrid Deep Reinforcement Learning and Planning for Safe and Comfortable Automated Drivingcited by 3
- 2024Self-Supervised Interpretable End-to-End Learning via Latent Functional Modularitycited by 3
- 2024Combining RL and IL using a dynamic, performance-based modulation over learning signals and its application to local planningcited by 3
- 2022Generalizing to New Tasks via One-Shot Compositional Subgoalscited by 1
- 2023Virtual Guidance as a Mid-level Representation for Navigation with Augmented Realitycited by 1
- 2024Motion planning for off-road autonomous driving based on human-like cognition and weight adaptationcited by 1
- 2021A review of motion planning algorithms for intelligent roboticscited by 0
- 2024Combining RL and IL using a dynamic, performance-based modulation over learning signals and its application to local planning16 May 2024
- 2024Motion planning for off-road autonomous driving based on human-like cognition and weight adaptation27 Apr 2024
- 2024Self-Supervised Interpretable End-to-End Learning via Latent Functional Modularity21 Feb 2024
- 2023Real-time Neural Network Inference on Extremely Weak Devices: Agile Offloading with Explainable AI21 Dec 2023
- 2023Hybrid Search for Efficient Planning with Completeness Guarantees19 Oct 2023
- 2023Virtual Guidance as a Mid-level Representation for Navigation with Augmented Reality5 Mar 2023
- 2022Hybrid Deep Reinforcement Learning and Planning for Safe and Comfortable Automated Driving30 Dec 2022
- 2022Fast and Precise: Adjusting Planning Horizon with Adaptive Subgoal Search1 Jun 2022
- 2022Generalizing to New Tasks via One-Shot Compositional Subgoals16 May 2022
- 2022MLNav: Learning to Safely Navigate on Martian Terrains9 Mar 2022
- 2021Carl-Lead: Lidar-based End-to-End Autonomous Driving with Contrastive Deep Reinforcement Learning17 Sep 2021
- 2021Deep Visual Navigation under Partial Observability16 Sep 2021
8 more
- 2021Subgoal Search For Complex Reasoning Tasks25 Aug 2021
- 2021Hierarchically Integrated Models: Learning to Navigate from Heterogeneous Robots24 Jun 2021
- 2021Hierarchical Robot Navigation in Novel Environments using Rough 2-D Maps7 Jun 2021
- 2021Visual Perspective Taking for Opponent Behavior Modeling11 May 2021
- 2021REGRAD: A Large-Scale Relational Grasp Dataset for Safe and Object-Specific Robotic Grasping in Clutter29 Apr 2021
- 2021Learning Interpretable End-to-End Vision-Based Motion Planning for Autonomous Driving with Optical Flow Distillation18 Apr 2021
- 2021End-to-End Interactive Prediction and Planning with Optical Flow Distillation for Autonomous Driving18 Apr 2021
- 2021A review of motion planning algorithms for intelligent robotics4 Feb 2021
- 2021Learning Interpretable End-to-End Vision-Based Motion Planning for Autonomous Driving with Optical Flow Distillationcited by 25
- 2021End-to-End Interactive Prediction and Planning with Optical Flow Distillation for Autonomous Drivingcited by 17
- 2021Carl-Lead: Lidar-based End-to-End Autonomous Driving with Contrastive Deep Reinforcement Learningcited by 11
- 2022Hybrid Deep Reinforcement Learning and Planning for Safe and Comfortable Automated Drivingcited by 3
- 2024Motion planning for off-road autonomous driving based on human-like cognition and weight adaptationcited by 1
- 2024Motion planning for off-road autonomous driving based on human-like cognition and weight adaptation27 Apr 2024
- 2022Hybrid Deep Reinforcement Learning and Planning for Safe and Comfortable Automated Driving30 Dec 2022
- 2021Carl-Lead: Lidar-based End-to-End Autonomous Driving with Contrastive Deep Reinforcement Learning17 Sep 2021
- 2021Learning Interpretable End-to-End Vision-Based Motion Planning for Autonomous Driving with Optical Flow Distillation18 Apr 2021
- 2021End-to-End Interactive Prediction and Planning with Optical Flow Distillation for Autonomous Driving18 Apr 2021
- 2021Subgoal Search For Complex Reasoning Taskscited by 21
- 2023Real-time Neural Network Inference on Extremely Weak Devices: Agile Offloading with Explainable AIcited by 17
- 2022Fast and Precise: Adjusting Planning Horizon with Adaptive Subgoal Searchcited by 12
- 2021REGRAD: A Large-Scale Relational Grasp Dataset for Safe and Object-Specific Robotic Grasping in Cluttercited by 11
- 2021Visual Perspective Taking for Opponent Behavior Modelingcited by 6
- 2021Deep Visual Navigation under Partial Observabilitycited by 6
- 2023Hybrid Search for Efficient Planning with Completeness Guaranteescited by 6
- 2021Hierarchical Robot Navigation in Novel Environments using Rough 2-D Mapscited by 4
- 2021Hierarchically Integrated Models: Learning to Navigate from Heterogeneous Robotscited by 3
- 2022MLNav: Learning to Safely Navigate on Martian Terrainscited by 3
- 2024Self-Supervised Interpretable End-to-End Learning via Latent Functional Modularitycited by 3
- 2023Virtual Guidance as a Mid-level Representation for Navigation with Augmented Realitycited by 1
12 most cited of 13 All 13 (JSON)
- 2024Self-Supervised Interpretable End-to-End Learning via Latent Functional Modularity21 Feb 2024
- 2023Real-time Neural Network Inference on Extremely Weak Devices: Agile Offloading with Explainable AI21 Dec 2023
- 2023Hybrid Search for Efficient Planning with Completeness Guarantees19 Oct 2023
- 2023Virtual Guidance as a Mid-level Representation for Navigation with Augmented Reality5 Mar 2023
- 2022Fast and Precise: Adjusting Planning Horizon with Adaptive Subgoal Search1 Jun 2022
- 2022MLNav: Learning to Safely Navigate on Martian Terrains9 Mar 2022
- 2021Deep Visual Navigation under Partial Observability16 Sep 2021
- 2021Subgoal Search For Complex Reasoning Tasks25 Aug 2021
- 2021Hierarchically Integrated Models: Learning to Navigate from Heterogeneous Robots24 Jun 2021
- 2021Hierarchical Robot Navigation in Novel Environments using Rough 2-D Maps7 Jun 2021
- 2021Visual Perspective Taking for Opponent Behavior Modeling11 May 2021
- 2021REGRAD: A Large-Scale Relational Grasp Dataset for Safe and Object-Specific Robotic Grasping in Clutter29 Apr 2021
12 newest of 13 All 13 (JSON)