From Perception to Decision: A Data-driven Approach to End-to-end Motion Planning for Autonomous Ground Robots
Not on the map. Why?
Abstract (arXiv)
Learning from demonstration for motion planning is an ongoing research topic. In this paper we present a model that is able to learn the complex mapping from raw 2D-laser range findings and a target position to the required steering commands for the robot. To our best knowledge, this work presents the first approach that learns a target-oriented end-to-end navigation model for a robotic platform. The supervised model training is based on expert demonstrations generated in simulation with an existing motion planner. We demonstrate that the learned navigation model is directly transferable to previously unseen virtual and, more interestingly, real-world environments. It can safely navigate the robot through obstacle-cluttered environments to reach the provided targets. We present an extensive qualitative and quantitative evaluation of the neural network-based motion planner, and compare it to a grid-based global approach, both in simulation and in real-world experiments.
Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Sep 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 11; 2022: 6; 2023: 3; 2024: 7; 2025: 7; 2026: 2.
37 papers.
Sort:
By area:
- 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 365
- 2021Deep Federated Learning for Autonomous Drivingcited by 54
- 2021Learning a State Representation and Navigation in Cluttered and Dynamic Environmentscited by 30
- 2022Learning Model Predictive Controllers with Real-Time Attention for Real-World Navigationcited by 27
- 2022VI-IKD: High-Speed Accurate Off-Road Navigation using Learned Visual-Inertial Inverse Kinodynamicscited by 19
- 2020APPLD: Adaptive Planner Parameter Learning from Demonstrationcited by 17
- 2021Learning Interactive Driving Policies via Data-driven Simulationcited by 17
- 2021Carl-Lead: Lidar-based End-to-End Autonomous Driving with Contrastive Deep Reinforcement Learningcited by 11
- 2021Curriculum Learning for Safe Mapless Navigationcited by 11
- 2022High-Speed Accurate Robot Control using Learned Forward Kinodynamics and Non-linear Least Squares Optimizationcited by 9
- 2021Distilling Motion Planner Augmented Policies into Visual Control Policies for Robot Manipulationcited by 8
- 2021Human-Inspired Multi-Agent Navigation using Knowledge Distillationcited by 7
25 more
- 2022Learning Forward Dynamics Model and Informed Trajectory Sampler for Safe Quadruped Navigationcited by 6
- 2024Efficient Motion Planning for Manipulators with Control Barrier Function-Induced Neural Controllercited by 5
- 2024Grounded Curriculum Learningcited by 5
- 2023Leveraging Scene Embeddings for Gradient-Based Motion Planning in Latent Spacecited by 4
- 2023A Study on Learning Social Robot Navigation with Multimodal Perceptioncited by 4
- 2024QuadrupedGPT: Towards a Versatile Quadruped Agent in Open-ended Worldscited by 4
- 2022MLNav: Learning to Safely Navigate on Martian Terrainscited by 3
- 2025MaskPlanner: Learning-Based Object-Centric Motion Generation from 3D Point Cloudscited by 3
- 2025Data-Efficient Learning from Human Interventions for Mobile Robotscited by 3
- 2024CURE: Simulation-Augmented Auto-Tuning in Roboticscited by 2
- 2025Socially aware navigation for mobile robots: a survey on deep reinforcement learning approachescited by 2
- 2021Cross-Modal Contrastive Learning of Representations for Navigation using Lightweight, Low-Cost Millimeter Wave Radar for Adverse Environmental Conditionscited by 1
- 2021Decentralized Global Connectivity Maintenance for Multi-Robot Navigation: A Reinforcement Learning Approachcited by 1
- 2024Transformer-Enhanced Motion Planner: Attention-Guided Sampling for State-Specific Decision Makingcited by 1
- 2025Imitation Learning for Obstacle Avoidance Using End-to-End CNN-Based Sensor Fusioncited by 1
- 2025Accelerated Multi-Modal Motion Planning Using Context-Conditioned Diffusion Modelscited by 1
- 2026Learning from Demonstration with Failure Awareness for Safe Robot Navigationcited by 1
- 2021The Pitfall of More Powerful Autoencoders in Lidar-Based Navigationcited by 0
- 2021Autonomous Navigation in Dynamic Environments: Deep Learning-Based Approachcited by 0
- 2023Improving Reliable Navigation under Uncertainty via Predictions Informed by Non-Local Informationcited by 0
- 2024Dyna-LfLH: Learning Agile Navigation in Dynamic Environments from Learned Hallucinationcited by 0
- 2024RoboArm-NMP: a Learning Environment for Neural Motion Planningcited by 0
- 2025Are Learning-Based Approaches Ready for Real-World Indoor Navigation? A Case for Imitation Learningcited by 0
- 2025DRL-TH: Jointly Utilizing Temporal Graph Attention and Hierarchical Fusion for UGV Navigation in Crowded Environmentscited by 0
- 2026SPADE: Sketch-guided Path Planning Augmented with Diffusion Expertscited by 0
- 2026SPADE: Sketch-guided Path Planning Augmented with Diffusion Experts2 Jun 2026
- 2026Learning from Demonstration with Failure Awareness for Safe Robot Navigation25 Apr 2026
- 2025DRL-TH: Jointly Utilizing Temporal Graph Attention and Hierarchical Fusion for UGV Navigation in Crowded Environments30 Dec 2025
- 2025Socially aware navigation for mobile robots: a survey on deep reinforcement learning approaches18 Nov 2025
- 2025Accelerated Multi-Modal Motion Planning Using Context-Conditioned Diffusion Models16 Oct 2025
- 2025Imitation Learning for Obstacle Avoidance Using End-to-End CNN-Based Sensor Fusion10 Jul 2025
- 2025Are Learning-Based Approaches Ready for Real-World Indoor Navigation? A Case for Imitation Learning5 Jul 2025
- 2025Data-Efficient Learning from Human Interventions for Mobile Robots6 Mar 2025
- 2025MaskPlanner: Learning-Based Object-Centric Motion Generation from 3D Point Clouds26 Feb 2025
- 2024Grounded Curriculum Learning29 Sep 2024
- 2024QuadrupedGPT: Towards a Versatile Quadruped Agent in Open-ended Worlds24 Jun 2024
- 2024RoboArm-NMP: a Learning Environment for Neural Motion Planning25 May 2024
25 more
- 2024Transformer-Enhanced Motion Planner: Attention-Guided Sampling for State-Specific Decision Making30 Apr 2024
- 2024Efficient Motion Planning for Manipulators with Control Barrier Function-Induced Neural Controller1 Apr 2024
- 2024Dyna-LfLH: Learning Agile Navigation in Dynamic Environments from Learned Hallucination25 Mar 2024
- 2024CURE: Simulation-Augmented Auto-Tuning in Robotics8 Feb 2024
- 2023A Study on Learning Social Robot Navigation with Multimodal Perception22 Sep 2023
- 2023Improving Reliable Navigation under Uncertainty via Predictions Informed by Non-Local Information26 Jul 2023
- 2023Leveraging Scene Embeddings for Gradient-Based Motion Planning in Latent Space6 Mar 2023
- 2022Learning Model Predictive Controllers with Real-Time Attention for Real-World Navigation22 Sep 2022
- 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learning15 Jul 2022
- 2022High-Speed Accurate Robot Control using Learned Forward Kinodynamics and Non-linear Least Squares Optimization16 Jun 2022
- 2022Learning Forward Dynamics Model and Informed Trajectory Sampler for Safe Quadruped Navigation19 Apr 2022
- 2022VI-IKD: High-Speed Accurate Off-Road Navigation using Learned Visual-Inertial Inverse Kinodynamics30 Mar 2022
- 2022MLNav: Learning to Safely Navigate on Martian Terrains9 Mar 2022
- 2021Curriculum Learning for Safe Mapless Navigation23 Dec 2021
- 2021Learning Interactive Driving Policies via Data-driven Simulation23 Nov 2021
- 2021Distilling Motion Planner Augmented Policies into Visual Control Policies for Robot Manipulation11 Nov 2021
- 2021Deep Federated Learning for Autonomous Driving12 Oct 2021
- 2021Decentralized Global Connectivity Maintenance for Multi-Robot Navigation: A Reinforcement Learning Approach17 Sep 2021
- 2021Carl-Lead: Lidar-based End-to-End Autonomous Driving with Contrastive Deep Reinforcement Learning17 Sep 2021
- 2021Human-Inspired Multi-Agent Navigation using Knowledge Distillation18 Mar 2021
- 2021Learning a State Representation and Navigation in Cluttered and Dynamic Environments7 Mar 2021
- 2021Autonomous Navigation in Dynamic Environments: Deep Learning-Based Approach3 Feb 2021
- 2021The Pitfall of More Powerful Autoencoders in Lidar-Based Navigation3 Feb 2021
- 2021Cross-Modal Contrastive Learning of Representations for Navigation using Lightweight, Low-Cost Millimeter Wave Radar for Adverse Environmental Conditions10 Jan 2021
- 2020APPLD: Adaptive Planner Parameter Learning from Demonstration31 Mar 2020
- 2020APPLD: Adaptive Planner Parameter Learning from Demonstrationcited by 17
- 2021Distilling Motion Planner Augmented Policies into Visual Control Policies for Robot Manipulationcited by 8
- 2025Imitation Learning for Obstacle Avoidance Using End-to-End CNN-Based Sensor Fusioncited by 1
- 2026Learning from Demonstration with Failure Awareness for Safe Robot Navigationcited by 1
- 2025Are Learning-Based Approaches Ready for Real-World Indoor Navigation? A Case for Imitation Learningcited by 0
- 2026SPADE: Sketch-guided Path Planning Augmented with Diffusion Expertscited by 0
- 2026SPADE: Sketch-guided Path Planning Augmented with Diffusion Experts2 Jun 2026
- 2026Learning from Demonstration with Failure Awareness for Safe Robot Navigation25 Apr 2026
- 2025Imitation Learning for Obstacle Avoidance Using End-to-End CNN-Based Sensor Fusion10 Jul 2025
- 2025Are Learning-Based Approaches Ready for Real-World Indoor Navigation? A Case for Imitation Learning5 Jul 2025
- 2021Distilling Motion Planner Augmented Policies into Visual Control Policies for Robot Manipulation11 Nov 2021
- 2020APPLD: Adaptive Planner Parameter Learning from Demonstration31 Mar 2020
- 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 365
- 2021Deep Federated Learning for Autonomous Drivingcited by 54
- 2021Learning Interactive Driving Policies via Data-driven Simulationcited by 17
- 2021Carl-Lead: Lidar-based End-to-End Autonomous Driving with Contrastive Deep Reinforcement Learningcited by 11
- 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learning15 Jul 2022
- 2021Learning Interactive Driving Policies via Data-driven Simulation23 Nov 2021
- 2021Deep Federated Learning for Autonomous Driving12 Oct 2021
- 2021Carl-Lead: Lidar-based End-to-End Autonomous Driving with Contrastive Deep Reinforcement Learning17 Sep 2021
- 2021Learning a State Representation and Navigation in Cluttered and Dynamic Environmentscited by 30
- 2022Learning Model Predictive Controllers with Real-Time Attention for Real-World Navigationcited by 27
- 2022VI-IKD: High-Speed Accurate Off-Road Navigation using Learned Visual-Inertial Inverse Kinodynamicscited by 19
- 2021Curriculum Learning for Safe Mapless Navigationcited by 11
- 2022High-Speed Accurate Robot Control using Learned Forward Kinodynamics and Non-linear Least Squares Optimizationcited by 9
- 2021Human-Inspired Multi-Agent Navigation using Knowledge Distillationcited by 7
- 2022Learning Forward Dynamics Model and Informed Trajectory Sampler for Safe Quadruped Navigationcited by 6
- 2024Efficient Motion Planning for Manipulators with Control Barrier Function-Induced Neural Controllercited by 5
- 2024Grounded Curriculum Learningcited by 5
- 2023Leveraging Scene Embeddings for Gradient-Based Motion Planning in Latent Spacecited by 4
- 2023A Study on Learning Social Robot Navigation with Multimodal Perceptioncited by 4
- 2024QuadrupedGPT: Towards a Versatile Quadruped Agent in Open-ended Worldscited by 4
12 most cited of 26 All 26 (JSON)
- 2025DRL-TH: Jointly Utilizing Temporal Graph Attention and Hierarchical Fusion for UGV Navigation in Crowded Environments30 Dec 2025
- 2025Socially aware navigation for mobile robots: a survey on deep reinforcement learning approaches18 Nov 2025
- 2025Data-Efficient Learning from Human Interventions for Mobile Robots6 Mar 2025
- 2025MaskPlanner: Learning-Based Object-Centric Motion Generation from 3D Point Clouds26 Feb 2025
- 2024Grounded Curriculum Learning29 Sep 2024
- 2024QuadrupedGPT: Towards a Versatile Quadruped Agent in Open-ended Worlds24 Jun 2024
- 2024RoboArm-NMP: a Learning Environment for Neural Motion Planning25 May 2024
- 2024Transformer-Enhanced Motion Planner: Attention-Guided Sampling for State-Specific Decision Making30 Apr 2024
- 2024Efficient Motion Planning for Manipulators with Control Barrier Function-Induced Neural Controller1 Apr 2024
- 2024Dyna-LfLH: Learning Agile Navigation in Dynamic Environments from Learned Hallucination25 Mar 2024
- 2024CURE: Simulation-Augmented Auto-Tuning in Robotics8 Feb 2024
- 2023A Study on Learning Social Robot Navigation with Multimodal Perception22 Sep 2023
12 newest of 26 All 26 (JSON)