mlsanityData to 7 Oct 2026

Interpretable and Flexible Target-Conditioned Neural Planners For Autonomous Vehicles

arXiv 2309.13485 ↗First posted 23 Sep 2023cs.RO cs.LGcited by 1

On the map: End-to-end autonomous driving → Imitation-learning end-to-end planners

Abstract (arXiv)

Learning-based approaches to autonomous vehicle planners have the potential to scale to many complicated real-world driving scenarios by leveraging huge amounts of driver demonstrations. However, prior work only learns to estimate a single planning trajectory, while there may be multiple acceptable plans in real-world scenarios. To solve the problem, we propose an interpretable neural planner to regress a heatmap, which effectively represents multiple potential goals in the bird's-eye view of an autonomous vehicle. The planner employs an adaptive Gaussian kernel and relaxed hourglass loss to better capture the uncertainty of planning problems. We also use a negative Gaussian kernel to add supervision to the heatmap regression, enabling the model to learn collision avoidance effectively. Our systematic evaluation on the Lyft Open Dataset across a diverse range of real-world driving scenarios shows that our model achieves a safer and more flexible driving performance than prior works.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Imitation-learning end-to-end planners, one of 9 directions in End-to-end autonomous driving. Builds on 24 of its 27 references that are in the map. First posted on arXiv 23 Sep 2023.

Builds on

24 of 27 references.

Closest ancestors · 1

Same direction, newest first

  1. 2021Exploring Imitation Learning for Autonomous Driving with Feedback Synthesizer and Differentiable Rasterization2 Mar

Other references · 23

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
  4. 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 524
  5. 2017A systematic study of the class imbalance problem in convolutional neural networkscited by 510
  6. 2018ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worstcited by 391
  7. 2019A Survey of Autonomous Driving: Common Practices and Emerging Technologiescited by 373
  8. 2020TNT: Target-driveN Trajectory Predictioncited by 345
  9. 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
  10. 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 292
  11. 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
  12. 2021End-to-end Interpretable Neural Motion Plannercited by 240
11 more
  1. 2020One Thousand and One Hours: Self-driving Motion Prediction Datasetcited by 239
  2. 2022Unifying Voxel-based Representation with Transformer for 3D Object Detectioncited by 202
  3. 2022BEVSegFormer: Bird's Eye View Semantic Segmentation From Arbitrary Camera Rigscited by 123
  4. 2019Overcoming Limitations of Mixture Density Networks: A Sampling and Fitting Framework for Multimodal Future Predictioncited by 96
  5. 2018Numerical Coordinate Regression with Convolutional Neural Networkscited by 72
  6. 2020Rethinking the Heatmap Regression for Bottom-up Human Pose Estimationcited by 69
  7. 2019Jointly Learnable Behavior and Trajectory Planning for Self-Driving Vehiclescited by 51
  8. 2020Driving Behavior Modeling using Naturalistic Human Driving Data with Inverse Reinforcement Learningcited by 46
  9. 2018A Reinforcement Learning Based Approach for Automated Lane Change Maneuverscited by 44
  10. 2017InfoGAIL: Interpretable Imitation Learning from Visual Demonstrationscited by 11
  11. 2021BEV-MODNet: Monocular Camera based Bird's Eye View Moving Object Detection for Autonomous Drivingcited by 5

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2022Distribution-aware Goal Prediction and Conformant Model-based Planning for Safe Autonomous Driving
  2. 2024QuAD: Query-based Interpretable Neural Motion Planning for Autonomous Driving
  3. 2023Interpretable Motion Planner for Urban Driving via Hierarchical Imitation Learning
  4. 2025A Framework for Learning Scoring Rules in Autonomous Driving Planning Systems
  5. 2026Learning-Based Behavior Planning for Automated Driving: Real-World Integration and Deployment
  6. 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planning
  7. 2024LHPF: Look back the History and Plan for the Future in Autonomous Driving
  8. 2026HEAT: Heterogeneous End-to-End Autonomous Driving via Trajectory-Guided World Models