Interpretable and Flexible Target-Conditioned Neural Planners For Autonomous Vehicles
On the map: End-to-end autonomous driving → Imitation-learning end-to-end planners
Abstract (arXiv)
Learning-based approaches to autonomous vehicle planners have the potential to scale to many complicated real-world driving scenarios by leveraging huge amounts of driver demonstrations. However, prior work only learns to estimate a single planning trajectory, while there may be multiple acceptable plans in real-world scenarios. To solve the problem, we propose an interpretable neural planner to regress a heatmap, which effectively represents multiple potential goals in the bird's-eye view of an autonomous vehicle. The planner employs an adaptive Gaussian kernel and relaxed hourglass loss to better capture the uncertainty of planning problems. We also use a negative Gaussian kernel to add supervision to the heatmap regression, enabling the model to learn collision avoidance effectively. Our systematic evaluation on the Lyft Open Dataset across a diverse range of real-world driving scenarios shows that our model achieves a safer and more flexible driving performance than prior works.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Imitation-learning end-to-end planners, one of 9 directions in End-to-end autonomous driving. Builds on 24 of its 27 references that are in the map. First posted on arXiv 23 Sep 2023.
Builds on
24 of 27 references.
Closest ancestors · 1
Same direction, newest first
Other references · 23
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
- 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 524
- 2017A systematic study of the class imbalance problem in convolutional neural networkscited by 510
- 2018ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worstcited by 391
- 2019A Survey of Autonomous Driving: Common Practices and Emerging Technologiescited by 373
- 2020TNT: Target-driveN Trajectory Predictioncited by 345
- 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
- 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 292
- 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
- 2021End-to-end Interpretable Neural Motion Plannercited by 240
11 more
- 2020One Thousand and One Hours: Self-driving Motion Prediction Datasetcited by 239
- 2022Unifying Voxel-based Representation with Transformer for 3D Object Detectioncited by 202
- 2022BEVSegFormer: Bird's Eye View Semantic Segmentation From Arbitrary Camera Rigscited by 123
- 2019Overcoming Limitations of Mixture Density Networks: A Sampling and Fitting Framework for Multimodal Future Predictioncited by 96
- 2018Numerical Coordinate Regression with Convolutional Neural Networkscited by 72
- 2020Rethinking the Heatmap Regression for Bottom-up Human Pose Estimationcited by 69
- 2019Jointly Learnable Behavior and Trajectory Planning for Self-Driving Vehiclescited by 51
- 2020Driving Behavior Modeling using Naturalistic Human Driving Data with Inverse Reinforcement Learningcited by 46
- 2018A Reinforcement Learning Based Approach for Automated Lane Change Maneuverscited by 44
- 2017InfoGAIL: Interpretable Imitation Learning from Visual Demonstrationscited by 11
- 2021BEV-MODNet: Monocular Camera based Bird's Eye View Moving Object Detection for Autonomous Drivingcited by 5
Built on by
Citing papers per year: 2024: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2022Distribution-aware Goal Prediction and Conformant Model-based Planning for Safe Autonomous Driving
- 2024QuAD: Query-based Interpretable Neural Motion Planning for Autonomous Driving
- 2023Interpretable Motion Planner for Urban Driving via Hierarchical Imitation Learning
- 2025A Framework for Learning Scoring Rules in Autonomous Driving Planning Systems
- 2026Learning-Based Behavior Planning for Automated Driving: Real-World Integration and Deployment
- 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planning
- 2024LHPF: Look back the History and Plan for the Future in Autonomous Driving
- 2026HEAT: Heterogeneous End-to-End Autonomous Driving via Trajectory-Guided World Models