mlsanityData to 7 Oct 2026

On the Road to Portability: Compressing End-to-End Motion Planner for Autonomous Driving

arXiv 2403.01238 ↗First posted 2 Mar 2024cs.CVcited by 10

On the map: End-to-end autonomous driving → Reasoning VLA and VLM driving policies

Abstract (arXiv)

End-to-end motion planning models equipped with deep neural networks have shown great potential for enabling full autonomous driving. However, the oversized neural networks render them impractical for deployment on resource-constrained systems, which unavoidably requires more computational time and resources during reference.To handle this, knowledge distillation offers a promising approach that compresses models by enabling a smaller student model to learn from a larger teacher model. Nevertheless, how to apply knowledge distillation to compress motion planners has not been explored so far. In this paper, we propose PlanKD, the first knowledge distillation framework tailored for compressing end-to-end motion planners. First, considering that driving scenes are inherently complex, often containing planning-irrelevant or even noisy information, transferring such information is not beneficial for the student planner. Thus, we design an information bottleneck based strategy to only distill planning-relevant information, rather than transfer all information indiscriminately. Second, different waypoints in an output planned trajectory may hold varying degrees of importance for motion planning, where a slight deviation in certain crucial waypoints might lead to a collision. Therefore, we devise a safety-aware waypoint-attentive distillation module that assigns adaptive weights to different waypoints based on the importance, to encourage the student to accurately mimic more crucial waypoints, thereby improving overall safety. Experiments demonstrate that our PlanKD can boost the performance of smaller planners by a large margin, and significantly reduce their reference time.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Reasoning VLA and VLM driving policies, one of 9 directions in End-to-end autonomous driving. Builds on 40 of its 54 references that are in the map. First posted on arXiv 2 Mar 2024.

Builds on

40 of 54 references.

References · 40

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  4. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  5. 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
  6. 2022Planning-oriented Autonomous Drivingcited by 1,068
  7. 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,059
  8. 2016Deep Variational Information Bottleneckcited by 915
  9. 2019Patient Knowledge Distillation for BERT Model Compressioncited by 502
  10. 2017End-to-end Driving via Conditional Imitation Learningcited by 479
  11. 2022Decoupled Knowledge Distillationcited by 380
  12. 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Drivingcited by 372
28 more
  1. 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 365
  2. 2019Learning by Cheatingcited by 361
  3. 2021Distilling Knowledge via Knowledge Reviewcited by 285
  4. 2019Structured Knowledge Distillation for Dense Predictioncited by 277
  5. 2022Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baselinecited by 247
  6. 2021MP3: A Unified Model to Map, Perceive, Predict and Plancited by 211
  7. 2022Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformercited by 211
  8. 2021End-to-End Urban Driving by Imitating a Reinforcement Learning Coachcited by 191
  9. 2021NEAT: Neural Attention Fields for End-to-End Autonomous Drivingcited by 174
  10. 2016End-to-end Learning of Driving Models from Large-scale Video Datasetscited by 147
  11. 2021Focal and Global Knowledge Distillation for Detectorscited by 138
  12. 2022Learning from All Vehiclescited by 135
  13. 2020A Survey of End-to-End Driving: Architectures and Training Methodscited by 123
  14. 2019Knowledge Adaptation for Efficient Semantic Segmentationcited by 105
  15. 2018CIRL: Controllable Imitative Reinforcement Learning for Vision-based Self-drivingcited by 96
  16. 2021LookOut: Diverse Multi-Future Prediction and Planning for Self-Drivingcited by 96
  17. 2021Extract the Knowledge of Graph Neural Networks and Go Beyond it: An Effective Knowledge Distillation Frameworkcited by 69
  18. 2022BEVDistill: Cross-Modal BEV Distillation for Multi-View 3D Object Detectioncited by 66
  19. 2021Localization Distillation for Dense Object Detectioncited by 55
  20. 2022Cross-Modality Knowledge Distillation Network for Monocular 3D Object Detectioncited by 48
  21. 2021Instance-Conditional Knowledge Distillation for Object Detectioncited by 42
  22. 2022Better Teacher Better Student: Dynamic Prior Knowledge for Knowledge Distillationcited by 41
  23. 2020On Self-Distilling Graph Neural Networkcited by 35
  24. 2020LRC-BERT: Latent-representation Contrastive Knowledge Distillation for Natural Language Understandingcited by 27
  25. 2021Learning Interpretable End-to-End Vision-Based Motion Planning for Autonomous Driving with Optical Flow Distillationcited by 25
  26. 2023Policy Pre-training for Autonomous Driving via Self-supervised Geometric Modelingcited by 25
  27. 2021Learning by Watchingcited by 22
  28. 2022FreeKD: Free-direction Knowledge Distillation for Graph Neural Networkscited by 22

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 6; 2026: 3.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026On-Policy Distillation of Language Models for Autonomous Vehicle Motion Planning
  2. 2024Towards Scalable & Efficient Interaction-Aware Planning in Autonomous Vehicles using Knowledge Distillation
  3. 2026Drive-KD: Multi-Teacher Distillation for VLMs in Autonomous Driving
  4. 2021End-to-End Interactive Prediction and Planning with Optical Flow Distillation for Autonomous Driving
  5. 2025A Knowledge-Driven Diffusion Policy for End-to-End Autonomous Driving Based on Expert Routing
  6. 2026RAPiD: Reward-Guided Consistency Distillation of Diffusion Planners for Real-Time Autonomous Driving
  7. 2026KnowDiffuser: A Knowledge-Guided Diffusion Planner with LLM Reasoning
  8. 2026Learning to Explain While Planning: Rule-Aligned Diffusion Planning for Autonomous Driving