On the Road to Portability: Compressing End-to-End Motion Planner for Autonomous Driving
On the map: End-to-end autonomous driving → Reasoning VLA and VLM driving policies
Abstract (arXiv)
End-to-end motion planning models equipped with deep neural networks have shown great potential for enabling full autonomous driving. However, the oversized neural networks render them impractical for deployment on resource-constrained systems, which unavoidably requires more computational time and resources during reference.To handle this, knowledge distillation offers a promising approach that compresses models by enabling a smaller student model to learn from a larger teacher model. Nevertheless, how to apply knowledge distillation to compress motion planners has not been explored so far. In this paper, we propose PlanKD, the first knowledge distillation framework tailored for compressing end-to-end motion planners. First, considering that driving scenes are inherently complex, often containing planning-irrelevant or even noisy information, transferring such information is not beneficial for the student planner. Thus, we design an information bottleneck based strategy to only distill planning-relevant information, rather than transfer all information indiscriminately. Second, different waypoints in an output planned trajectory may hold varying degrees of importance for motion planning, where a slight deviation in certain crucial waypoints might lead to a collision. Therefore, we devise a safety-aware waypoint-attentive distillation module that assigns adaptive weights to different waypoints based on the importance, to encourage the student to accurately mimic more crucial waypoints, thereby improving overall safety. Experiments demonstrate that our PlanKD can boost the performance of smaller planners by a large margin, and significantly reduce their reference time.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Reasoning VLA and VLM driving policies, one of 9 directions in End-to-end autonomous driving. Builds on 40 of its 54 references that are in the map. First posted on arXiv 2 Mar 2024.
Builds on
40 of 54 references.
References · 40
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,059
- 2016Deep Variational Information Bottleneckcited by 915
- 2019Patient Knowledge Distillation for BERT Model Compressioncited by 502
- 2017End-to-end Driving via Conditional Imitation Learningcited by 479
- 2022Decoupled Knowledge Distillationcited by 380
- 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Drivingcited by 372
28 more
- 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 365
- 2019Learning by Cheatingcited by 361
- 2021Distilling Knowledge via Knowledge Reviewcited by 285
- 2019Structured Knowledge Distillation for Dense Predictioncited by 277
- 2022Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baselinecited by 247
- 2021MP3: A Unified Model to Map, Perceive, Predict and Plancited by 211
- 2022Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformercited by 211
- 2021End-to-End Urban Driving by Imitating a Reinforcement Learning Coachcited by 191
- 2021NEAT: Neural Attention Fields for End-to-End Autonomous Drivingcited by 174
- 2016End-to-end Learning of Driving Models from Large-scale Video Datasetscited by 147
- 2021Focal and Global Knowledge Distillation for Detectorscited by 138
- 2022Learning from All Vehiclescited by 135
- 2020A Survey of End-to-End Driving: Architectures and Training Methodscited by 123
- 2019Knowledge Adaptation for Efficient Semantic Segmentationcited by 105
- 2018CIRL: Controllable Imitative Reinforcement Learning for Vision-based Self-drivingcited by 96
- 2021LookOut: Diverse Multi-Future Prediction and Planning for Self-Drivingcited by 96
- 2021Extract the Knowledge of Graph Neural Networks and Go Beyond it: An Effective Knowledge Distillation Frameworkcited by 69
- 2022BEVDistill: Cross-Modal BEV Distillation for Multi-View 3D Object Detectioncited by 66
- 2021Localization Distillation for Dense Object Detectioncited by 55
- 2022Cross-Modality Knowledge Distillation Network for Monocular 3D Object Detectioncited by 48
- 2021Instance-Conditional Knowledge Distillation for Object Detectioncited by 42
- 2022Better Teacher Better Student: Dynamic Prior Knowledge for Knowledge Distillationcited by 41
- 2020On Self-Distilling Graph Neural Networkcited by 35
- 2020LRC-BERT: Latent-representation Contrastive Knowledge Distillation for Natural Language Understandingcited by 27
- 2021Learning Interpretable End-to-End Vision-Based Motion Planning for Autonomous Driving with Optical Flow Distillationcited by 25
- 2023Policy Pre-training for Autonomous Driving via Self-supervised Geometric Modelingcited by 25
- 2021Learning by Watchingcited by 22
- 2022FreeKD: Free-direction Knowledge Distillation for Graph Neural Networkscited by 22
Built on by
Citing papers per year: 2024: 1; 2025: 6; 2026: 3.
10 papers.
- 2025A Survey on Vision-Language-Action Models for Autonomous Drivingcited by 72
- 2024Keypoint-based Progressive Chain-of-Thought Distillation for LLMscited by 22
- 2025DistillDrive: End-to-End Multi-Mode Autonomous Driving Distillation by Isomorphic Hetero-Source Planning Modelcited by 13
- 2025FASIONAD++ : Integrating High-Level Instruction and Information Bottleneck in FAt-Slow fusION Systems for Enhanced Safety in Autonomous Driving with Adaptive Feedbackcited by 12
- 2025VR-Drive: Viewpoint-Robust End-to-End Driving with Feed-Forward 3D Gaussian Splattingcited by 5
- 2025ExpertAD: Enhancing Autonomous Driving Systems with Mixture of Expertscited by 3
- 2025Application of Vision-Language Model to Pedestrians Behavior and Scene Understanding in Autonomous Drivingcited by 2
- 2026MISTY: High-Throughput Motion Planning via Mixer-based Single-step Driftingcited by 1
- 2026Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddingscited by 0
- 2026BucketKD: A Safety-Aware Bucket-Based Knowledge Distillation Framework for End-to-End Motion Planningcited by 0
- 2026BucketKD: A Safety-Aware Bucket-Based Knowledge Distillation Framework for End-to-End Motion Planning12 Jul 2026
- 2026Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddings29 Jun 2026
- 2026MISTY: High-Throughput Motion Planning via Mixer-based Single-step Drifting23 Apr 2026
- 2025ExpertAD: Enhancing Autonomous Driving Systems with Mixture of Experts13 Nov 2025
- 2025VR-Drive: Viewpoint-Robust End-to-End Driving with Feed-Forward 3D Gaussian Splatting27 Oct 2025
- 2025DistillDrive: End-to-End Multi-Mode Autonomous Driving Distillation by Isomorphic Hetero-Source Planning Model7 Aug 2025
- 2025A Survey on Vision-Language-Action Models for Autonomous Driving30 Jun 2025
- 2025FASIONAD++ : Integrating High-Level Instruction and Information Bottleneck in FAt-Slow fusION Systems for Enhanced Safety in Autonomous Driving with Adaptive Feedback11 Mar 2025
- 2025Application of Vision-Language Model to Pedestrians Behavior and Scene Understanding in Autonomous Driving12 Jan 2025
- 2024Keypoint-based Progressive Chain-of-Thought Distillation for LLMs25 May 2024
Similar, not cited
Close in wording, no citation either way
- 2026On-Policy Distillation of Language Models for Autonomous Vehicle Motion Planning
- 2024Towards Scalable & Efficient Interaction-Aware Planning in Autonomous Vehicles using Knowledge Distillation
- 2026Drive-KD: Multi-Teacher Distillation for VLMs in Autonomous Driving
- 2021End-to-End Interactive Prediction and Planning with Optical Flow Distillation for Autonomous Driving
- 2025A Knowledge-Driven Diffusion Policy for End-to-End Autonomous Driving Based on Expert Routing
- 2026RAPiD: Reward-Guided Consistency Distillation of Diffusion Planners for Real-Time Autonomous Driving
- 2026KnowDiffuser: A Knowledge-Guided Diffusion Planner with LLM Reasoning
- 2026Learning to Explain While Planning: Rule-Aligned Diffusion Planning for Autonomous Driving