Enhancing Mapless Trajectory Prediction through Knowledge Distillation
On the map: Knowledge distillation → Multimodal distillation
Abstract (arXiv)
Scene information plays a crucial role in trajectory forecasting systems for autonomous driving by providing semantic clues and constraints on potential future paths of traffic agents. Prevalent trajectory prediction techniques often take high-definition maps (HD maps) as part of the inputs to provide scene knowledge. Although HD maps offer accurate road information, they may suffer from the high cost of annotation or restrictions of law that limits their widespread use. Therefore, those methods are still expected to generate reliable prediction results in mapless scenarios. In this paper, we tackle the problem of improving the consistency of multi-modal prediction trajectories and the real road topology when map information is unavailable during the test phase. Specifically, we achieve this by training a map-based prediction teacher network on the annotated samples and transferring the knowledge to a student mapless prediction network using a two-fold knowledge distillation framework. Our solution is generalizable for common trajectory prediction networks and does not bring extra computation burden. Experimental results show that our method stably improves prediction performance in mapless mode on many widely used state-of-the-art trajectory prediction baselines, compensating for the gaps caused by the absence of HD maps. Qualitative visualization results demonstrate that our approach helps infer unseen map information.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Multimodal distillation, one of 12 directions in Knowledge distillation. Builds on 38 of its 61 references that are in the map. First posted on arXiv 25 Jun 2023.
Builds on
38 of 61 references.
Closest ancestors · 1
Same direction, newest first
Other references · 37
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2014FitNets: Hints for Thin Deep Netscited by 1,653
- 2019Contrastive Representation Distillationcited by 748
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 732
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 530
- 2022Decoupled Knowledge Distillationcited by 388
- 2020Learning Lane Graph Representations for Motion Forecastingcited by 382
- 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 368
- 2019Variational Information Distillation for Knowledge Transfercited by 324
- 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 314
25 more
- 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 295
- 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 281
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 245
- 2021FIERY: Future Instance Prediction in Bird's-Eye View from Surround Monocular Camerascited by 239
- 2021Multimodal Motion Prediction with Stacked Transformerscited by 208
- 2020DLow: Diversifying Latent Flows for Diverse Human Motion Predictioncited by 185
- 2020From Goals, Waypoints & Paths To Long Term Human Trajectory Forecastingcited by 167
- 2021GOHOME: Graph-Oriented Heatmap Output for future Motion Estimationcited by 146
- 2021HOME: Heatmap Output for future Motion Estimationcited by 122
- 2019Rules of the Road: Predicting Driving Behavior with a Convolutional Model of Semantic Interactionscited by 117
- 2022ViP3D: End-to-end Visual Trajectory Prediction via 3D Agent Queriescited by 117
- 2021LaneRCNN: Distributed Representations for Graph-Centric Motion Forecastingcited by 113
- 2021TPCN: Temporal Point Cloud Networks for Motion Forecastingcited by 94
- 2021Multi-modal Motion Prediction with Transformer-based Neural Network for Autonomous Drivingcited by 73
- 2022GoRela: Go Relative for Viewpoint-Invariant Motion Forecastingcited by 68
- 2023LAformer: Trajectory Prediction for Autonomous Driving with Lane-Aware Scene Constraintscited by 53
- 2023FEND: A Future Enhanced Distribution-Aware Contrastive Learning Framework for Long-tail Trajectory Predictioncited by 31
- 2022Perceive, Interact, Predict: Learning Dynamic and Static Clues for End-to-End Motion Predictioncited by 28
- 2022GATraj: A Graph- and Attention-based Multi-Agent Trajectory Prediction Modelcited by 26
- 2022CRAT-Pred: Vehicle Trajectory Prediction with Crystal Graph Convolutional Neural Networks and Multi-Head Self-Attentioncited by 21
- 2020Likelihood-Based Diverse Sampling for Trajectory Forecastingcited by 16
- 2021Safety-aware Motion Prediction with Unseen Vehicles for Autonomous Drivingcited by 15
- 2022Narrowing the Coordinate-frame Gap in Behavior Prediction Models: Distillation for Efficient and Accurate Scene-centric Motion Forecastingcited by 10
- 2022Aware of the History: Trajectory Forecasting with the Local Behavior Datacited by 9
- 2023FlowMap: Path Generation for Automated Vehicles in Open Space Using Traffic Flowcited by 3
Built on by
Citing papers per year: 2024: 2; 2025: 0; 2026: 1.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2023Exploring Navigation Maps for Learning-Based Motion Prediction
- 2025Improving Partially Observed Trajectories Forecasting by Target-driven Self-Distillation
- 2024On the Road to Portability: Compressing End-to-End Motion Planner for Autonomous Driving
- 2023Distilling Knowledge for Short-to-Long Term Trajectory Prediction
- 2025MapKD: Unlocking Prior Knowledge with Cross-Modal Distillation for Efficient Online HD Map Construction
- 2024Online Temporal Fusion for Vectorized Map Construction in Mapless Autonomous Driving
- 2025Predicting the Road Ahead: A Knowledge Graph based Foundation Model for Scene Understanding in Autonomous Driving
- 2026TaPD: Temporal-adaptive Progressive Distillation for Observation-Adaptive Trajectory Forecasting in Autonomous Driving