mlsanityData to 7 Oct 2026

Transferable and Adaptable Driving Behavior Prediction

arXiv 2202.05140 ↗First posted 10 Feb 2022cs.RO cs.AIcited by 20

Not on the map. Why?

Abstract (arXiv)

While autonomous vehicles still struggle to solve challenging situations during on-road driving, humans have long mastered the essence of driving with efficient, transferable, and adaptable driving capability. By mimicking humans' cognition model and semantic understanding during driving, we propose HATN, a hierarchical framework to generate high-quality, transferable, and adaptable predictions for driving behaviors in multi-agent dense-traffic environments. Our hierarchical method consists of a high-level intention identification policy and a low-level trajectory generation policy. We introduce a novel semantic sub-task definition and generic state representation for each sub-task. With these techniques, the hierarchical framework is transferable across different driving scenarios. Besides, our model is able to capture variations of driving behaviors among individuals and scenarios by an online adaptation module. We demonstrate our algorithms in the task of trajectory prediction for real traffic data at intersections and roundabouts from the INTERACTION dataset. Through extensive numerical studies, it is evident that our method significantly outperformed other methods in terms of prediction accuracy, transferability, and adaptability. Pushing the state-of-the-art performance by a considerable margin, we also provide a cognitive view of understanding the driving behavior behind such improvement. We highlight that in the future, more research attention and effort are deserved for transferability and adaptability. It is not only due to the promising performance elevation of prediction and planning algorithms, but more fundamentally, they are crucial for the scalable and general deployment of autonomous vehicles.

Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 37 of its 80 references that are in the map. First posted on arXiv 10 Feb 2022.

Builds on

37 of 80 references.

References · 37

  1. 2017Graph Attention Networkscited by 8,854
  2. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  3. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  4. 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
  5. 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,024
  6. 2014Deep Visual-Semantic Alignments for Generating Image Descriptionscited by 966
  7. 2014Show and Tell: A Neural Image Caption Generatorcited by 877
  8. 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
  9. 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
  10. 2017End-to-end Driving via Conditional Imitation Learningcited by 479
  11. 2020TNT: Target-driveN Trajectory Predictioncited by 345
  12. 2018Graph networks as learnable physics engines for inference and controlcited by 242
25 more
  1. 2019Human Motion Trajectory Prediction: A Surveycited by 231
  2. 2019INTERACTION Dataset: An INTERnational, Adversarial and Cooperative moTION Dataset in Interactive Driving Scenarios with Semantic Mapscited by 231
  3. 2016Learning to Navigate in Complex Environmentscited by 192
  4. 2019PRECOG: PREdiction Conditioned On Goals in Visual Multi-Agent Settingscited by 178
  5. 2019Multiple Futures Predictioncited by 178
  6. 2017On a Formal Model of Safe and Scalable Self-driving Carscited by 129
  7. 2018TrafficPredict: Trajectory Prediction for Heterogeneous Traffic-Agentscited by 111
  8. 2018Sequence-to-Sequence Prediction of Vehicle Trajectory via LSTM Encoder-Decoder Architecturecited by 55
  9. 2018How would surround vehicles move? A Unified Framework for Maneuver Classification and Motion Predictioncited by 46
  10. 2018Probabilistic Prediction of Vehicle Semantic Intention and Motioncited by 31
  11. 2018Naturalistic Driver Intention and Path Prediction using Recurrent Neural Networkscited by 29
  12. 2018Probabilistic Prediction of Interactive Driving Behavior via Hierarchical Inverse Reinforcement Learningcited by 28
  13. 2017Neural Machine Translation and Sequence-to-sequence Models: A Tutorialcited by 25
  14. 2020Socially-Compatible Behavior Design of Autonomous Vehicles with Verification on Real Human Datacited by 18
  15. 2020Scenario-Transferable Semantic Graph Reasoning for Interaction-Aware Probabilistic Predictioncited by 17
  16. 2019Predicting Vehicle Behaviors Over An Extended Horizon Using Behavior Interaction Networkcited by 15
  17. 2018Courteous Autonomous Carscited by 14
  18. 2018Multimodal Interaction-aware Motion Prediction for Autonomous Street Crossingcited by 13
  19. 2021Hierarchical Adaptable and Transferable Networks (HATN) for Driving Behavior Predictioncited by 10
  20. 2019Towards Better Human Robot Collaboration with Robust Plan Recognition and Trajectory Predictioncited by 8
  21. 2020Spatiotemporal Learning of Multivehicle Interaction Patterns in Lane-Change Scenarioscited by 8
  22. 2018A Framework for Probabilistic Generic Traffic Scene Predictioncited by 6
  23. 2019Robust Online Model Adaptation by Extended Kalman Filter with Exponential Moving Average and Dynamic Multi-Epoch Strategycited by 6
  24. 2021Online Adaptation of Neural Network Models by Modified Extended Kalman Filter for Customizable and Transferable Driving Behavior Predictioncited by 6
  25. 2021Convolutions for Spatial Interaction Modelingcited by 2

Built on by

Cited by year

Citing papers per year: 2022: 6; 2023: 5; 2024: 5; 2025: 4.

20 papers.

Sort:

By area:

  1. 2022Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformercited by 211
  2. 2023ReasonNet: End-to-End Driving with Temporal and Global Reasoningcited by 92
  3. 2023Efficient Reinforcement Learning for Autonomous Driving with Parameterized Skills and Priorscited by 36
  4. 2024SmartRefine: A Scenario-Adaptive Refinement Framework for Efficient Motion Predictioncited by 33
  5. 2022Expanding the Deployment Envelope of Behavior Prediction via Adaptive Meta-Learningcited by 23
  6. 2024T4P: Test-Time Training of Trajectory Prediction via Masked Autoencoder and Actor-specific Token Memorycited by 20
  7. 2023Boosting Offline Reinforcement Learning for Autonomous Driving with Hierarchical Latent Skillscited by 13
  8. 2022Accelerating Reinforcement Learning for Autonomous Driving using Task-Agnostic and Ego-Centric Motion Skillscited by 12
  9. 2022Motion Style Transfer: Modular Low-Rank Adaptation for Deep Motion Forecastingcited by 12
  10. 2023Improving Transferability for Cross-domain Trajectory Prediction via Neural Stochastic Differential Equationcited by 12
  11. 2025DriveAgent-R1: Advancing VLM-based Autonomous Driving with Active Perception and Hybrid Thinkingcited by 11
  12. 2024SmartPretrain: Model-Agnostic and Dataset-Agnostic Representation Learning for Motion Predictioncited by 7
8 more
  1. 2022SHAIL: Safety-Aware Hierarchical Adversarial Imitation Learning for Autonomous Driving in Urban Environmentscited by 5
  2. 2023Adaptive Human Trajectory Prediction via Latent Corridorscited by 5
  3. 2024Towards Generalizable and Interpretable Motion Prediction: A Deep Variational Bayes Approachcited by 5
  4. 2025Trends in Motion Prediction Toward Deployable and Generalizable Autonomy: A Revisit and Perspectivescited by 5
  5. 2025ForeSight: Multi-View Streaming Joint Object Detection and Trajectory Forecastingcited by 3
  6. 2024MetaTra: Meta-Learning for Generalized Trajectory Prediction in Unseen Domaincited by 2
  7. 2022Generalizability Analysis of Graph-based Trajectory Predictor with Vectorized Representationcited by 1
  8. 2025AdaSports-Traj: Role- and Domain-Aware Adaptation for Multi-Agent Trajectory Modeling in Sportscited by 0