Transferable and Adaptable Driving Behavior Prediction
Not on the map. Why?
Abstract (arXiv)
While autonomous vehicles still struggle to solve challenging situations during on-road driving, humans have long mastered the essence of driving with efficient, transferable, and adaptable driving capability. By mimicking humans' cognition model and semantic understanding during driving, we propose HATN, a hierarchical framework to generate high-quality, transferable, and adaptable predictions for driving behaviors in multi-agent dense-traffic environments. Our hierarchical method consists of a high-level intention identification policy and a low-level trajectory generation policy. We introduce a novel semantic sub-task definition and generic state representation for each sub-task. With these techniques, the hierarchical framework is transferable across different driving scenarios. Besides, our model is able to capture variations of driving behaviors among individuals and scenarios by an online adaptation module. We demonstrate our algorithms in the task of trajectory prediction for real traffic data at intersections and roundabouts from the INTERACTION dataset. Through extensive numerical studies, it is evident that our method significantly outperformed other methods in terms of prediction accuracy, transferability, and adaptability. Pushing the state-of-the-art performance by a considerable margin, we also provide a cognitive view of understanding the driving behavior behind such improvement. We highlight that in the future, more research attention and effort are deserved for transferability and adaptability. It is not only due to the promising performance elevation of prediction and planning algorithms, but more fundamentally, they are crucial for the scalable and general deployment of autonomous vehicles.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 37 of its 80 references that are in the map. First posted on arXiv 10 Feb 2022.
Builds on
37 of 80 references.
References · 37
- 2017Graph Attention Networkscited by 8,854
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
- 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,024
- 2014Deep Visual-Semantic Alignments for Generating Image Descriptionscited by 966
- 2014Show and Tell: A Neural Image Caption Generatorcited by 877
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
- 2017End-to-end Driving via Conditional Imitation Learningcited by 479
- 2020TNT: Target-driveN Trajectory Predictioncited by 345
- 2018Graph networks as learnable physics engines for inference and controlcited by 242
25 more
- 2019Human Motion Trajectory Prediction: A Surveycited by 231
- 2019INTERACTION Dataset: An INTERnational, Adversarial and Cooperative moTION Dataset in Interactive Driving Scenarios with Semantic Mapscited by 231
- 2016Learning to Navigate in Complex Environmentscited by 192
- 2019PRECOG: PREdiction Conditioned On Goals in Visual Multi-Agent Settingscited by 178
- 2019Multiple Futures Predictioncited by 178
- 2017On a Formal Model of Safe and Scalable Self-driving Carscited by 129
- 2018TrafficPredict: Trajectory Prediction for Heterogeneous Traffic-Agentscited by 111
- 2018Sequence-to-Sequence Prediction of Vehicle Trajectory via LSTM Encoder-Decoder Architecturecited by 55
- 2018How would surround vehicles move? A Unified Framework for Maneuver Classification and Motion Predictioncited by 46
- 2018Probabilistic Prediction of Vehicle Semantic Intention and Motioncited by 31
- 2018Naturalistic Driver Intention and Path Prediction using Recurrent Neural Networkscited by 29
- 2018Probabilistic Prediction of Interactive Driving Behavior via Hierarchical Inverse Reinforcement Learningcited by 28
- 2017Neural Machine Translation and Sequence-to-sequence Models: A Tutorialcited by 25
- 2020Socially-Compatible Behavior Design of Autonomous Vehicles with Verification on Real Human Datacited by 18
- 2020Scenario-Transferable Semantic Graph Reasoning for Interaction-Aware Probabilistic Predictioncited by 17
- 2019Predicting Vehicle Behaviors Over An Extended Horizon Using Behavior Interaction Networkcited by 15
- 2018Courteous Autonomous Carscited by 14
- 2018Multimodal Interaction-aware Motion Prediction for Autonomous Street Crossingcited by 13
- 2021Hierarchical Adaptable and Transferable Networks (HATN) for Driving Behavior Predictioncited by 10
- 2019Towards Better Human Robot Collaboration with Robust Plan Recognition and Trajectory Predictioncited by 8
- 2020Spatiotemporal Learning of Multivehicle Interaction Patterns in Lane-Change Scenarioscited by 8
- 2018A Framework for Probabilistic Generic Traffic Scene Predictioncited by 6
- 2019Robust Online Model Adaptation by Extended Kalman Filter with Exponential Moving Average and Dynamic Multi-Epoch Strategycited by 6
- 2021Online Adaptation of Neural Network Models by Modified Extended Kalman Filter for Customizable and Transferable Driving Behavior Predictioncited by 6
- 2021Convolutions for Spatial Interaction Modelingcited by 2
Built on by
Citing papers per year: 2022: 6; 2023: 5; 2024: 5; 2025: 4.
20 papers.
Sort:
By area:
- 2022Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformercited by 211
- 2023ReasonNet: End-to-End Driving with Temporal and Global Reasoningcited by 92
- 2023Efficient Reinforcement Learning for Autonomous Driving with Parameterized Skills and Priorscited by 36
- 2024SmartRefine: A Scenario-Adaptive Refinement Framework for Efficient Motion Predictioncited by 33
- 2022Expanding the Deployment Envelope of Behavior Prediction via Adaptive Meta-Learningcited by 23
- 2024T4P: Test-Time Training of Trajectory Prediction via Masked Autoencoder and Actor-specific Token Memorycited by 20
- 2023Boosting Offline Reinforcement Learning for Autonomous Driving with Hierarchical Latent Skillscited by 13
- 2022Accelerating Reinforcement Learning for Autonomous Driving using Task-Agnostic and Ego-Centric Motion Skillscited by 12
- 2022Motion Style Transfer: Modular Low-Rank Adaptation for Deep Motion Forecastingcited by 12
- 2023Improving Transferability for Cross-domain Trajectory Prediction via Neural Stochastic Differential Equationcited by 12
- 2025DriveAgent-R1: Advancing VLM-based Autonomous Driving with Active Perception and Hybrid Thinkingcited by 11
- 2024SmartPretrain: Model-Agnostic and Dataset-Agnostic Representation Learning for Motion Predictioncited by 7
8 more
- 2022SHAIL: Safety-Aware Hierarchical Adversarial Imitation Learning for Autonomous Driving in Urban Environmentscited by 5
- 2023Adaptive Human Trajectory Prediction via Latent Corridorscited by 5
- 2024Towards Generalizable and Interpretable Motion Prediction: A Deep Variational Bayes Approachcited by 5
- 2025Trends in Motion Prediction Toward Deployable and Generalizable Autonomy: A Revisit and Perspectivescited by 5
- 2025ForeSight: Multi-View Streaming Joint Object Detection and Trajectory Forecastingcited by 3
- 2024MetaTra: Meta-Learning for Generalized Trajectory Prediction in Unseen Domaincited by 2
- 2022Generalizability Analysis of Graph-based Trajectory Predictor with Vectorized Representationcited by 1
- 2025AdaSports-Traj: Role- and Domain-Aware Adaptation for Multi-Agent Trajectory Modeling in Sportscited by 0
- 2025AdaSports-Traj: Role- and Domain-Aware Adaptation for Multi-Agent Trajectory Modeling in Sports19 Sep 2025
- 2025ForeSight: Multi-View Streaming Joint Object Detection and Trajectory Forecasting9 Aug 2025
- 2025DriveAgent-R1: Advancing VLM-based Autonomous Driving with Active Perception and Hybrid Thinking28 Jul 2025
- 2025Trends in Motion Prediction Toward Deployable and Generalizable Autonomy: A Revisit and Perspectives14 May 2025
- 2024SmartPretrain: Model-Agnostic and Dataset-Agnostic Representation Learning for Motion Prediction11 Oct 2024
- 2024SmartRefine: A Scenario-Adaptive Refinement Framework for Efficient Motion Prediction18 Mar 2024
- 2024T4P: Test-Time Training of Trajectory Prediction via Masked Autoencoder and Actor-specific Token Memory15 Mar 2024
- 2024Towards Generalizable and Interpretable Motion Prediction: A Deep Variational Bayes Approach10 Mar 2024
- 2024MetaTra: Meta-Learning for Generalized Trajectory Prediction in Unseen Domain13 Feb 2024
- 2023Improving Transferability for Cross-domain Trajectory Prediction via Neural Stochastic Differential Equation26 Dec 2023
- 2023Adaptive Human Trajectory Prediction via Latent Corridors11 Dec 2023
- 2023Boosting Offline Reinforcement Learning for Autonomous Driving with Hierarchical Latent Skills24 Sep 2023
8 more
- 2023ReasonNet: End-to-End Driving with Temporal and Global Reasoning17 May 2023
- 2023Efficient Reinforcement Learning for Autonomous Driving with Parameterized Skills and Priors8 May 2023
- 2022Motion Style Transfer: Modular Low-Rank Adaptation for Deep Motion Forecasting6 Nov 2022
- 2022Accelerating Reinforcement Learning for Autonomous Driving using Task-Agnostic and Ego-Centric Motion Skills24 Sep 2022
- 2022Expanding the Deployment Envelope of Behavior Prediction via Adaptive Meta-Learning23 Sep 2022
- 2022Generalizability Analysis of Graph-based Trajectory Predictor with Vectorized Representation6 Aug 2022
- 2022Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformer28 Jul 2022
- 2022SHAIL: Safety-Aware Hierarchical Adversarial Imitation Learning for Autonomous Driving in Urban Environments5 Apr 2022
- 2023ReasonNet: End-to-End Driving with Temporal and Global Reasoningcited by 92
- 2023Efficient Reinforcement Learning for Autonomous Driving with Parameterized Skills and Priorscited by 36
- 2023Boosting Offline Reinforcement Learning for Autonomous Driving with Hierarchical Latent Skillscited by 13
- 2022Accelerating Reinforcement Learning for Autonomous Driving using Task-Agnostic and Ego-Centric Motion Skillscited by 12
- 2022SHAIL: Safety-Aware Hierarchical Adversarial Imitation Learning for Autonomous Driving in Urban Environmentscited by 5
- 2023Boosting Offline Reinforcement Learning for Autonomous Driving with Hierarchical Latent Skills24 Sep 2023
- 2023ReasonNet: End-to-End Driving with Temporal and Global Reasoning17 May 2023
- 2023Efficient Reinforcement Learning for Autonomous Driving with Parameterized Skills and Priors8 May 2023
- 2022Accelerating Reinforcement Learning for Autonomous Driving using Task-Agnostic and Ego-Centric Motion Skills24 Sep 2022
- 2022SHAIL: Safety-Aware Hierarchical Adversarial Imitation Learning for Autonomous Driving in Urban Environments5 Apr 2022
- 2022Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformercited by 211
- 2024SmartRefine: A Scenario-Adaptive Refinement Framework for Efficient Motion Predictioncited by 33
- 2022Expanding the Deployment Envelope of Behavior Prediction via Adaptive Meta-Learningcited by 23
- 2024T4P: Test-Time Training of Trajectory Prediction via Masked Autoencoder and Actor-specific Token Memorycited by 20
- 2022Motion Style Transfer: Modular Low-Rank Adaptation for Deep Motion Forecastingcited by 12
- 2023Improving Transferability for Cross-domain Trajectory Prediction via Neural Stochastic Differential Equationcited by 12
- 2024SmartPretrain: Model-Agnostic and Dataset-Agnostic Representation Learning for Motion Predictioncited by 7
- 2023Adaptive Human Trajectory Prediction via Latent Corridorscited by 5
- 2024Towards Generalizable and Interpretable Motion Prediction: A Deep Variational Bayes Approachcited by 5
- 2025ForeSight: Multi-View Streaming Joint Object Detection and Trajectory Forecastingcited by 3
- 2024MetaTra: Meta-Learning for Generalized Trajectory Prediction in Unseen Domaincited by 2
- 2022Generalizability Analysis of Graph-based Trajectory Predictor with Vectorized Representationcited by 1
12 most cited of 13 All 13 (JSON)
- 2025AdaSports-Traj: Role- and Domain-Aware Adaptation for Multi-Agent Trajectory Modeling in Sports19 Sep 2025
- 2025ForeSight: Multi-View Streaming Joint Object Detection and Trajectory Forecasting9 Aug 2025
- 2024SmartPretrain: Model-Agnostic and Dataset-Agnostic Representation Learning for Motion Prediction11 Oct 2024
- 2024SmartRefine: A Scenario-Adaptive Refinement Framework for Efficient Motion Prediction18 Mar 2024
- 2024T4P: Test-Time Training of Trajectory Prediction via Masked Autoencoder and Actor-specific Token Memory15 Mar 2024
- 2024Towards Generalizable and Interpretable Motion Prediction: A Deep Variational Bayes Approach10 Mar 2024
- 2024MetaTra: Meta-Learning for Generalized Trajectory Prediction in Unseen Domain13 Feb 2024
- 2023Improving Transferability for Cross-domain Trajectory Prediction via Neural Stochastic Differential Equation26 Dec 2023
- 2023Adaptive Human Trajectory Prediction via Latent Corridors11 Dec 2023
- 2022Motion Style Transfer: Modular Low-Rank Adaptation for Deep Motion Forecasting6 Nov 2022
- 2022Expanding the Deployment Envelope of Behavior Prediction via Adaptive Meta-Learning23 Sep 2022
- 2022Generalizability Analysis of Graph-based Trajectory Predictor with Vectorized Representation6 Aug 2022
12 newest of 13 All 13 (JSON)