Learning to Navigate Intersections with Unsupervised Driver Trait Inference
Not on the map. Why?
Abstract (arXiv)
Navigation through uncontrolled intersections is one of the key challenges for autonomous vehicles. Identifying the subtle differences in hidden traits of other drivers can bring significant benefits when navigating in such environments. We propose an unsupervised method for inferring driver traits such as driving styles from observed vehicle trajectories. We use a variational autoencoder with recurrent neural networks to learn a latent representation of traits without any ground truth trait labels. Then, we use this trait representation to learn a policy for an autonomous vehicle to navigate through a T-intersection with deep reinforcement learning. Our pipeline enables the autonomous vehicle to adjust its actions when dealing with drivers of different traits to ensure safety and efficiency. Our method demonstrates promising performance and outperforms state-of-the-art baselines in the T-intersection scenario.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 19 of its 39 references that are in the map. First posted on arXiv 14 Sep 2021.
Builds on
19 of 39 references.
References · 19
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2015Generating Sentences from a Continuous Spacecited by 612
- 2018The highD Dataset: A Drone Dataset of Naturalistic Vehicle Trajectories on German Highways for Validation of Highly Automated Driving Systemscited by 277
- 2019INTERACTION Dataset: An INTERnational, Adversarial and Cooperative moTION Dataset in Interactive Driving Scenarios with Semantic Mapscited by 231
- 2020Social NCE: Contrastive Learning of Socially-aware Motion Representationscited by 58
- 2015Learning to Transduce with Unbounded Memorycited by 54
- 2017Multimodal Probabilistic Model-Based Planning for Human-Robot Interactioncited by 50
- 2020Multimodal Deep Generative Models for Trajectory Prediction: A Conditional Variational Autoencoder Approachcited by 47
- 2020Decentralized Structural-RNN for Robot Crowd Navigation with Deep Reinforcement Learningcited by 40
- 2020Reinforcement Learning for Autonomous Driving with Latent State Inference and Spatial-Temporal Relationshipscited by 37
7 more
- 2017Navigating Occluded Intersections with Autonomous Vehicles using Deep Reinforcement Learningcited by 21
- 2017Towards Full Automated Drive in Urban Environments: A Demonstration in GoMentum Station, Californiacited by 17
- 2017Simultaneous Policy Learning and Latent State Inference for Imitating Driver Behaviorcited by 16
- 2017The Value of Inferring the Internal State of Traffic Participants for Autonomous Freeway Drivingcited by 15
- 2017Belief State Planning for Autonomously Navigating Urban Intersectionscited by 11
- 2017Autoencoder Regularized Network For Driving Style Representation Learningcited by 9
- 2020A Taxonomy and Review of Algorithms for Modeling and Predicting Human Driver Behaviorcited by 9
Built on by
Citing papers per year: 2023: 3; 2024: 2; 2025: 3.
8 papers.
- 2023Interactive Autonomous Navigation with Internal State Inference and Interactivity Estimationcited by 10
- 2024HEIGHT: Heterogeneous Interaction Graph Transformer for Robot Navigation in Crowded and Constrained Environmentscited by 9
- 2023Robust Driving Policy Learning with Guided Meta Reinforcement Learningcited by 5
- 2023PeRP: Personalized Residual Policies For Congestion Mitigation Through Co-operative Advisory Systemscited by 4
- 2024Cooperative Advisory Residual Policies for Congestion Mitigationcited by 1
- 2025An Expert Ensemble for Detecting Anomalous Scenes, Interactions, and Behaviors in Autonomous Drivingcited by 1
- 2025Casper: Inferring Diverse Intents for Assistive Teleoperation with Vision Language Modelscited by 1
- 2025Goal-conditioned Hierarchical Reinforcement Learning for Sample-efficient and Safe Autonomous Driving at Intersectionscited by 0
- 2025Goal-conditioned Hierarchical Reinforcement Learning for Sample-efficient and Safe Autonomous Driving at Intersections19 Jun 2025
- 2025Casper: Inferring Diverse Intents for Assistive Teleoperation with Vision Language Models17 Jun 2025
- 2025An Expert Ensemble for Detecting Anomalous Scenes, Interactions, and Behaviors in Autonomous Driving23 Feb 2025
- 2024HEIGHT: Heterogeneous Interaction Graph Transformer for Robot Navigation in Crowded and Constrained Environments19 Nov 2024
- 2024Cooperative Advisory Residual Policies for Congestion Mitigation30 Jun 2024
- 2023Interactive Autonomous Navigation with Internal State Inference and Interactivity Estimation27 Nov 2023
- 2023PeRP: Personalized Residual Policies For Congestion Mitigation Through Co-operative Advisory Systems1 Aug 2023
- 2023Robust Driving Policy Learning with Guided Meta Reinforcement Learning19 Jul 2023