SwapTransformer: highway overtaking tactical planner model via imitation learning on OSHA dataset
On the map: Offline RL and imitation learning from data → Imitation and offline RL for driving
Abstract (arXiv)
This paper investigates the high-level decision-making problem in highway scenarios regarding lane changing and over-taking other slower vehicles. In particular, this paper aims to improve the Travel Assist feature for automatic overtaking and lane changes on highways. About 9 million samples including lane images and other dynamic objects are collected in simulation. This data; Overtaking on Simulated HighwAys (OSHA) dataset is released to tackle this challenge. To solve this problem, an architecture called SwapTransformer is designed and implemented as an imitation learning approach on the OSHA dataset. Moreover, auxiliary tasks such as future points and car distance network predictions are proposed to aid the model in better understanding the surrounding environment. The performance of the proposed solution is compared with a multi-layer perceptron (MLP) and multi-head self-attention networks as baselines in a simulation environment. We also demonstrate the performance of the model with and without auxiliary tasks. All models are evaluated based on different metrics such as time to finish each lap, number of overtakes, and speed difference with speed limit. The evaluation shows that the SwapTransformer model outperforms other models in different traffic densities in the inference phase.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Imitation and offline RL for driving, one of 13 directions in Offline RL and imitation learning from data. Builds on 38 of its 61 references that are in the map. First posted on arXiv 2 Jan 2024.
Builds on
38 of 61 references.
Closest ancestors · 2
Same direction, newest first
- 2022Model-Based Imitation Learning for Urban Driving14 Oct
- 2021Adversarial Imitation Learning via Random Search in Lane Change Decision-Making11 Sep
Other references · 36
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2016End to End Learning for Self-Driving Carscited by 1,000
- 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 791
- 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 532
- 2019A Survey of Deep Learning Techniques for Autonomous Drivingcited by 401
- 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 279
24 more
- 2020One Thousand and One Hours: Self-driving Motion Prediction Datasetcited by 239
- 2018Unity: A General Platform for Intelligent Agentscited by 232
- 2023Waymax: An Accelerated, Data-Driven Simulator for Large-Scale Autonomous Driving Researchcited by 158
- 2023Motion Planning for Autonomous Driving: The State of the Art and Future Perspectivescited by 112
- 2019Multimodal End-to-End Autonomous Drivingcited by 110
- 2020Survey of Deep Reinforcement Learning for Motion Planning of Autonomous Vehiclescited by 101
- 2021Explainability of deep vision-based autonomous driving systems: Review and challengescited by 80
- 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directionscited by 73
- 2023WOMD-LiDAR: Raw Sensor Dataset Benchmark for Motion Forecastingcited by 28
- 2018End-to-end Multi-Modal Multi-Task Vehicle Control for Self-Driving Cars with Visual Perceptioncited by 27
- 2021Maneuver-based Trajectory Prediction for Self-driving Cars Using Spatio-temporal Convolutional Networkscited by 14
- 2018Learning End-to-end Autonomous Driving using Guided Auxiliary Supervisioncited by 10
- 2020A Learning-based Discretionary Lane-Change Decision-Making Model with Driving Style Awarenesscited by 9
- 2023Learning to Drive Anywherecited by 9
- 2023Multimodal Manoeuvre and Trajectory Prediction for Automated Driving on Highways Using Transformer Networkscited by 7
- 2023Deep Q-Network Based Decision Making for Autonomous Drivingcited by 4
- 2018Learning On-Road Visual Control for Self-Driving Vehicles with Auxiliary Taskscited by 3
- 2022Lane Change Classification and Prediction with Action Recognition Networkscited by 3
- 2023A Novel Model for Driver Lane Change Prediction in Cooperative Adaptive Cruise Control Systemscited by 2
- 2019Vision-Based Lane-Changing Behavior Detection Using Deep Residual Neural Networkcited by 1
- 2021Hierarchical automatic lane-changing motion planning: from self-optimum to local-optimumcited by 1
- 2023Autonomous Slalom Maneuver Based on Expert Drivers' Behavior Using Convolutional Neural Networkcited by 1
- 2023Time-to-Collision-Aware Lane-Change Strategy Based on Potential Field and Cubic Polynomial for Autonomous Vehiclescited by 1
- 2023Target-point Attention Transformer: A novel trajectory predict network for end-to-end autonomous drivingcited by 1
Built on by
Citing papers per year: 2025: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2023Human-Like Autonomous Driving on Dense Traffic
- 2025Learning to Drive by Imitating Surrounding Vehicles
- 2023Detrive: Imitation Learning with Transformer Detection for End-to-End Autonomous Driving
- 2021Safe Imitation Learning on Real-Life Highway Data for Human-like Autonomous Driving
- 2024Hybrid Imitation-Learning Motion Planner for Urban Driving
- 2025Learning-based Autonomous Oversteer Control and Collision Avoidance
- 2026Risk-Aware Decision-Making for Autonomous Overtaking: A World Model-Based Mixture-of-Experts Framework
- 2019Efficient Motion Planning for Automated Lane Change based on Imitation Learning and Mixed-Integer Optimization