DRL-Based Trajectory Tracking for Motion-Related Modules in Autonomous Driving
On the map: End-to-end autonomous driving → Reinforcement learning for driving
Abstract (arXiv)
Autonomous driving systems are always built on motion-related modules such as the planner and the controller. An accurate and robust trajectory tracking method is indispensable for these motion-related modules as a primitive routine. Current methods often make strong assumptions about the model such as the context and the dynamics, which are not robust enough to deal with the changing scenarios in a real-world system. In this paper, we propose a Deep Reinforcement Learning (DRL)-based trajectory tracking method for the motion-related modules in autonomous driving systems. The representation learning ability of DL and the exploration nature of RL bring strong robustness and improve accuracy. Meanwhile, it enhances versatility by running the trajectory tracking in a model-free and data-driven manner. Through extensive experiments, we demonstrate both the efficiency and effectiveness of our method compared to current methods. Code and documentation are released to facilitate both further research and industrial deployment.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Reinforcement learning for driving, one of 9 directions in End-to-end autonomous driving. Builds on 15 of its 31 references that are in the map. First posted on arXiv 30 Aug 2023.
Builds on
15 of 31 references.
References · 15
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
- 2021Convex optimizationcited by 2,515
- 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,417
- 2016OpenAI Gymcited by 1,736
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
- 2017Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithmcited by 734
- 2018ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worstcited by 397
- 2017Hamilton-Jacobi Reachability: A Brief Overview and Recent Advancescited by 201
- 2017Optimization-Based Autonomous Racing of 1:43 Scale RC Carscited by 50
Built on by
Citing papers per year: 2024: 6.
6 papers.
- 2024Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Drivingcited by 252
- 2024Editable Scene Simulation for Autonomous Driving via Collaborative LLM-Agentscited by 91
- 2024RAT: Adversarial Attacks on Deep Reinforcement Agents for Targeted Behaviorscited by 16
- 2024Efficient Preference-based Reinforcement Learning via Aligned Experience Estimationcited by 9
- 2024ComTraQ-MPC: Meta-Trained DQN-MPC Integration for Trajectory Tracking with Limited Active Localization Updatescited by 4
- 2024ChatDyn: Language-Driven Multi-Actor Dynamics Generation in Street Scenescited by 3
- 2024RAT: Adversarial Attacks on Deep Reinforcement Agents for Targeted Behaviors14 Dec 2024
- 2024ChatDyn: Language-Driven Multi-Actor Dynamics Generation in Street Scenes11 Dec 2024
- 2024Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Driving6 Jun 2024
- 2024Efficient Preference-based Reinforcement Learning via Aligned Experience Estimation29 May 2024
- 2024ComTraQ-MPC: Meta-Trained DQN-MPC Integration for Trajectory Tracking with Limited Active Localization Updates3 Mar 2024
- 2024Editable Scene Simulation for Autonomous Driving via Collaborative LLM-Agents8 Feb 2024
Similar, not cited
Close in wording, no citation either way
- 2024Deep Reinforcement Learning in Autonomous Car Path Planning and Control: A Survey
- 2023Review of Deep Reinforcement Learning for Autonomous Driving
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learning
- 2021A Survey of Deep Reinforcement Learning Algorithms for Motion Planning and Control of Autonomous Vehicles
- 2020Deep Reinforcement Learning for Autonomous Driving: A Survey
- 2025Evaluating Scenario-based Decision-making for Interactive Autonomous Driving Using Rational Criteria: A Survey
- 2023Vision-based DRL Autonomous Driving Agent with Sim2Real Transfer
- 2023A Platform-Agnostic Deep Reinforcement Learning Framework for Effective Sim2Real Transfer towards Autonomous Driving