An Uncertainty-Weighted Decision Transformer for Navigation in Dense, Complex Driving Scenarios
Not on the map. Why?
Abstract (arXiv)
Autonomous driving in dense, dynamic environments requires decision-making systems that can exploit both spatial structure and long-horizon temporal dependencies while remaining robust to uncertainty. This work presents a novel framework that integrates multi-channel bird's-eye-view occupancy grids with transformer-based sequence modeling for tactical driving in complex roundabout scenarios. To address the imbalance between frequent low-risk states and rare safety-critical decisions, we propose the Uncertainty-Weighted Decision Transformer (UWDT). UWDT employs a frozen teacher transformer to estimate per-token predictive entropy, which is then used as a weight in the student model's loss function. This mechanism amplifies learning from uncertain, high-impact states while maintaining stability across common low-risk transitions. Experiments in a roundabout simulator, across varying traffic densities, show that UWDT consistently outperforms other baselines in terms of reward, collision rate, and behavioral stability. The results demonstrate that uncertainty-aware, spatial-temporal transformers can deliver safer and more efficient decision-making for autonomous driving in complex traffic environments.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 32 references that are in the map. First posted on arXiv 16 Sep 2025.
Builds on
18 of 32 references.
References · 18
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2020Conservative Q-Learning for Offline Reinforcement Learningcited by 1,809
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,546
- 2020Deep Reinforcement Learning for Autonomous Driving: A Surveycited by 721
- 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 644
- 2019A Survey of Autonomous Driving: Common Practices and Emerging Technologiescited by 379
- 2021Uncertainty Weighted Actor-Critic for Offline Reinforcement Learningcited by 126
- 2021Unified Focal loss: Generalising Dice and cross entropy-based losses to handle class imbalanced medical image segmentationcited by 88
- 2019Social Attention for Autonomous Decision-Making in Dense Trafficcited by 39
- 2017Dynamic Occupancy Grid Prediction for Urban Autonomous Driving: A Deep Learning Approach with Fully Automatic Labelingcited by 30
- 2014Bandit Algorithms for Tree Searchcited by 25
6 more
- 2024Decision Mamba: Reinforcement Learning via Hybrid Selective Sequence Modelingcited by 18
- 2023Skill Transformer: A Monolithic Policy for Mobile Manipulationcited by 16
- 2023Uncertainty-Aware Decision Transformer for Stochastic Driving Environmentscited by 8
- 2023Reachability-Based Confidence-Aware Probabilistic Collision Detection in Highway Drivingcited by 5
- 2025Extensive Exploration in Complex Traffic Scenarios using Hierarchical Reinforcement Learningcited by 3
- 2025Reinforcement Learning with Data Bootstrapping for Dynamic Subgoal Pursuit in Humanoid Robot Navigationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026A Risk-Sensitive and Uncertainty-Aware Decision-Making and Control Framework for Safe and Robust Autonomous Driving
- 2023Transformer-Based Autonomous Driving Models and Deployment-Oriented Compression: A Survey
- 2025Uncertainty-Aware Safety-Critical Decision and Control for Autonomous Vehicles at Unsignalized Intersections
- 2026UniUncer: Unified Dynamic Static Uncertainty for End to End Driving
- 2026ROSA-RL: Uncertainty-Aware Roundabout Optimized Speed Advisory with Reinforcement Learning
- 2023MTD-GPT: A Multi-Task Decision-Making GPT Model for Autonomous Driving at Unsignalized Intersections
- 2025Using Ensemble Diffusion to Estimate Uncertainty for End-to-End Autonomous Driving
- 2024CALMM-Drive: Confidence-Aware Autonomous Driving with Large Multimodal Model