mlsanityData to 7 Oct 2026

Enhanced Safety in Autonomous Driving: Integrating Latent State Diffusion Model for End-to-End Navigation

arXiv 2407.06317 ↗First posted 8 Jul 2024cs.AI cs.CV cs.ROcited by 1

On the map: End-to-end autonomous driving → Reinforcement learning for driving

Abstract (arXiv)

With the advancement of autonomous driving, ensuring safety during motion planning and navigation is becoming more and more important. However, most end-to-end planning methods suffer from a lack of safety. This research addresses the safety issue in the control optimization problem of autonomous driving, formulated as Constrained Markov Decision Processes (CMDPs). We propose a novel, model-based approach for policy optimization, utilizing a conditional Value-at-Risk based Soft Actor Critic to manage constraints in complex, high-dimensional state spaces effectively. Our method introduces a worst-case actor to guide safe exploration, ensuring rigorous adherence to safety requirements even in unpredictable scenarios. The policy optimization employs the Augmented Lagrangian method and leverages latent diffusion models to predict and simulate future trajectories. This dual approach not only aids in navigating environments safely but also refines the policy's performance by integrating distribution modeling to account for environmental uncertainties. Empirical evaluations conducted in both simulated and real environment demonstrate that our approach outperforms existing methods in terms of safety, efficiency, and decision-making capabilities.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reinforcement learning for driving, one of 9 directions in End-to-end autonomous driving. Builds on 36 of its 51 references that are in the map. First posted on arXiv 8 Jul 2024.

Builds on

36 of 51 references.

Closest ancestors · 1

Same direction, newest first

  1. 2021Offline Reinforcement Learning for Autonomous Driving with Safety and Exploration Enhancement13 Oct

Other references · 35

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
  4. 2015Trust Region Policy Optimizationcited by 2,503
  5. 2020Conservative Q-Learning for Offline Reinforcement Learningcited by 1,777
  6. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  7. 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,023
  8. 2017Constrained Policy Optimizationcited by 928
  9. 2020Deep Reinforcement Learning for Autonomous Driving: A Surveycited by 698
  10. 2018Reinforcement Learning and Control as Probabilistic Inference: Tutorial and Reviewcited by 466
  11. 2019A Survey of Autonomous Driving: Common Practices and Emerging Technologiescited by 373
  12. 2016Safe, Multi-Agent, Reinforcement Learning for Autonomous Drivingcited by 301
23 more
  1. 2018Learning-based Model Predictive Control for Safe Explorationcited by 116
  2. 2019Multimodal End-to-End Autonomous Drivingcited by 110
  3. 2020Interpretable End-to-end Urban Autonomous Driving with Latent Deep Reinforcement Learningcited by 99
  4. 2015Gaussian Processes for Data-Efficient Learning in Robotics and Controlcited by 97
  5. 2020Context-aware Dynamics Model for Generalization in Model-Based Reinforcement Learningcited by 95
  6. 2021Conservative Offline Distributional Reinforcement Learningcited by 78
  7. 2019Safe Reinforcement Learning Using Robust MPCcited by 72
  8. 2020A Survey of Reinforcement Learning Algorithms for Dynamically Varying Environmentscited by 62
  9. 2019Distributional Reinforcement Learning for Efficient Explorationcited by 59
  10. 2023Reasoning with Latent Diffusion in Offline Reinforcement Learningcited by 33
  11. 2020Automated Lane Change Strategy using Proximal Policy Optimization-based Deep Reinforcement Learningcited by 30
  12. 2020Latent Space Models for Dynamic Networkscited by 29
  13. 2019Adaptive Safety with Control Barrier Functionscited by 25
  14. 2019Lane Change Decision-making through Deep Reinforcement Learning with Rule-based Constraintscited by 24
  15. 2020Learning Barrier Functions with Memory for Robust Safe Navigationcited by 19
  16. 2017A Review of Dynamic Network Models with Latent Variablescited by 18
  17. 2020Stochastic Model Predictive Control with a Safety Guarantee for Automated Driving: Extended Versioncited by 12
  18. 2017InfoGAIL: Interpretable Imitation Learning from Visual Demonstrationscited by 11
  19. 2022Control Barrier Functions and Input-to-State Safety with Application to Automated Vehiclescited by 11
  20. 2022Differentiable Control Barrier Functions for Vision-based End-to-End Autonomous Drivingcited by 10
  21. 2021Safe Exploration in Model-based Reinforcement Learning using Control Barrier Functionscited by 8
  22. 2024Predicting Long-Term Human Behaviors in Discrete Representations via Physics-Guided Diffusioncited by 6
  23. 2020Efficient Connected and Automated Driving System with Multi-agent Graph Reinforcement Learningcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024DDM-Lag : A Diffusion-based Decision-making Model for Autonomous Vehicles with Lagrangian Safety Enhancement
  2. 2026Bridging Predictive Uncertainty and Safe Action: Sample-Conditioned Differentiable Planning for Autonomous Driving
  3. 2026A Risk-Sensitive and Uncertainty-Aware Decision-Making and Control Framework for Safe and Robust Autonomous Driving
  4. 2026DualShield: Safe Model Predictive Diffusion via Reachability Analysis for Interactive Autonomous Driving
  5. 2025Risk-Aware Reinforcement Learning for Autonomous Driving: Improving Safety When Driving through Intersection
  6. 2025Safety Reinforced Model Predictive Control (SRMPC): Improving MPC with Reinforcement Learning for Motion Planning in Autonomous Driving
  7. 2024Long and Short-Term Constraints Driven Safe Reinforcement Learning for Autonomous Driving
  8. 2026DiDrive: A Risk-Aware Hierarchical Diffusion Framework for Safe Offline Reinforcement Learning in Autonomous Driving