mlsanityData to 14 Oct 2026

A Reliable Context-Aware and Temporal Planning Framework for Autonomous Driving

arXiv 2607.04689 ↗First posted 6 Jul 2026cs.RO cs.CVcited by 0

On the map: End-to-end autonomous driving → End-to-end system architecture

Abstract (arXiv)

Safe operation of autonomous vehicles in dense urban traffic depends on perception and planning that remain reliable when onboard sensing is degraded. In real driving conditions, camera observations are frequently corrupted by occlusion, motion blur, illumination change, and sensor noise, and when such degraded observations are aggregated indiscriminately over time, trajectory planning becomes unstable and collision risk rises for both the ego vehicle and surrounding road users. Recent Bird's-Eye-View (BEV) approaches unify perception and planning through a shared spatial representation, but most fuse temporal information across frames without assessing the reliability of the underlying observations. We present a Reliable Context-Aware and Temporal Planning framework for Autonomous Driving (RCT-AD) that explicitly models feature quality and temporal consistency to support safer, more consistent planning. A Reliable Context Awareness module scores per-frame reliability and selectively retains trustworthy features through a quality-gated First-In-Last-Out (FILO) memory mechanism, reconstructing degraded observations from reliable historical context so that corrupted inputs do not destabilize the scene representation. A Temporal Trajectory Planner captures long-term dependencies and multi-agent interactions to produce smoother, safety-aware trajectories, while a joint detection-and-segmentation head injects semantic and motion cues into the shared BEV space to strengthen scene understanding. Experiments on the nuScenes autonomous driving benchmark show that RCT-AD improves perception accuracy, motion prediction, and planning robustness over recent end-to-end baselines, achieving 61.5 nuScenes Detection Score, 52.9 mean Average Precision, and 52.3 mean Intersection over Union, while maintaining competitive computational efficiency suitable for real-time deployment.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in End-to-end system architecture, one of 9 directions in End-to-end autonomous driving. Builds on 27 of its 35 references that are in the map. First posted on arXiv 6 Jul 2026.

Builds on

27 of 35 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representation30 May
  2. 2023End-to-end Autonomous Driving: Challenges and Frontiers29 Jun

Other references · 25

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  3. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
  4. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
  5. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
  6. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
  7. 2022Planning-oriented Autonomous Drivingcited by 1,087
  8. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
  9. 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
  10. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
  11. 2019ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networkscited by 575
  12. 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 572
13 more
  1. 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 552
  2. 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 334
  3. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 319
  4. 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 315
  5. 2024GenAD: Generative End-to-End Autonomous Drivingcited by 225
  6. 2019Cross-view Semantic Segmentation for Sensing Surroundingscited by 174
  7. 2022Simple-BEV: What Really Matters for Multi-Sensor BEV Perception?cited by 128
  8. 2022ViP3D: End-to-end Visual Trajectory Prediction via 3D Agent Queriescited by 117
  9. 2024NeuroNCAP: Photorealistic Closed-loop Safety Testing for Autonomous Drivingcited by 62
  10. 2025Bridging Past and Future: End-to-End Autonomous Driving with Historical Prediction and Planningcited by 48
  11. 2019Learning an Uncertainty-Aware Object Detector for Autonomous Drivingcited by 34
  12. 2022Prediction-aware and Reinforcement Learning based Altruistic Cooperative Drivingcited by 6
  13. 2025RESAR-BEV: An Explainable Progressive Residual Autoregressive Approach for Camera-Radar Fusion in BEV Segmentationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Echo Planning for Autonomous Driving: From Current Observations to Future Trajectories and Back
  2. 2025Future-Aware End-to-End Driving: Bidirectional Modeling of Trajectory Planning and Scene Evolution
  3. 2026READ: Learning Risk-Informed Fields for End-to-End Autonomous Driving
  4. 2025SUPER-AD: Semantic Uncertainty-aware Planning for End-to-End Robust Autonomous Driving
  5. 2026HERMES: A Holistic End-to-End Risk-Aware Multimodal Embodied System with Vision-Language Models for Long-Tail Autonomous Driving
  6. 2025Progressive Bird's Eye View Perception for Safety-Critical Autonomous Driving: A Comprehensive Survey
  7. 2026PriorEye: Geospatial Visual Priors for End-to-End Autonomous Driving
  8. 2025SAFe-Copilot: Unified Shared Autonomy Framework ↗