CORAL: Curriculum-Optimized Reward Adaptation for LiDAR-Based Goal-Directed Urban Driving
On the map: End-to-end autonomous driving → Reinforcement learning for driving
Abstract (arXiv)
Reinforcement learning is promising for autonomous urban driving, but long-horizon goal-directed navigation asks a policy to acquire several competing behaviors at once--reaching a distant goal, tracking a route, avoiding obstacles, obeying signals--and a fixed objective gives no order in which to learn them. This paper presents CORAL, which advances two schedules together: a five-stage curriculum that progressively lengthens routes and tightens behavioral constraints, and a stage-aware reward whose component weights shift emphasis from mission progress toward route following, safety, smoothness, and rule compliance as the task hardens. The policy is a multi-stream actor-critic network trained with Proximal Policy Optimization (PPO) in CARLA on a compact 99-dimensional state pairing a polar LiDAR histogram with vehicle telemetry, ego-frame route geometry, and traffic-rule indicators--no point-cloud encoder, no bird's-eye-view rasterization. Against two PPO baselines under an identical protocol, CORAL reaches the goal in all twenty evaluation episodes on the longest routes under the full set of behavioral constraints, where the baselines reach 5% and 10%; a factorial ablation shows that neither schedule alone matches their combination: removing either lowers both success and route completion, and disabling both drops success to 55%. Trained in one town, the policy transfers zero-shot to seven unseen towns, succeeding in 68-98% of episodes on routes of the same 100-150 m length, with mean lateral deviation below 0.35 m.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reinforcement learning for driving, one of 9 directions in End-to-end autonomous driving. Builds on 21 of its 31 references that are in the map. First posted on arXiv 14 Aug 2026.
Builds on
21 of 31 references.
Closest ancestors · 4
Same direction, newest first
- 2025A Comprehensive Review of Reinforcement Learning for Autonomous Driving in the CARLA Simulator10 Sep
- 2025CuRLA: Curriculum Learning Based Deep Reinforcement Learning for Autonomous Driving9 Jan
- 2023Risk-Aware Reward Shaping of Reinforcement Learning Agents for Autonomous Driving5 Jun
- 2021Carl-Lead: Lidar-based End-to-End Autonomous Driving with Contrastive Deep Reinforcement Learning17 Sep
Other references · 17
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2015Continuous control with deep reinforcement learningcited by 3,407
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,258
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2018Soft Actor-Critic Algorithms and Applicationscited by 1,240
- 2016End to End Learning for Self-Driving Carscited by 1,009
- 2019Deep Learning for 3D Point Clouds: A Surveycited by 558
- 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 490
- 2017End-to-end Driving via Conditional Imitation Learningcited by 485
- 2019A Survey of Deep Learning Techniques for Autonomous Drivingcited by 403
5 more
- 2020Curriculum Learning for Reinforcement Learning Domains: A Framework and Surveycited by 373
- 2022Imitation Is Not Enough: Robustifying Imitation with Reinforcement Learning for Challenging Driving Scenarioscited by 129
- 2021Perception and Sensing for Autonomous Vehicles Under Adverse Weather Conditions: A Surveycited by 82
- 2020MVLidarNet: Real-Time Multi-Class Scene Understanding for Autonomous Driving Using Multiple Viewscited by 20
- 2022Emergent Visual Sensors for Autonomous Vehiclescited by 19
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2021Goal-constrained Sparse Reinforcement Learning for End-to-End Driving
- 2025InDRiVE: Reward-Free World-Model Pretraining for Autonomous Driving via Latent Disagreement
- 2023Action and Trajectory Planning for Urban Autonomous Driving with Hierarchical Reinforcement Learning
- 2026DriveAnchor: Progressive Anchor-based Flow Learning for Autonomous Driving Planning
- 2026Scaling Curriculum Learning For Autonomous Driving
- 2021Spatially and Seamlessly Hierarchical Reinforcement Learning for State Space and Policy space in Autonomous Driving
- 2025DriveMind: A Dual Visual Language Model-based Reinforcement Learning Framework for Autonomous Driving
- 2026RIWANav: Recursive World-Action Models with Self-Improvement for Urban Navigation