mlsanityData to 14 Oct 2026

Sometimes You Gotta Run Before You Can Walk: Run-then-Walk Scheduling Strategy for VLM Autonomous Driving

arXiv 2609.25831 ↗First posted 22 Sep 2026cs.RO cs.CVcited by 1

On the map: End-to-end autonomous driving → Reinforcement learning for driving also fits: Imitation-learning end-to-end planners

Abstract (arXiv)

Recent VLM-based autonomous driving planners adopt GRPO-style reinforcement learning to optimize driving performance. However, existing GRPO recipes either optimize driving efficiency, risking progress-seeking but unsafe behavior, or enforce early safety constraints, leading to overly conservative behavior; both require lengthy training. To solve these problems, we first reveal two distinct RL regimes: a progress regime (Run-GRPO) that aggressively explores high progress, and a safety regime (Walk-GRPO) that restores safety under stable progress. Based on this finding, we propose textitRun-then-Walk, a simple yet effective two-stage reward scheduling strategy for GRPO, achieving both better performance and faster convergence. Unlike one-stage RL, which may focus on progress, safety, or a mixture of both within a single training phase, this schedule explicitly separates progress discovery from safety repair. In the textitRun phase, we focus on progress, allowing the policy to escape the conservative bias and discover high-progress modes. In the subsequent textitWalk phase, we introduce endpoint and safety strategy to repair unsafe behaviors from the Run phase. This reversed schedule overcomes the conservatism of Walk-first methods and the unsafe progress-seeking of joint optimization. We validate it with various VLM-based planners on multiple benchmarks: NAVSIMv1, NAVSIMv2, Navhard, and nuScenes. Extensive experiments demonstrate improved driving performance while requiring 40--50% fewer RL training epochs than the baselines. Code is available at https://github.com/haha-yuki-haha/AutoDrive-P3withRun-then-walk.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reinforcement learning for driving, one of 9 directions in End-to-end autonomous driving. Builds on 33 of its 39 references that are in the map. First posted on arXiv 22 Sep 2026.

Builds on

33 of 39 references.

References · 33

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  3. 2022Planning-oriented Autonomous Drivingcited by 1,087
  4. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
  5. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
  6. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
  7. 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 485
  8. 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Drivingcited by 377
  9. 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 368
  10. 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 354
  11. 2023GPT-Driver: Learning to Drive with GPTcited by 347
  12. 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 334
21 more
  1. 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 260
  2. 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 249
  3. 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?cited by 242
  4. 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 231
  5. 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 198
  6. 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 176
  7. 2024Enhancing End-to-End Autonomous Driving with Latent World Modelcited by 166
  8. 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Modelcited by 151
  9. 2025Pseudo-Simulation for Autonomous Drivingcited by 150
  10. 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Drivingcited by 134
  11. 2025GoalFlow: Goal-Driven Flow Matching for Multimodal Trajectories Generation in End-to-End Autonomous Drivingcited by 120
  12. 2025AlphaDrive: Unleashing the Power of VLMs in Autonomous Driving via Reinforcement Learning and Reasoningcited by 108
  13. 2025DeepSeekMath-V2: Towards Self-Verifiable Mathematical Reasoningcited by 94
  14. 2024OpenEMMA: Open-Source Multimodal Model for End-to-End Autonomous Drivingcited by 93
  15. 2024VLM-AD: End-to-End Autonomous Driving through Vision-Language Model Supervisioncited by 86
  16. 2024Making Large Language Models Better Planners with Reasoning-Decision Alignmentcited by 52
  17. 2026DriveWorld-VLA: Unified Latent-Space World Modeling with Vision-Language-Action for Autonomous Drivingcited by 37
  18. 2026Latent-WAM: Latent World Action Modeling for End-to-End Autonomous Drivingcited by 33
  19. 2026DriveFuture: Future-Aware Latent World Models for Autonomous Drivingcited by 17
  20. 2025InsightDrive: Insight Scene Representation for End-to-End Autonomous Drivingcited by 14
  21. 2026AutoDrive-P3: Unified Chain of Perception-Prediction-Planning Thought via Reinforcement Fine-Tuningcited by 14

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2022Driver Dojo: A Benchmark for Generalizable Reinforcement Learning for Autonomous Driving
  2. 2025A Survey of Reinforcement Learning-Based Motion Planning for Autonomous Driving: Lessons Learned from a Driving Task Perspective
  3. 2025Plan-R1: Safe and Feasible Trajectory Planning as Language Modeling
  4. 2025CaRL: Learning Scalable Planning Policies with Simple Rewards
  5. 2025Balancing Progress and Safety: A Novel Risk-Aware Objective for RL in Autonomous Driving
  6. 2024Optimizing Low-Speed Autonomous Driving: A Reinforcement Learning Approach to Route Stability and Maximum Speed
  7. 2025A Comprehensive Review of Reinforcement Learning for Autonomous Driving in the CARLA Simulator
  8. 2026PlanRL: A Trajectory Planning Architecture for Reinforcement Learning-based Driving Experts