WorkDrive: Roadwork Chain of Causation for Autonomous Driving
On the map: Multimodal LLMs / vision-language models → Driving VLMs and open-vocabulary detection
also in 1 more
Abstract (arXiv)
Autonomous driving vision-language models (VLMs) struggle in roadwork zones, where familiar visual cues such as lane markings and permanent signs are altered or absent, and temporary devices such as cones and barriers redefine the drivable corridor. VLMs can detect these objects, but without explicit guidance they anchor their reasoning on familiar elements from pre-training and fail to connect work-zone observations to correct planning decisions. We propose WorkDrive, a framework that constructs perception-grounded causal reasoning for work zones and aligns it with trajectory prediction. An automated multitask perception pipeline extracts structured scene facts and injects them into a Chain-of-Causation (CoC) annotation pipeline, redirecting the annotator's attention to domain-specific elements. The resulting reasoning labels are used for supervised fine-tuning, followed by reinforcement learning with a single reward: consistency between lateral meta-actions and the predicted trajectory. On ROADWork, the largest public work-zone dataset, the proposed roadwork CoC reduces trajectory average displacement error (ADE) by 9.0%, and consistency-based GRPO yields a further 3.0%, achieving progressive improvement over the trajectory-only baseline. Code and data will be publicly released.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Driving VLMs and open-vocabulary detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 21 of its 43 references that are in the map. First posted on arXiv 16 Jul 2026.
Builds on
21 of 43 references.
Closest ancestors · 6
Same direction, newest first
- 2025OmniDrive-R1: Reinforcement-driven Interleaved Multi-modal Chain-of-Thought for Trustworthy Vision-Language Autonomous Driving16 Dec
- 2025Work Zones challenge VLM Trajectory Planning: Toward Mitigation and Robust Autonomous Driving3 Oct
- 2025DriveAgent-R1: Advancing VLM-based Autonomous Driving with Active Perception and Hybrid Thinking28 Jul
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Driving9 Jun
- 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Driving29 Oct
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Models19 Feb
Other references · 15
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 252
- 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 226
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tailcited by 136
- 2025AlphaDrive: Unleashing the Power of VLMs in Autonomous Driving via Reinforcement Learning and Reasoningcited by 108
- 2024DriveCoT: Integrating Chain-of-Thought Reasoning with End-to-End Drivingcited by 67
- 2025Detect Anything via Next Point Predictioncited by 66
- 2025DiffVLA: Vision-Language Guided Diffusion Planning for Autonomous Drivingcited by 64
- 2025AdaThinkDrive: Adaptive Thinking via Reinforcement Learning for Autonomous Drivingcited by 57
3 more
- 2025OpenREAD: Reinforced Open-Ended Reasoning for End-to-End Autonomous Driving with LLM-as-Criticcited by 11
- 2025ColaVLA: Leveraging Cognitive Latent Reasoning for Hierarchical Parallel Trajectory Planning in Autonomous Drivingcited by 10
- 2025CoT4AD: A Vision-Language-Action Model with Explicit Chain-of-Thought Reasoning for Autonomous Drivingcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024ROADWork: A Dataset and Benchmark for Learning to Recognize, Observe, Analyze and Drive Through Work Zones
- 2025InsightDrive: Insight Scene Representation for End-to-End Autonomous Driving
- 2026CASCADE: A Spatio-Temporal-Causal Reasoning Representation and Dataset for Driving
- 2026WZPlanner: Safe End-to-End Path Planning for Autonomous Driving in Work Zones
- 2026Explicit Geometric Chain-of-Thought for Vision-Language-Action in Autonomous Driving
- 2026SGDrive: Scene-to-Goal Hierarchical World Cognition for Autonomous Driving
- 2026DriveCombo: Benchmarking Compositional Traffic Rule Reasoning in Autonomous Driving
- 2026GeoDrive-Bench: Benchmarking Region-Specific Multimodal Reasoning in Autonomous Driving