mlsanityData to 14 Oct 2026

ReasonDrive: Efficient Visual Question Answering for Autonomous Vehicles with Reasoning-Enhanced Small Vision-Language Models

arXiv 2504.10757 ↗First posted 14 Apr 2025cs.CV cs.LG cs.ROcited by 8

On the map: LLM reasoning → Chain-of-thought reasoning for driving

also in 2 more
Abstract (arXiv)

Vision-language models (VLMs) show promise for autonomous driving but often lack transparent reasoning capabilities that are critical for safety. We investigate whether explicitly modeling reasoning during fine-tuning enhances VLM performance on driving decision tasks. Using GPT-4o, we generate structured reasoning chains for driving scenarios from the DriveLM benchmark with category-specific prompting strategies. We compare reasoning-based fine-tuning, answer-only fine-tuning, and baseline instruction-tuned models across multiple small VLM families (Llama 3.2, Llava 1.5, and Qwen 2.5VL). Our results demonstrate that reasoning-based fine-tuning consistently outperforms alternatives, with Llama3.2-11B-reason achieving the highest performance. Models fine-tuned with reasoning show substantial improvements in accuracy and text generation quality, suggesting explicit reasoning enhances internal representations for driving decisions. These findings highlight the importance of transparent decision processes in safety-critical domains and offer a promising direction for developing more interpretable autonomous driving systems.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 27 of its 29 references that are in the map. First posted on arXiv 14 Apr 2025.

Builds on

27 of 29 references.

References · 27

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2023Visual Instruction Tuningcited by 7,869
  4. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  5. 2024GPT-4o System Cardcited by 4,588
  6. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  7. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  8. 2023DriveLM: Driving with Graph Visual Question Answeringcited by 536
  9. 2023A Survey on Multimodal Large Language Models for Autonomous Drivingcited by 290
  10. 2023NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenariocited by 262
  11. 2023LingoQA: Visual Question Answering for Autonomous Drivingcited by 145
  12. 2023Talk2BEV: Language-enhanced Bird's-eye View Maps for Autonomous Drivingcited by 89
15 more
  1. 2025HERMES: A Unified Self-Driving World Model for Simultaneous 3D Scene Understanding and Generationcited by 56
  2. 2024Multi-Frame, Lightweight & Efficient Vision-Language Models for Question Answering in Autonomous Drivingcited by 52
  3. 2024VLM-Auto: VLM-based Autonomous Driving Assistant with Human-like Behavior and Understanding for Complex Road Scenescited by 23
  4. 2023Explaining Autonomous Driving Actions with Visual Question Answeringcited by 16
  5. 2024SimpleLLM4AD: An End-to-End Vision-Language Model with Graph Visual Question Answering for Autonomous Drivingcited by 16
  6. 2024MiniDrive: More Efficient Vision-Language Models with Multi-Level 2D Features as Text Tokens for Autonomous Drivingcited by 13
  7. 2025CurricuVLM: Towards Safe Autonomous Driving via Personalized Safety-Critical Curriculum Learning with Vision-Language Modelscited by 12
  8. 2024Video Token Sparsification for Efficient Multimodal LLMs in Autonomous Drivingcited by 11
  9. 2025VLM-Assisted Continual learning for Visual Question Answering in Self-Drivingcited by 6
  10. 2024Query3D: LLM-Powered Open-Vocabulary Scene Segmentation with Language Embedded 3D Gaussiancited by 5
  11. 2024Edge-Cloud Collaborative Motion Planning for Autonomous Driving with Large Language Modelscited by 5
  12. 2024XLM for Autonomous Driving Systems: A Comprehensive Reviewcited by 5
  13. 2024Optimizing Visual Question Answering Models for Driving: Bridging the Gap Between Human and Machine Attention Patternscited by 4
  14. 2023Towards a performance analysis on pre-trained Visual Question Answering models for autonomous drivingcited by 3
  15. 2024Integrating Object Detection Modality into Visual Language Model for Enhanced Autonomous Driving Agentcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 7.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Reason2Drive: Towards Interpretable and Chain-based Reasoning for Autonomous Driving
  2. 2025Fine-Grained Evaluation of Large Vision-Language Models in Autonomous Driving
  3. 2025Are VLMs Ready for Autonomous Driving? An Empirical Study from the Reliability, Data, and Metric Perspectives
  4. 2025VLMs Guided Interpretable Decision Making for Autonomous Driving
  5. 2025DriveRX: A Vision-Language Reasoning Model for Cross-Task Autonomous Driving
  6. 2025DriveLMM-o1: A Step-by-Step Reasoning Dataset and Large Multimodal Model for Driving Scenario Understanding
  7. 2025Reasoning-VLA: A Fast and General Vision-Language-Action Reasoning Model for Autonomous Driving
  8. 2026Outcome-Guided Distillation: A Teacher-Student Framework to Advance VLM Reasoning in Autonomous Driving