Do LLMs Understand Romanian Driving Laws? A Study on Multimodal and Fine-Tuned Question Answering
Not on the map. Why?
Abstract (arXiv)
Ensuring that both new and experienced drivers master current traffic rules is critical to road safety. This paper evaluates Large Language Models (LLMs) on Romanian driving-law QA with explanation generation. We release a 1{,}208-question dataset (387 multimodal) and compare text-only and multimodal SOTA systems, then measure the impact of domain-specific fine-tuning for Llama 3.1-8B-Instruct and RoLlama 3.1-8B-Instruct. SOTA models perform well, but fine-tuned 8B models are competitive. Textual descriptions of images outperform direct visual input. Finally, an LLM-as-a-Judge assesses explanation quality, revealing self-preference bias. The study informs explainable QA for less-resourced languages.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 2 of its 13 references that are in the map. First posted on arXiv 28 Sep 2025.
Builds on
2 of 13 references.
References · 2
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2021Datasets: A Community Library for Natural Language Processingcited by 530
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025RoD-TAL: A Benchmark for Answering Questions in Romanian Driving License Exams
- 2023Driving with LLMs: Fusing Object-Level Vector Modality for Explainable Autonomous Driving
- 2025WaymoQA: A Multi-View Visual Question Answering Dataset for Safety-Critical Reasoning in Autonomous Driving
- 2025DriveQA: Passing the Driving Knowledge Test
- 2025SafePLUG: Empowering Multimodal LLMs with Pixel-Level Insight and Temporal Grounding for Traffic Accident Understanding
- 2025Evaluating Small Vision-Language Models on Distance-Dependent Traffic Perception
- 2026Beyond Scene Priors: Fine-Grained Traffic Scene Reasoning with Benchmarking and Query-Guided Small-Object Focus
- 2025SafeDriveRAG: Towards Safe Autonomous Driving with Knowledge Graph-based Retrieval-Augmented Generation