mlsanityData to 7 Oct 2026

Towards Systematic Qualification of Vision-Language Models for Automotive Perception Systems

arXiv 2609.25945 ↗First posted 22 Sep 2026cs.CV cs.SEcited by 0

On the map: Multimodal LLMs / vision-language models → Driving VLMs and open-vocabulary detection

Abstract (arXiv)

The field of Artificial Intelligence has been adopted for many application domains. Vision Language Models are one of the recently advanced AI techniques that have been explored to support automotive features such as vehicle perception, and safety assurance. However, such language models are prone to hallucinations, posing a potential threat to the safety of automotive systems that may incorporate them. Within the automotive domain, VLMs could not only hallucinate traffic objects, but could also fail to identify traffic objects that are actually present, which may potentially lead to dangerous situations. Though we have observed a growing body of literature that proposes verification and validation techniques for safe and trustworthy AI, these methods are often studied in isolation, focusing either on run-time or design-time phases. Such isolated techniques could be insufficient in safety-critical, realistic contexts such as automotive perception systems. In this paper, we analyze design-time and run-time verification and validation techniques based on a taxonomy presented by Huang et al. We present an automotive study in which a design-time qualification workflow is proposed to complement run-time monitoring. This workflow combines a fixed safety-relevant ontology-based structured annotation system together with a synonym-based evaluation process to statistically evaluate three state-of-the-art VLMs against data from the nuScenes dataset. We observed that the proposed technique enables deterministic and repeatable quantification of the hallucinations VLMs generate in automotive perception-related tasks. The proposed workflow supports model comparison and deployment-oriented engineering decisions within the design-time verification and validation process and will contribute to a holistic verification strategy that strives towards trustworthy automotive perception systems

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Driving VLMs and open-vocabulary detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 24 of its 41 references that are in the map. First posted on arXiv 22 Sep 2026.

Builds on

24 of 41 references.

References · 24

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2023Visual Instruction Tuningcited by 7,792
  3. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  4. 2024GPT-4o System Cardcited by 4,467
  5. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  6. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
  7. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
  8. 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 485
  9. 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 472
  10. 2023GPTScore: Evaluate as You Desirecited by 357
  11. 2018On the Effectiveness of Interval Bound Propagation for Training Verifiably Robust Modelscited by 322
  12. 2023How is ChatGPT's behavior changing over time?cited by 265
12 more
  1. 2023On the Robustness of ChatGPT: An Adversarial and Out-of-distribution Perspectivecited by 208
  2. 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validationcited by 91
  3. 2017Feature-Guided Black-Box Safety Testing of Deep Neural Networkscited by 48
  4. 2018Testing Deep Neural Networkscited by 36
  5. 2024CrossCheckGPT: Universal Hallucination Ranking for Multimodal Foundation Modelscited by 18
  6. 2025FactSelfCheck: Fact-Level Black-Box Hallucination Detection for LLMscited by 14
  7. 2023Safety Analysis in the Era of Large Language Models: A Case Study of STPA using ChatGPTcited by 13
  8. 2024Hybrid Reasoning Based on Large Language Models for Autonomous Car Drivingcited by 11
  9. 2021Systematic Literature Review of Validation Methods for AI Systemscited by 10
  10. 2023CarExpert: Leveraging Large Language Models for In-Car Conversational Question Answeringcited by 10
  11. 2024Evaluating and Enhancing Trustworthiness of LLMs in Perception Taskscited by 4
  12. 2024LLMs Can Check Their Own Results to Mitigate Hallucinations in Traffic Understanding Taskscited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Evaluation of Safety Cognition Capability in Vision-Language Models for Autonomous Driving
  2. 2026Towards Reliable Vision-Language Models for Autonomous Driving
  3. 2025Are VLMs Ready for Autonomous Driving? An Empirical Study from the Reliability, Data, and Metric Perspectives
  4. 2025BetterCheck: Towards Safeguarding VLMs for Automotive Perception Systems
  5. 2026Vision and Language: Novel Representations and Artificial intelligence for Driving Scene Safety Assessment and Autonomous Vehicle Planning
  6. 2025A Survey on Vision-Language-Action Models for Autonomous Driving
  7. 2025CARScenes: Semantic VLM Dataset for Safe Autonomous Driving
  8. 2025Fighting AI with AI: Leveraging Foundation Models for Assuring AI-Enabled Safety-Critical Systems