mlsanityData to 14 Oct 2026

Towards a performance analysis on pre-trained Visual Question Answering models for autonomous driving

arXiv 2307.09329 ↗First posted 18 Jul 2023cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

This short paper presents a preliminary analysis of three popular Visual Question Answering (VQA) models, namely ViLBERT, ViLT, and LXMERT, in the context of answering questions relating to driving scenarios. The performance of these models is evaluated by comparing the similarity of responses to reference answers provided by computer vision experts. Model selection is predicated on the analysis of transformer utilization in multimodal architectures. The results indicate that models incorporating cross-modal attention and late fusion techniques exhibit promising potential for generating improved answers within a driving perspective. This initial analysis serves as a launchpad for a forthcoming comprehensive comparative study involving nine VQA models and sets the scene for further investigations into the effectiveness of VQA model queries in self-driving scenarios. Supplementary material is available at https://github.com/KaavyaRekanar/Towards-a-performance-analysis-on-pre-trained-VQA-models-for-autonomous-driving.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 6 of its 10 references that are in the map. First posted on arXiv 18 Jul 2023.

Builds on

6 of 10 references.

References · 6

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,222
  3. 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,553
  4. 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,230
  5. 2021Attention Bottlenecks for Multimodal Fusioncited by 361
  6. 2022Video Question Answering: Datasets, Algorithms and Challengescited by 84

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 1.

3 papers.

  1. 2025ReasonDrive: Efficient Visual Question Answering for Autonomous Vehicles with Reasoning-Enhanced Small Vision-Language Modelscited by 8
  2. 2024Optimizing Visual Question Answering Models for Driving: Bridging the Gap Between Human and Machine Attention Patternscited by 4
  3. 2026DriveXQA: Cross-modal Visual Question Answering for Adverse Driving Scene Understandingcited by 0