mlsanityData to 14 Oct 2026

Performance Analysis of Traditional VQA Models Under Limited Computational Resources

arXiv 2502.05738 ↗First posted 9 Feb 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

In real-world applications where computational resources are limited, effectively integrating visual and textual information for Visual Question Answering (VQA) presents significant challenges. This paper investigates the performance of traditional models under computational constraints, focusing on enhancing VQA performance, particularly for numerical and counting questions. We evaluate models based on Bidirectional GRU (BidGRU), GRU, Bidirectional LSTM (BidLSTM), and Convolutional Neural Networks (CNN), analyzing the impact of different vocabulary sizes, fine-tuning strategies, and embedding dimensions. Experimental results show that the BidGRU model with an embedding dimension of 300 and a vocabulary size of 3000 achieves the best overall performance without the computational overhead of larger models. Ablation studies emphasize the importance of attention mechanisms and counting information in handling complex reasoning tasks under resource limitations. Our research provides valuable insights for developing more efficient VQA models suitable for deployment in environments with limited computational capacity.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 22 of its 23 references that are in the map. First posted on arXiv 9 Feb 2025.

Builds on

22 of 23 references.

References · 22

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  4. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  5. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  6. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,222
  7. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,031
  8. 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,593
  9. 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,423
  10. 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,167
  11. 2016Self-critical Sequence Training for Image Captioningcited by 547
  12. 2020MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devicescited by 482
10 more
  1. 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 408
  2. 2019Meshed-Memory Transformer for Image Captioningcited by 343
  3. 2016Bidirectional Attention Flow for Machine Comprehensioncited by 278
  4. 2020X-Linear Attention Networks for Image Captioningcited by 198
  5. 2015Ask, Attend and Answer: Exploring Question-Guided Spatial Attention for Visual Question Answeringcited by 66
  6. 2022Beyond a Pre-Trained Object Detector: Cross-Modal Textual and Visual Context for Image Captioningcited by 25
  7. 2017iVQA: Inverse Visual Question Answeringcited by 22
  8. 2017Structured Attentions for Visual Question Answeringcited by 6
  9. 2017Learning Convolutional Text Representations for Visual Question Answeringcited by 3
  10. 2022Transformer-Based Multi-modal Proposal and Re-Rank for Wikipedia Image-Caption Matchingcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.