HaVQA: A Dataset for Visual Question Answering and Multimodal Research in Hausa Language
Not on the map. Why?
Abstract (arXiv)
This paper presents HaVQA, the first multimodal dataset for visual question-answering (VQA) tasks in the Hausa language. The dataset was created by manually translating 6,022 English question-answer pairs, which are associated with 1,555 unique images from the Visual Genome dataset. As a result, the dataset provides 12,044 gold standard English-Hausa parallel sentences that were translated in a fashion that guarantees their semantic match with the corresponding visual information. We conducted several baseline experiments on the dataset, including visual question answering, visual question elicitation, text-only and multimodal machine translation.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 42 of its 69 references that are in the map. First posted on arXiv 28 May 2023.
Builds on
42 of 69 references.
References · 42
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
- 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,498
- 2015VQA: Visual Question Answeringcited by 2,489
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
30 more
- 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,445
- 2020Beyond English-Centric Multilingual Machine Translationcited by 559
- 2016Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translationcited by 467
- 2019Deep Modular Co-Attention Networks for Visual Question Answeringcited by 338
- 2017Don't Just Assume; Look and Answer: Overcoming Priors for Visual Question Answeringcited by 337
- 2015Visual7W: Grounded Question Answering in Imagescited by 315
- 2017OpenNMT: Open-source Toolkit for Neural Machine Translationcited by 251
- 2021Quality at a Glance: An Audit of Web-Crawled Multilingual Datasetscited by 241
- 2015Exploring Models and Data for Image Question Answeringcited by 139
- 2014A Multi-World Approach to Question Answering about Real-World Scenes based on Uncertain Inputcited by 112
- 2016Human Attention in Visual Question Answering: Do Humans and Deep Networks Look at the Same Regions?cited by 111
- 2022A Few Thousand Translations Go a Long Way! Leveraging Pre-trained Models for African News Translationcited by 97
- 2019Multimodal Transformer with Multi-View Visual Representation for Image Captioningcited by 86
- 2018Tensor2Tensor for Neural Machine Translationcited by 85
- 2018Training Tips for the Transformer Modelcited by 85
- 2015Are You Talking to a Machine? Dataset and Methods for Multilingual Image Question Answeringcited by 80
- 2021xGQA: Cross-Lingual Visual Question Answeringcited by 72
- 2023AfriSenti: A Twitter Sentiment Analysis Benchmark for African Languagescited by 68
- 2022NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment Analysiscited by 64
- 2016Visual Question Answering: Datasets, Algorithms, and Future Challengescited by 56
- 2023SemEval-2023 Task 12: Sentiment Analysis for African Languages (AfriSenti-SemEval)cited by 41
- 2022MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognitioncited by 38
- 2020MMFT-BERT: Multimodal Fusion Transformer with BERT Encodings for Visual Question Answeringcited by 30
- 2022Hausa Visual Genome: A Dataset for Multi-Modal English to Hausa Machine Translationcited by 13
- 2022Multi-Modal Fusion Transformer for Visual Question Answering in Remote Sensingcited by 13
- 2022HERDPhobia: A Dataset for Hate Speech against Fulani in Nigeriacited by 12
- 2022Kencorpus: A Kenyan Language Corpus of Swahili, Dholuo and Luhya for Natural Language Processing Taskscited by 9
- 2018Visual Question Answering as Reading Comprehensioncited by 8
- 2022MuCoT: Multilingual Contrastive Training for Question-Answering in Low-resource Languagescited by 6
- 2022Recent, rapid advancement in visual question answering architecture: a reviewcited by 5
Built on by
Citing papers per year: 2024: 2; 2025: 6; 2026: 4.
12 papers.
- 2024Correcting FLORES Evaluation Dataset for Four African Languagescited by 13
- 2024A Survey on Multi-modal Machine Translation: Tasks, Methods and Challengescited by 6
- 2025Pearl: A Multimodal Culturally-Aware Arabic Instruction Datasetcited by 6
- 2025Large Multimodal Models for Low-Resource Languages: A Surveycited by 4
- 2025Evaluation of Cultural Competence of Vision-Language Modelscited by 3
- 2025HausaNLP: Current Status, Challenges and Future Directions for Hausa Natural Language Processingcited by 2
- 2026Afri-MCQA: Multimodal Cultural Question Answering for African Languagescited by 2
- 2025NaijaNLP: A Survey of Nigerian Low-Resource Languagescited by 0
- 2025Automatic Correction of Writing Anomalies in Hausa Textscited by 0
- 2026Scalable Multilingual Multimodal Machine Translation with Speech-Text Fusioncited by 0
- 2026Multilingual and Multimodal LLMs in the Wild: Building for Low-Resource Languagescited by 0
- 2026PUMA: A Polish Benchmark for Culturally Grounded Multimodal Understandingcited by 0
- 2026PUMA: A Polish Benchmark for Culturally Grounded Multimodal Understanding22 Aug 2026
- 2026Multilingual and Multimodal LLMs in the Wild: Building for Low-Resource Languages16 May 2026
- 2026Scalable Multilingual Multimodal Machine Translation with Speech-Text Fusion25 Feb 2026
- 2026Afri-MCQA: Multimodal Cultural Question Answering for African Languages9 Jan 2026
- 2025Automatic Correction of Writing Anomalies in Hausa Texts4 Jun 2025
- 2025Evaluation of Cultural Competence of Vision-Language Models28 May 2025
- 2025Pearl: A Multimodal Culturally-Aware Arabic Instruction Dataset28 May 2025
- 2025HausaNLP: Current Status, Challenges and Future Directions for Hausa Natural Language Processing20 May 2025
- 2025NaijaNLP: A Survey of Nigerian Low-Resource Languages27 Feb 2025
- 2025Large Multimodal Models for Low-Resource Languages: A Survey8 Feb 2025
- 2024Correcting FLORES Evaluation Dataset for Four African Languages1 Sep 2024
- 2024A Survey on Multi-modal Machine Translation: Tasks, Methods and Challenges21 May 2024