Coling-UniA at SciVQA 2025: Few-Shot Example Retrieval and Confidence-Informed Ensembling for Multimodal Large Language Models
On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning
Abstract (arXiv)
This paper describes our system for the SciVQA 2025 Shared Task on Scientific Visual Question Answering. Our system employs an ensemble of two Multimodal Large Language Models and various few-shot example retrieval strategies. The model and few-shot setting are selected based on the figure and question type. We also select answers based on the models' confidence levels. On the blind test data, our system ranks third out of seven with an average F1 score of 85.12 across ROUGE-1, ROUGE-L, and BERTS. Our code is publicly available.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 11 of its 19 references that are in the map. First posted on arXiv 3 Jul 2025.
Builds on
11 of 19 references.
References · 11
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,516
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
- 2019PlotQA: Reasoning over Scientific Plotscited by 321
- 2022MatCha: Enhancing Visual Language Pretraining with Math Reasoning and Chart Derenderingcited by 133
- 2023SciGraphQA: A Large-Scale Synthetic Multi-Turn Question-Answering Dataset for Scientific Graphscited by 68
- 2024TinyChart: Efficient Chart Understanding with Visual Token Merging and Program-of-Thoughts Learningcited by 52
- 2023ACL-Fig: A Dataset for Scientific Figure Classificationcited by 10
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Enhancing Scientific Visual Question Answering through Multimodal Reasoning and Ensemble Modeling
- 2025A Simple Data Augmentation Strategy for Text-in-Image Scientific VQA
- 2025SimpleVQA: Multimodal Factuality Evaluation for Multimodal Large Language Models
- 2023Language Guided Visual Question Answering: Elevate Your Multimodal Language Model Using Knowledge-Enriched Prompts
- 2025Enhancing Scientific Visual Question Answering via Vision-Caption aware Supervised Fine-Tuning
- 2026FAU at ImageCLEF 2026 Task on Multimodal Reasoning Robust Candidate Scoring and Concise Multilingual Visual Answering
- 2024CVQA: Culturally-diverse Multilingual Visual Question Answering Benchmark
- 2025VeriSciQA: An Auto-Verified Dataset for Scientific Visual Question Answering