VQA: Visual Question Answering
Not on the map. Why?
Cited by 750 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We propose the task of free-form and open-ended Visual Question Answering (VQA). Given an image and a natural language question about the image, the task is to provide an accurate natural language answer. Mirroring real-world scenarios, such as helping the visually impaired, both the questions and answers are open-ended. Visual questions selectively target different areas of an image, including background details and underlying context. As a result, a system that succeeds at VQA typically needs a more detailed understanding of the image and complex reasoning than a system producing generic image captions. Moreover, VQA is amenable to automatic evaluation, since many open-ended answers contain only a few words or a closed set of answers that can be provided in a multiple-choice format. We provide a dataset containing ~0.25M images, ~0.76M questions, and ~10M answers (www.visualqa.org), and discuss the information it provides. Numerous baselines and methods for VQA are provided and compared with human performance. Our VQA demo is available on CloudCV (http://cloudcv.org/vqa).
Key facts. Cited by 2,506 papers in the map (data through 14 Oct 2026). First posted on arXiv 3 May 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 0; 2020: 1; 2021: 332; 2022: 389; 2023: 482; 2024: 498; 2025: 485; 2026: 318.
2,506 papers.
Sort:
By area:
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
- 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,619
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
- 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
38 more
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
- 2021Transformers in Vision: A Surveycited by 1,013
- 2023A Survey on Multimodal Large Language Modelscited by 909
- 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
- 2022A Generalist Agentcited by 808
- 2022PaLI: A Jointly-Scaled Multilingual Language-Image Modelcited by 766
- 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 744
- 2022Language-driven Semantic Segmentationcited by 717
- 2022A-OKVQA: A Benchmark for Visual Question Answering using World Knowledgecited by 710
- 2023CogVLM: Visual Expert for Pretrained Language Modelscited by 708
- 2023CogAgent: A Visual Language Model for GUI Agentscited by 704
- 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 680
- 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 668
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
- 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 656
- 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 583
- 2023Otter: A Multi-Modal Model with In-Context Instruction Tuningcited by 550
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
- 2021DenseCLIP: Language-Guided Dense Prediction with Context-Aware Promptingcited by 532
- 2022GroupViT: Semantic Segmentation Emerges from Text Supervisioncited by 531
- 2022Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionalitycited by 529
- 2024Long Context Transfer from Language to Visioncited by 515
- 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 512
- 2023VisionLLM: Large Language Model is also an Open-Ended Decoder for Vision-Centric Taskscited by 501
- 2025Humanity's Last Examcited by 491
- 2021Less is More: ClipBERT for Video-and-Language Learning via Sparse Samplingcited by 484
- 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 449
- 2021Tip-Adapter: Training-free CLIP-Adapter for Better Vision-Language Modelingcited by 431
- 2022Unified-IO: A Unified Model for Vision, Language, and Multi-Modal Taskscited by 421
- 2021Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigmcited by 405
- 2022Multimodal Learning with Transformers: A Surveycited by 400
- 2023Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understandingcited by 371
- 2023An Embodied Generalist Agent in 3D Worldcited by 365
- 2021Measuring and Improving Consistency in Pretrained Language Modelscited by 364
50 most cited of 2,506 All 2,506 (JSON)
- 2026Recognizing Dialogue Ambiguity via Candidate Set Visual Grounding14 Oct 2026
- 2026Vision-Language Models Integrate Conflicting Evidence Like Biased Bayesian Observers14 Oct 2026
- 2026Visual Dependence Does Not Imply Answerability: A Systematic Analysis of Answerability Signals in Frozen InstructBLIP13 Oct 2026
- 2026DVTR-KD: Distilling Vision-Language Models via Intermediate Visual Token Reconstruction13 Oct 2026
- 2026Tanawpamana: Benchmarking Vision-Language Models on Philippine Cultural Heritage Sites13 Oct 2026
- 2026Lost in Contrast: Instruction-Preserving Decoding for Reliable Visual Question Answering12 Oct 2026
- 2026Do you "see" what I "see"? A Multi-panel Visual Question Answer Dataset for Large Language Model Chart Analysis9 Oct 2026
- 2026OccludeBench: Can VLMs Find What's Missing?9 Oct 2026
- 2026SheafPrune: Sheaf-Guided Graph Propagation for Visual Token Pruning9 Oct 2026
- 2026Feature Competition and Its Representational Origins in Vision Language Models: Evidence from the Stroop Paradigm8 Oct 2026
- 2026When to Rethink: Learning Multi-Perspective Self-Verification for Vision-Language Models4 Oct 2026
- 2026A Strong Baseline for Evaluating Vision Encoders in Multimodal Large Language Models4 Oct 2026
38 more
- 2026Architecture-Dependent Fusion Pathways in MLLMs2 Oct 2026
- 2026Evaluating VQA in Vision Language Models using Cooperative Principles2 Oct 2026
- 2026Hob-VL: A Benchmark for Visually Grounded Boolean Reasoning1 Oct 2026
- 2026NeuronEye: Query-Guided Visual Concept Activation for Vision-Language Reasoning29 Sep 2026
- 2026DARE to Mitigate Hallucination: Dual-path Auto-Regressive-aware Editing29 Sep 2026
- 2026Paired Multimodal Scaling Laws28 Sep 2026
- 2026When Does an Image Determine the Answer? Benchmarking Visual Answerability across Charts and Scenes28 Sep 2026
- 2026Seeing and Solving Are Not Enough for Vision-Language Models27 Sep 2026
- 2026Informative Viewpoint Selection for Episodic-Memory Embodied Question Answering using Omnidirectional Images27 Sep 2026
- 2026A2Safe: Counterfactual Evidence-Aligned Adaptive Agent Collaboration for Safe and Effective Visual Question Answering21 Sep 2026
- 2026InterHier: Learning Interconnected Hierarchical Semantics for Open-Vocabulary Object Detection21 Sep 2026
- 2026QwenVLConnector: A Fast, Unified Medical VLM Chatbot for Fine-Grained Clinical Perception and Text Generation19 Sep 2026
- 2026DocAttriBench: Benchmarking Answer Grounding in Document Visual Question Answering17 Sep 2026
- 2026A Multi-Modal Generative Model for Tomato Disease Leaves Understanding17 Sep 2026
- 2026BrainFocus: EEG-Guided ROI Selection for Efficient Vision-Language Models15 Sep 2026
- 2026NeuroSymbEAD: A Large Scale Neuro-Symbolic Caption Dataset for Omni-Directional Embodied Autonomous Driving15 Sep 2026
- 2026Counterfactual Reasoning for Robust Visual Question Answering15 Sep 2026
- 2026PalmLeaf-VQA: A Multi-Script Visual Question Answering Benchmark for Historical Palm-Leaf Manuscript Understanding Across Diverse Regions14 Sep 2026
- 2026Don't Send What You Don't Need: Question-Guided Token Pruning as a Privacy Defense for Vision-Language Models14 Sep 2026
- 2026Unraveling the Real Working Mechanism and Inherent Flaws of GAE: A Method for Interpreting Transformer Processes from an Economic Perspective7 Sep 2026
- 2026ECOKV: Geometry-Aware KV Cache Eviction via Complementary Diversity Metrics6 Sep 2026
- 2026VDiff-Bench: A Challenging Benchmark for Fine-Grained Image Difference Identification5 Sep 2026
- 2026One Perturbation Is Not Enough: Identifiability and Blind Baselines for Behavioral AI Evaluation5 Sep 2026
- 2026Commonsense Reasoning in Computer Vision: Foundations, Recent Advancements, and Future Directions4 Sep 2026
- 2026Knowing What Not to Answer: Selective Non-Compliance in Vision-Language Models4 Sep 2026
- 2026FPCO-Dialog: A Multi-Turn False-Premise Benchmark for Correction and Cooperation in Vision-Language Models3 Sep 2026
- 2026Who Drives the Probability Game of VLMs? A Temporal Causal Drive Evaluation Framework2 Sep 2026
- 2026From Terminology to Diagrams: Visual-Instruction Generation for Scientific Diagram Understanding1 Sep 2026
- 2026Benchmarking Vision-Language Models for Automated Pathology Diagnosis and Report Generation1 Sep 2026
- 2026Towards Generalizable Visually Grounded Exploration of Household Devices1 Sep 2026
- 2026SciTrue: Reliable Scientific Claim Validation with Frontier and Open Language Models at the NTCIR SciClaimEval Task1 Sep 2026
- 2026BiG-SURE - Bipartite Graph for Semantic Uncertainty and Reliability Estimation of LLMs31 Aug 2026
- 2026Inter-3D VQA: A Roadside Multimodal Benchmark for 3D Spatiotemporally Grounded Visual Question Answering28 Aug 2026
- 2026Dynamic Alignment Compensation for Hallucination Mitigation in Large Vision-Language Models28 Aug 2026
- 2026Defending Wearable VLMs Against Private Attribute Inference26 Aug 2026
- 2026PlanSightRAG: A Visual-First Multimodal RAG for Automating Question Answering and Compliance Checking for Civil Standard Plans26 Aug 2026
- 2026Not All Tokens Are Equal: Region-Aware Consistency Repair of Backdoors in MLLMs25 Aug 2026
- 2026IntentQA: Intent Question Answering in Videos by Cognitive Context Reasoning24 Aug 2026
50 newest of 2,506 All 2,506 (JSON)
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
- 2023A Survey on Multimodal Large Language Modelscited by 909
- 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
- 2023CogAgent: A Visual Language Model for GUI Agentscited by 704
- 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 583
- 2023Otter: A Multi-Modal Model with In-Context Instruction Tuningcited by 550
12 most cited of 648 All 648 (JSON)
- 2026Vision-Language Models Integrate Conflicting Evidence Like Biased Bayesian Observers14 Oct 2026
- 2026DVTR-KD: Distilling Vision-Language Models via Intermediate Visual Token Reconstruction13 Oct 2026
- 2026Tanawpamana: Benchmarking Vision-Language Models on Philippine Cultural Heritage Sites13 Oct 2026
- 2026OccludeBench: Can VLMs Find What's Missing?9 Oct 2026
- 2026SheafPrune: Sheaf-Guided Graph Propagation for Visual Token Pruning9 Oct 2026
- 2026Feature Competition and Its Representational Origins in Vision Language Models: Evidence from the Stroop Paradigm8 Oct 2026
- 2026A Strong Baseline for Evaluating Vision Encoders in Multimodal Large Language Models4 Oct 2026
- 2026Architecture-Dependent Fusion Pathways in MLLMs2 Oct 2026
- 2026Evaluating VQA in Vision Language Models using Cooperative Principles2 Oct 2026
- 2026DARE to Mitigate Hallucination: Dual-path Auto-Regressive-aware Editing29 Sep 2026
- 2026Seeing and Solving Are Not Enough for Vision-Language Models27 Sep 2026
- 2026A2Safe: Counterfactual Evidence-Aligned Adaptive Agent Collaboration for Safe and Effective Visual Question Answering21 Sep 2026
12 newest of 648 All 648 (JSON)
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
- 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 668
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
- 2022Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionalitycited by 529
- 2022SQA3D: Situated Question Answering in 3D Scenescited by 314
- 2022Visual Spatial Reasoningcited by 293
- 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?cited by 286
- 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RLcited by 248
- 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contextscited by 245
- 2022DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Modelscited by 230
- 2023Knowledge Editing for Large Language Models: A Surveycited by 194
12 most cited of 233 All 233 (JSON)
- 2026When to Rethink: Learning Multi-Perspective Self-Verification for Vision-Language Models4 Oct 2026
- 2026Hob-VL: A Benchmark for Visually Grounded Boolean Reasoning1 Oct 2026
- 2026NeuronEye: Query-Guided Visual Concept Activation for Vision-Language Reasoning29 Sep 2026
- 2026Commonsense Reasoning in Computer Vision: Foundations, Recent Advancements, and Future Directions4 Sep 2026
- 2026Inter-3D VQA: A Roadside Multimodal Benchmark for 3D Spatiotemporally Grounded Visual Question Answering28 Aug 2026
- 2026IntentQA: Intent Question Answering in Videos by Cognitive Context Reasoning24 Aug 2026
- 2026CL4D: Contrastive Language-4D Pretraining for Vision-Language Reasoning in Dynamic Scenes19 Aug 2026
- 2026When Safety Overrides Vision: Exploring Dynamics between Vision Influence and Safety Alignment in Vision-Language Models19 Aug 2026
- 2026Evidence-Grounded Trustworthy Multimodal Reasoning and Evaluation Benchmark in Complex Urban Scenes11 Aug 2026
- 2026Agentic Visual Reasoning in Whole-Slide Pathology Images via Active Perception9 Aug 2026
- 2026MIRROR: Learning from the Other View for Multi-Modal Reasoning23 Jul 2026
- 2026TestHallVQA: Exploring LVLMs' Document-Level Reasoning under Redundant Contexts from Scientific Exams15 Jul 2026
12 newest of 233 All 233 (JSON)
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
- 2022A Generalist Agentcited by 808
- 2023An Embodied Generalist Agent in 3D Worldcited by 365
- 2024VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Taskscited by 47
- 2025A Survey on the Optimization of Large Language Model-based Agentscited by 46
- 2024Agent3D-Zero: An Agent for Zero-shot 3D Understandingcited by 29
- 2025WorldGUI: An Interactive Benchmark for Desktop GUI Automation from Any Starting Pointcited by 20
- 2025Multi-Agent System for Comprehensive Soccer Understandingcited by 18
- 2024COMMA: A Communicative Multimodal Multi-Agent Benchmarkcited by 14
- 2024BenchAgents: Multi-Agent Systems for Structured Benchmark Creationcited by 9
- 2024HAMMR: HierArchical MultiModal React agents for generic VQAcited by 7
- 2026H2HMem: A Multimodal Memory Benchmark for Agents in Human-Human Interactionscited by 6
12 most cited of 30 All 30 (JSON)
- 2026Beyond Relevance: Bayesian Evidence Acquisition for Agentic Whole-Slide Image Reasoning6 Aug 2026
- 2026Exploring Agentic Workflows for Generating High Quality Math Visual Aids10 Jul 2026
- 2026Task-Specific Multimodal Question Answering Agents via Confidence Calibration and Incremental Reasoning for QANTA 202610 Jul 2026
- 2026H2HMem: A Multimodal Memory Benchmark for Agents in Human-Human Interactions8 Jun 2026
- 2026Benchmarking Living-Screen-Native GUI Agents on Short-Video Platforms3 Jun 2026
- 2026AutoMedBench: Towards Medical AutoResearch with Agentic AI Models1 Jun 2026
- 2026Feynman: Knowledge-Infused Diagramming Agent for Scalable Visual Designs13 Mar 2026
- 2026Cybo-Waiter: A Physical Agentic Framework for Humanoid Whole-Body Locomotion-Manipulation11 Mar 2026
- 2026Clarify or Answer: Reinforcement Learning for Agentic VQA with Context Under-specification23 Jan 2026
- 2025AFRAgent : An Adaptive Feature Renormalization Based High Resolution Aware GUI agent30 Nov 2025
- 2025Affective Multimodal Agents with Proactive Knowledge Grounding for Emotionally Aligned Marketing Dialogue21 Nov 2025
- 2025Refine and Align: Confidence Calibration through Multi-Agent Interaction in VQA14 Nov 2025
12 newest of 30 All 30 (JSON)
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
- 2022Versatile Diffusion: Text, Images and Variations All in One Diffusion Modelcited by 199
- 2025Muddit: Liberating Generation Beyond Text-to-Image with a Unified Discrete Diffusion Modelcited by 55
- 2023If at First You Don't Succeed, Try, Try Again: Faithful Diffusion-based Text-to-Image Generation by Selectioncited by 40
- 2024PromptFix: You Prompt and We Fix the Photocited by 40
- 2023SUR-adapter: Enhancing Text-to-Image Pre-trained Diffusion Models with Large Language Modelscited by 30
- 2024Bi-LORA: A Vision-Language Approach for Synthetic Image Detectioncited by 20
- 2023VIDiff: Translating Videos via Multi-Modal Instructions with Diffusion Modelscited by 19
- 2022DALL-E for Detection: Language-driven Compositional Image Synthesis for Object Detectioncited by 17
- 2023Discffusion: Discriminative Diffusion Models as Few-shot Vision and Language Learnerscited by 14
- 2023De-Diffusion Makes Text a Strong Cross-Modal Interfacecited by 14
- 2023Learning to Follow Object-Centric Image Editing Instructions Faithfullycited by 12
12 most cited of 21 All 21 (JSON)
- 2026DODO: Discrete OCR Diffusion Models18 Feb 2026
- 2025Masked Diffusion Captioning for Visual Feature Learning30 Oct 2025
- 2025IMG: Calibrating Diffusion Models via Implicit Multimodal Guidance30 Sep 2025
- 2025DiffRIS: Enhancing Referring Remote Sensing Image Segmentation with Pre-trained Text-to-Image Diffusion Models23 Jun 2025
- 2025Muddit: Liberating Generation Beyond Text-to-Image with a Unified Discrete Diffusion Model29 May 2025
- 2025Multi-modal Synthetic Data Training and Model Collapse: Insights from VLMs and Diffusion Models10 May 2025
- 2025Underlying Semantic Diffusion for Effective and Efficient In-Context Learning6 Mar 2025
- 2025Hummingbird: High Fidelity Image Generation via Multimodal Context Alignment7 Feb 2025
- 2024PromptFix: You Prompt and We Fix the Photo27 May 2024
- 2024Bi-LORA: A Vision-Language Approach for Synthetic Image Detection2 Apr 2024
- 2023Learning from Mistakes: Iterative Prompt Relabeling for Text-to-Image Diffusion Model Training23 Dec 2023
- 2023VIDiff: Translating Videos via Multi-Modal Instructions with Diffusion Models30 Nov 2023
12 newest of 21 All 21 (JSON)
- 2022MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Textcited by 220
- 2023Encyclopedic VQA: Visual questions about detailed properties of fine-grained categoriescited by 107
- 2022Retrieval Augmented Visual Question Answering with Outside Knowledgecited by 94
- 2025ViDoRAG: Visual Document Retrieval-Augmented Generation via Dynamic Iterative Reasoning Agentscited by 66
- 2025Ask in Any Modality: A Comprehensive Survey on Multimodal Retrieval-Augmented Generationcited by 42
- 2025Retrieval-Augmented Visual Question Answering via Built-in Autoregressive Search Enginescited by 13
- 2025OMGM: Orchestrate Multiple Granularities and Modalities for Efficient Multimodal Retrievalcited by 10
- 2025CRAG-MM: Multi-modal Multi-turn Comprehensive RAG Benchmarkcited by 10
- 2025FilterRAG: Zero-Shot Informed Retrieval-Augmented Generation to Mitigate Hallucinations in VQAcited by 5
- 2025Beyond Text: Unveiling Privacy Vulnerabilities in Multi-modal Retrieval-Augmented Generationcited by 5
- 2025Multimodal Retrieval-Augmented Generation with Large Language Models for Medical VQAcited by 3
- 2026Multimodal Adaptive Retrieval Augmented Generation through Internal Representation Learningcited by 3
12 most cited of 17 All 17 (JSON)
- 2026ConceptFormer: Learning Adaptive Latent Concepts for Query-Document Alignment in Visual Document Retrieval16 Aug 2026
- 2026Very Efficient Listwise Multimodal Reranking for Long Documents12 May 2026
- 2026DEO: Training-Free Direct Embedding Optimization for Negation-Aware Retrieval10 Mar 2026
- 2026Multimodal Adaptive Retrieval Augmented Generation through Internal Representation Learning28 Feb 2026
- 2025CRAG-MM: Multi-modal Multi-turn Comprehensive RAG Benchmark30 Oct 2025
- 2025Multimedia-Aware Question Answering: A Review of Retrieval and Cross-Modal Reasoning Architectures23 Oct 2025
- 2025Multimodal Retrieval-Augmented Generation with Large Language Models for Medical VQA12 Oct 2025
- 2025Beyond Text: Unveiling Privacy Vulnerabilities in Multi-modal Retrieval-Augmented Generation20 May 2025
- 2025OMGM: Orchestrate Multiple Granularities and Modalities for Efficient Multimodal Retrieval10 May 2025
- 2025Automatic Teaching Platform on Vision Language Retrieval Augmented Generation7 Mar 2025
- 2025FilterRAG: Zero-Shot Informed Retrieval-Augmented Generation to Mitigate Hallucinations in VQA25 Feb 2025
- 2025ViDoRAG: Visual Document Retrieval-Augmented Generation via Dynamic Iterative Reasoning Agents25 Feb 2025
12 newest of 17 All 17 (JSON)
- 2021Compressing Visual-linguistic Model via Knowledge Distillationcited by 86
- 2021Instance-Conditional Knowledge Distillation for Object Detectioncited by 42
- 2022Look Around and Refer: 2D Synthetic Semantics Knowledge Distillation for 3D Visual Groundingcited by 41
- 2021KD-VLP: Improving End-to-End Vision-and-Language Pretraining with Object Knowledge Distillationcited by 23
- 2021VidLanKD: Improving Language Understanding via Video-Distilled Knowledge Transfercited by 22
- 2022Rethinking Data Augmentation for Robust Visual Question Answeringcited by 18
- 2021Dealing with Missing Modalities in the Visual Question Answer-Difference Prediction Task through Knowledge Distillationcited by 14
- 2021Towards Developing a Multilingual and Code-Mixed Visual Question Answering System by Knowledge Distillationcited by 13
- 2022Disentangle and Remerge: Interventional Knowledge Distillation for Few-Shot Object Detection from A Conditional Causal Perspectivecited by 13
- 2021MSD: Saliency-aware Knowledge Distillation for Multimodal Understandingcited by 3
- 2024Declarative Knowledge Distillation from Large Language Models for Visual Question Answering Datasetscited by 1
- 2025Overcoming Language Priors for Visual Question Answering Based on Knowledge Distillationcited by 1
- 2025Overcoming Language Priors for Visual Question Answering Based on Knowledge Distillation10 Jan 2025
- 2024Declarative Knowledge Distillation from Large Language Models for Visual Question Answering Datasets12 Oct 2024
- 2022Look Around and Refer: 2D Synthetic Semantics Knowledge Distillation for 3D Visual Grounding25 Nov 2022
- 2022Disentangle and Remerge: Interventional Knowledge Distillation for Few-Shot Object Detection from A Conditional Causal Perspective26 Aug 2022
- 2022Rethinking Data Augmentation for Robust Visual Question Answering18 Jul 2022
- 2021Instance-Conditional Knowledge Distillation for Object Detection25 Oct 2021
- 2021KD-VLP: Improving End-to-End Vision-and-Language Pretraining with Object Knowledge Distillation22 Sep 2021
- 2021Towards Developing a Multilingual and Code-Mixed Visual Question Answering System by Knowledge Distillation10 Sep 2021
- 2021VidLanKD: Improving Language Understanding via Video-Distilled Knowledge Transfer6 Jul 2021
- 2021Dealing with Missing Modalities in the Visual Question Answer-Difference Prediction Task through Knowledge Distillation13 Apr 2021
- 2021Compressing Visual-linguistic Model via Knowledge Distillation5 Apr 2021
- 2021MSD: Saliency-aware Knowledge Distillation for Multimodal Understanding6 Jan 2021
- 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directionscited by 73
- 2023NuScenes-MQA: Integrated Evaluation of Captions and QA for Autonomous Driving Datasets using Markup Annotationscited by 31
- 2023Towards Knowledge-driven Autonomous Drivingcited by 29
- 2023Explaining Autonomous Driving Actions with Visual Question Answeringcited by 16
- 2024Driving by the Rules: A Benchmark for Integrating Traffic Sign Regulations into Vectorized HD Mapcited by 11
- 2025Robusto-1 Dataset: Comparing Humans and VLMs on real out-of-distribution Autonomous Driving VQA from Perucited by 0
- 2026DriveXQA: Cross-modal Visual Question Answering for Adverse Driving Scene Understandingcited by 0
- 2026NeuroSymbEAD: A Large Scale Neuro-Symbolic Caption Dataset for Omni-Directional Embodied Autonomous Drivingcited by 0
- 2026NeuroSymbEAD: A Large Scale Neuro-Symbolic Caption Dataset for Omni-Directional Embodied Autonomous Driving15 Sep 2026
- 2026DriveXQA: Cross-modal Visual Question Answering for Adverse Driving Scene Understanding11 Mar 2026
- 2025Robusto-1 Dataset: Comparing Humans and VLMs on real out-of-distribution Autonomous Driving VQA from Peru10 Mar 2025
- 2024Driving by the Rules: A Benchmark for Integrating Traffic Sign Regulations into Vectorized HD Map31 Oct 2024
- 2023NuScenes-MQA: Integrated Evaluation of Captions and QA for Autonomous Driving Datasets using Markup Annotations11 Dec 2023
- 2023Towards Knowledge-driven Autonomous Driving7 Dec 2023
- 2023Explaining Autonomous Driving Actions with Visual Question Answering19 Jul 2023
- 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directions21 Dec 2021
- 2024MADTP: Multimodal Alignment-Guided Dynamic Token Pruning for Accelerating Vision-Language Transformercited by 54
- 2024TempMe: Video Temporal Token Merging for Efficient Text-Video Retrievalcited by 40
- 2025ToSA: Token Merging with Spatial Awarenesscited by 11
- 2025Adaptive Token Merging for Efficient Transformer Semantic Communication at the Edgecited by 7
- 2023ELIP: Efficient Discriminative Language-Image Pre-training with Fewer Vision Tokenscited by 2
- 2024AdaCoder: Adaptive Prompt Compression for Programmatic Visual Question Answeringcited by 1
- 2026UniCompress: Token Compression for Unified Vision-Language Understanding and Generationcited by 1
- 2026SMART: When is it Actually Worth Expanding a Speculative Tree?cited by 1
- 2026SMART: When is it Actually Worth Expanding a Speculative Tree?9 Apr 2026
- 2026UniCompress: Token Compression for Unified Vision-Language Understanding and Generation11 Mar 2026
- 2025Adaptive Token Merging for Efficient Transformer Semantic Communication at the Edge12 Sep 2025
- 2025ToSA: Token Merging with Spatial Awareness24 Jun 2025
- 2024TempMe: Video Temporal Token Merging for Efficient Text-Video Retrieval2 Sep 2024
- 2024AdaCoder: Adaptive Prompt Compression for Programmatic Visual Question Answering28 Jul 2024
- 2024MADTP: Multimodal Alignment-Guided Dynamic Token Pruning for Accelerating Vision-Language Transformer5 Mar 2024
- 2023ELIP: Efficient Discriminative Language-Image Pre-training with Fewer Vision Tokens28 Sep 2023
- 2023On the Adversarial Robustness of Multi-Modal Foundation Modelscited by 145
- 2021Dual-Key Multimodal Backdoors for Visual Question Answeringcited by 37
- 2025FC-Attack: Jailbreaking Multimodal Large Language Models via Auto-Generated Flowchartscited by 18
- 2025LLM Jailbreak Detection for (Almost) Free!cited by 13
- 2026Multimodal Unlearning Across Vision, Language, Video, and Audio: Survey of Methods, Datasets, and Benchmarkscited by 7
- 2025InverTune: Removing Backdoors from Multimodal Contrastive Learning Models via Trigger Inversion and Activation Tuningcited by 1
- 2026The Boy Who Cried Wolf: Adversarial Misclassification of Safe Inputs as Unsafe in Multimodal Guardrailscited by 0
- 2026Not All Tokens Are Equal: Region-Aware Consistency Repair of Backdoors in MLLMscited by 0
- 2026Not All Tokens Are Equal: Region-Aware Consistency Repair of Backdoors in MLLMs25 Aug 2026
- 2026The Boy Who Cried Wolf: Adversarial Misclassification of Safe Inputs as Unsafe in Multimodal Guardrails2 Aug 2026
- 2026Multimodal Unlearning Across Vision, Language, Video, and Audio: Survey of Methods, Datasets, and Benchmarks8 Jul 2026
- 2025LLM Jailbreak Detection for (Almost) Free!18 Sep 2025
- 2025InverTune: Removing Backdoors from Multimodal Contrastive Learning Models via Trigger Inversion and Activation Tuning14 Jun 2025
- 2025FC-Attack: Jailbreaking Multimodal Large Language Models via Auto-Generated Flowcharts28 Feb 2025
- 2023On the Adversarial Robustness of Multi-Modal Foundation Models21 Aug 2023
- 2021Dual-Key Multimodal Backdoors for Visual Question Answering14 Dec 2021
- 2018Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigationcited by 305
- 2020Language-Conditioned Imitation Learning for Robot Manipulation Taskscited by 136
- 2024Unpacking Failure Modes of Generative Policies: Runtime Monitoring of Consistency and Progresscited by 69
- 2024MORE-3S:Multimodal-based Offline Reinforcement Learning with Shared Semantic Spacescited by 1
- 2024Unpacking Failure Modes of Generative Policies: Runtime Monitoring of Consistency and Progress6 Oct 2024
- 2024MORE-3S:Multimodal-based Offline Reinforcement Learning with Shared Semantic Spaces20 Feb 2024
- 2020Language-Conditioned Imitation Learning for Robot Manipulation Tasks22 Oct 2020
- 2018Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation25 Nov 2018
- 2025Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Datacited by 21
- 2025Emotion-Qwen: A Unified Framework for Emotion and Vision Understandingcited by 11
- 2024An Entailment Tree Generation Approach for Multimodal Multi-Hop Question Answering with Mixture-of-Experts and Iterative Feedback Mechanismcited by 3
- 2025Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Data16 Nov 2025
- 2025Emotion-Qwen: A Unified Framework for Emotion and Vision Understanding10 May 2025
- 2024An Entailment Tree Generation Approach for Multimodal Multi-Hop Question Answering with Mixture-of-Experts and Iterative Feedback Mechanism8 Dec 2024
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 279
- 2025Benchmarking the Generality of Vision-Language-Action Modelscited by 0
- 2025Benchmarking the Generality of Vision-Language-Action Models12 Dec 2025
- 2024A Survey on Vision-Language-Action Models for Embodied AI23 May 2024
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,619
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
- 2021Transformers in Vision: A Surveycited by 1,013
- 2022PaLI: A Jointly-Scaled Multilingual Language-Image Modelcited by 766
- 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 744
- 2022Language-driven Semantic Segmentationcited by 717
- 2022A-OKVQA: A Benchmark for Visual Question Answering using World Knowledgecited by 710
- 2023CogVLM: Visual Expert for Pretrained Language Modelscited by 708
- 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 680
12 most cited of 1,501 All 1,501 (JSON)
- 2026Recognizing Dialogue Ambiguity via Candidate Set Visual Grounding14 Oct 2026
- 2026Visual Dependence Does Not Imply Answerability: A Systematic Analysis of Answerability Signals in Frozen InstructBLIP13 Oct 2026
- 2026Lost in Contrast: Instruction-Preserving Decoding for Reliable Visual Question Answering12 Oct 2026
- 2026Do you "see" what I "see"? A Multi-panel Visual Question Answer Dataset for Large Language Model Chart Analysis9 Oct 2026
- 2026Paired Multimodal Scaling Laws28 Sep 2026
- 2026When Does an Image Determine the Answer? Benchmarking Visual Answerability across Charts and Scenes28 Sep 2026
- 2026Informative Viewpoint Selection for Episodic-Memory Embodied Question Answering using Omnidirectional Images27 Sep 2026
- 2026InterHier: Learning Interconnected Hierarchical Semantics for Open-Vocabulary Object Detection21 Sep 2026
- 2026DocAttriBench: Benchmarking Answer Grounding in Document Visual Question Answering17 Sep 2026
- 2026A Multi-Modal Generative Model for Tomato Disease Leaves Understanding17 Sep 2026
- 2026Counterfactual Reasoning for Robust Visual Question Answering15 Sep 2026
- 2026PalmLeaf-VQA: A Multi-Script Visual Question Answering Benchmark for Historical Palm-Leaf Manuscript Understanding Across Diverse Regions14 Sep 2026
12 newest of 1,501 All 1,501 (JSON)