DVQA: Understanding Data Visualizations via Question Answering
Not on the map. Why?
Cited by 185 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Bar charts are an effective way to convey numeric information, but today's algorithms cannot parse them. Existing methods fail when faced with even minor variations in appearance. Here, we present DVQA, a dataset that tests many aspects of bar chart understanding in a question answering framework. Unlike visual question answering (VQA), DVQA requires processing words and answers that are unique to a particular bar chart. State-of-the-art VQA algorithms perform poorly on DVQA, and we propose two strong baselines that perform considerably better. Our work will enable algorithms to automatically extract numeric and semantic information from vast quantities of bar charts found in scientific publications, Internet articles, business reports, and many other areas.
Key facts. Cited by 338 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Jan 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 13; 2023: 32; 2024: 109; 2025: 101; 2026: 68.
338 papers.
Sort:
By area:
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,881
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
- 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,033
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 653
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 502
- 2021InfographicVQAcited by 430
- 2024Mini-Gemini: Mining the Potential of Multi-modality Vision Language Modelscited by 361
38 more
- 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 347
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
- 2024InternLM-XComposer2: Mastering Free-form Text-Image Composition and Comprehension in Vision-Language Large Modelcited by 326
- 2024What matters when building vision-language models?cited by 321
- 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 321
- 2024MM-LLMs: Recent Advances in MultiModal Large Language Modelscited by 277
- 2021IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoningcited by 262
- 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RLcited by 244
- 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimizationcited by 238
- 2024MM1: Methods, Analysis & Insights from Multimodal LLM Pre-trainingcited by 230
- 2024mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understandingcited by 220
- 2024CogVLM2: Visual Language Models for Image and Video Understandingcited by 214
- 2024MANTIS: Interleaved Multi-Image Instruction Tuningcited by 212
- 2024NVILA: Efficient Frontier Visual Language Modelscited by 206
- 2024InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Outputcited by 195
- 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipecited by 174
- 2024VITA: Towards Open-Source Interactive Omni Multimodal LLMcited by 172
- 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 171
- 2024Building and better understanding vision-language models: insights and future directionscited by 169
- 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 165
- 2023UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoningcited by 158
- 2024InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HDcited by 156
- 2021VisualMRC: Machine Reading Comprehension on Document Imagescited by 150
- 2023MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuningcited by 149
- 2023UReader: Universal OCR-free Visually-situated Language Understanding with Multimodal Large Language Modelcited by 143
- 2024Multimodal ArXiv: A Dataset for Improving Scientific Comprehension of Large Vision-Language Modelscited by 138
- 2025Magma: A Foundation Model for Multimodal AI Agentscited by 138
- 2024Eagle: Exploring The Design Space for Multimodal LLMs with Mixture of Encoderscited by 137
- 2024Exploring the Reasoning Abilities of Multimodal Large Language Models (MLLMs): A Comprehensive Survey on Emerging Trends in Multimodal Reasoningcited by 136
- 2024VisionLLM v2: An End-to-End Generalist Multimodal Large Language Model for Hundreds of Vision-Language Taskscited by 136
- 2021Going Full-TILT Boogie on Document Understanding with Text-Image-Layout Transformercited by 134
- 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoningcited by 134
- 2024Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Modelscited by 133
- 2022MatCha: Enhancing Visual Language Pretraining with Math Reasoning and Chart Derenderingcited by 132
- 2024SPHINX-X: Scaling Data and Parameters for a Family of Multi-modal Large Language Modelscited by 130
- 2024ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoningcited by 127
- 2024MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scalecited by 125
- 2022A Survey of Deep Learning for Mathematical Reasoningcited by 124
50 most cited of 338 All 338 (JSON)
- 2026When Does an Image Determine the Answer? Benchmarking Visual Answerability across Charts and Scenes28 Sep 2026
- 2026MergeHEIR: Mitigating Multimodal Hallucinations as the Tax of Model Merging26 Sep 2026
- 2026DashAct: A Progressive Diagnostic Benchmark for GUI Agents in Interactive Dashboard Analysis26 Sep 2026
- 2026Amnesia by Design, Memory By Necessity: Persistent State for Document Intelligence25 Sep 2026
- 2026LegendBench: A Diagnostic Benchmark for Legend Understanding with Counterfactual Interventions21 Sep 2026
- 2026InSight: A Benchmark for Agentic Claim Verification in Interactive Visualizations1 Sep 2026
- 2026DVBench: Benchmarking MLLMs for Understanding Dynamic Charts and Narratives in Data Videos30 Aug 2026
- 2026FigMirror: Ground It, Code It, Plot It28 Aug 2026
- 2026DEEPCHART: How Far are LLMs from Faithful Data-Science Chart Generation?27 Aug 2026
- 2026PlanSightRAG: A Visual-First Multimodal RAG for Automating Question Answering and Compliance Checking for Civil Standard Plans26 Aug 2026
- 2026SCAFFOLD: A Large-Scale Structured Dataset of Computer Science Research Figures with Diagram QA and Chain-of-Thought Reasoning Traces20 Aug 2026
- 2026A Pathway to General-Purpose Scientific AI: Multimodal Comprehension of Scientific Images14 Aug 2026
38 more
- 2026MultiModal Code-Switching: Interleaving Visual Objects into Language for Explicit Object-Level Alignment11 Aug 2026
- 2026Chartography: A Benchmark for Professional Chart Understanding11 Aug 2026
- 2026PRISM: Priority-aware Rubric Internalization via Structured Multimodal Data Synthesis5 Aug 2026
- 2026SciFigQual-Bench: A Benchmark for Scientific Figure Quality Assessment with Full-Manuscript Context29 Jul 2026
- 2026AnnoBench: A Benchmark for Visualization Annotation Generation28 Jul 2026
- 2026ToolSciVer: Multimodal Scientific Claim Verification with Visual Tool Augmented Reinforcement Learning17 Jul 2026
- 2026Benchmarking Multimodal Large Language Models for Scientific Visualization Literacy16 Jul 2026
- 2026Making Multimodal LLMs Reliable Chart Data Extractors: A Benchmark and Training Framework29 Jun 2026
- 2026Enhancing Numerical Prediction in LLMs via Smooth MMD Alignment26 Jun 2026
- 2026The Hidden Evolution of Disguised Visual Context inside the VLM18 Jun 2026
- 2026AgentFinVQA: A Deployable Multi-Agent Pipeline for Auditable Financial Chart QA18 Jun 2026
- 2026Qwen-RobotNav Technical Report: A Scalable Navigation Model Designed for an Agentic Navigation System16 Jun 2026
- 2026HakushoBench: A Japanese Chart and Table VQA Benchmark from Governmental White Papers31 May 2026
- 2026Zamba2-VL Technical Report29 May 2026
- 2026CrystalXRD-Bench: Benchmarking Vision-Language Models for XRD Peak Indexing Across Diverse Crystalline Materials28 May 2026
- 2026ABot-OCR Technical Report27 May 2026
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding26 May 2026
- 2026Chartographer: Counterfactual Chart Generation for Evaluating Vision-Language Models26 May 2026
- 2026ChartAct: A Benchmark for Dynamic Chart Understanding26 May 2026
- 2026VEN-VL: A Visual Ensemble MoE Framework for Effective and Efficient Multi-Modal Understanding25 May 2026
- 2026Vision Inference Former: Sustaining Visual Consistency in Multimodal Large Language Models18 May 2026
- 2026Process Rewards with Learned Reliability15 May 2026
- 2026Vision2Code: A Multi-Domain Benchmark for Evaluating Image-to-Code Generation11 May 2026
- 2026Learning More from Less: Exploiting Counterfactuals for Data-Efficient Chart Understanding11 May 2026
- 2026ZAYA1-VL-8B Technical Report8 May 2026
- 2026Chart-FR1: Visual Focus-Driven Fine-Grained Reasoning on Dense Charts3 May 2026
- 2026QCalEval: Benchmarking Vision-Language Models for Quantum Calibration Plot Understanding28 Apr 2026
- 2026Assessing Y-Axis Influence: Bias in Multimodal Language Models on Chart-to-Table Translation27 Apr 2026
- 2026Beyond Single Plots: A Benchmark for Question Answering on Multi-Charts23 Apr 2026
- 2026Beyond Pixels: Introspective and Interactive Grounding for Visualization Agents22 Apr 2026
- 2026Fast-dVLM: Efficient Block-Diffusion VLM via Direct Conversion from Autoregressive VLM8 Apr 2026
- 2026ChartDesign: Towards LLM Designer of Data Visualization6 Apr 2026
- 2026GENFIG1: Visual Summaries of Scholarly Work as a Challenge for Vision-Language Models5 Apr 2026
- 2026Chart-RL: Policy Optimization Reinforcement Learning for Enhanced Visual Reasoning in Chart Question Answering with Vision Language Models3 Apr 2026
- 2026Q-Mask: Query-driven Causal Masks for Text Anchoring in OCR-Oriented Vision-Language Models31 Mar 2026
- 2026Xuanwu: Evolving General Multimodal Models into an Industrial-Grade Foundation for Content Ecosystems31 Mar 2026
- 2026ChartDiff: A Large-Scale Benchmark for Comprehending Pairs of Charts30 Mar 2026
- 2026Navigating the Mirage: A Dual-Path Agentic Framework for Robust Misleading Chart Question Answering30 Mar 2026
50 newest of 338 All 338 (JSON)
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,033
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
- 2024Mini-Gemini: Mining the Potential of Multi-modality Vision Language Modelscited by 361
- 2024InternLM-XComposer2: Mastering Free-form Text-Image Composition and Comprehension in Vision-Language Large Modelcited by 326
- 2024What matters when building vision-language models?cited by 321
- 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 321
- 2024MM-LLMs: Recent Advances in MultiModal Large Language Modelscited by 277
- 2024MM1: Methods, Analysis & Insights from Multimodal LLM Pre-trainingcited by 230
- 2024CogVLM2: Visual Language Models for Image and Video Understandingcited by 214
- 2024MANTIS: Interleaved Multi-Image Instruction Tuningcited by 212
12 most cited of 158 All 158 (JSON)
- 2026InSight: A Benchmark for Agentic Claim Verification in Interactive Visualizations1 Sep 2026
- 2026MultiModal Code-Switching: Interleaving Visual Objects into Language for Explicit Object-Level Alignment11 Aug 2026
- 2026Benchmarking Multimodal Large Language Models for Scientific Visualization Literacy16 Jul 2026
- 2026Making Multimodal LLMs Reliable Chart Data Extractors: A Benchmark and Training Framework29 Jun 2026
- 2026HakushoBench: A Japanese Chart and Table VQA Benchmark from Governmental White Papers31 May 2026
- 2026Zamba2-VL Technical Report29 May 2026
- 2026ABot-OCR Technical Report27 May 2026
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding26 May 2026
- 2026Vision Inference Former: Sustaining Visual Consistency in Multimodal Large Language Models18 May 2026
- 2026Vision2Code: A Multi-Domain Benchmark for Evaluating Image-to-Code Generation11 May 2026
- 2026Learning More from Less: Exploiting Counterfactuals for Data-Efficient Chart Understanding11 May 2026
- 2026ZAYA1-VL-8B Technical Report8 May 2026
12 newest of 158 All 158 (JSON)
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,881
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 653
- 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 347
- 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RLcited by 244
- 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimizationcited by 238
- 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 171
- 2024Exploring the Reasoning Abilities of Multimodal Large Language Models (MLLMs): A Comprehensive Survey on Emerging Trends in Multimodal Reasoningcited by 136
- 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoningcited by 134
- 2024Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Modelscited by 133
- 2022MatCha: Enhancing Visual Language Pretraining with Math Reasoning and Chart Derenderingcited by 132
12 most cited of 46 All 46 (JSON)
- 2026SCAFFOLD: A Large-Scale Structured Dataset of Computer Science Research Figures with Diagram QA and Chain-of-Thought Reasoning Traces20 Aug 2026
- 2026Chartographer: Counterfactual Chart Generation for Evaluating Vision-Language Models26 May 2026
- 2026Process Rewards with Learned Reliability15 May 2026
- 2026Chart-FR1: Visual Focus-Driven Fine-Grained Reasoning on Dense Charts3 May 2026
- 2026Chart-RL: Policy Optimization Reinforcement Learning for Enhanced Visual Reasoning in Chart Question Answering with Vision Language Models3 Apr 2026
- 2026Evaluating Prompting Strategies for Chart Question Answering with Large Language Models3 Mar 2026
- 2026TableNet A Large-Scale Table Dataset with LLM-Powered Autonomous27 Feb 2026
- 2026Bridging Modality Disconnect in Self-Reflection via Closed-Loop Visually Grounded Verification21 Feb 2026
- 2026MapVerse: A Benchmark for Geospatial Question Answering on Diverse Real-World Maps11 Feb 2026
- 2026ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratch20 Jan 2026
- 2026Understanding Multi-Agent Reasoning with Large Language Models for Cartoon VQA6 Jan 2026
- 2025CompoDistill: Attention Distillation for Compositional Reasoning in Multimodal LLMs14 Oct 2025
12 newest of 46 All 46 (JSON)
- 2025Magma: A Foundation Model for Multimodal AI Agentscited by 138
- 2025LLM/Agent-as-Data-Analyst: A Surveycited by 15
- 2025Breaking the Data Barrier -- Building GUI Agents Through Task Generalizationcited by 13
- 2026Qwen-RobotNav Technical Report: A Scalable Navigation Model Designed for an Agentic Navigation Systemcited by 10
- 2025DashboardQA: Benchmarking Multimodal Agents for Question Answering on Interactive Dashboardscited by 3
- 2026DashAct: A Progressive Diagnostic Benchmark for GUI Agents in Interactive Dashboard Analysiscited by 0
- 2026DashAct: A Progressive Diagnostic Benchmark for GUI Agents in Interactive Dashboard Analysis26 Sep 2026
- 2026Qwen-RobotNav Technical Report: A Scalable Navigation Model Designed for an Agentic Navigation System16 Jun 2026
- 2025LLM/Agent-as-Data-Analyst: A Survey28 Sep 2025
- 2025DashboardQA: Benchmarking Multimodal Agents for Question Answering on Interactive Dashboards24 Aug 2025
- 2025Breaking the Data Barrier -- Building GUI Agents Through Task Generalization14 Apr 2025
- 2025Magma: A Foundation Model for Multimodal AI Agents18 Feb 2025
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 502
- 2021InfographicVQAcited by 430
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
- 2021IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoningcited by 262
- 2024mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understandingcited by 220
- 2021VisualMRC: Machine Reading Comprehension on Document Imagescited by 150
- 2021Going Full-TILT Boogie on Document Understanding with Text-Image-Layout Transformercited by 134
- 2024mPLUG-DocOwl2: High-resolution Compressing for OCR-free Multi-page Document Understandingcited by 113
- 2025Baichuan-Omni-1.5 Technical Reportcited by 107
- 2022MapQA: A Dataset for Question Answering on Choropleth Mapscited by 82
- 2024MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizercited by 80
12 most cited of 121 All 121 (JSON)
- 2026When Does an Image Determine the Answer? Benchmarking Visual Answerability across Charts and Scenes28 Sep 2026
- 2026MergeHEIR: Mitigating Multimodal Hallucinations as the Tax of Model Merging26 Sep 2026
- 2026Amnesia by Design, Memory By Necessity: Persistent State for Document Intelligence25 Sep 2026
- 2026LegendBench: A Diagnostic Benchmark for Legend Understanding with Counterfactual Interventions21 Sep 2026
- 2026DVBench: Benchmarking MLLMs for Understanding Dynamic Charts and Narratives in Data Videos30 Aug 2026
- 2026FigMirror: Ground It, Code It, Plot It28 Aug 2026
- 2026DEEPCHART: How Far are LLMs from Faithful Data-Science Chart Generation?27 Aug 2026
- 2026PlanSightRAG: A Visual-First Multimodal RAG for Automating Question Answering and Compliance Checking for Civil Standard Plans26 Aug 2026
- 2026A Pathway to General-Purpose Scientific AI: Multimodal Comprehension of Scientific Images14 Aug 2026
- 2026Chartography: A Benchmark for Professional Chart Understanding11 Aug 2026
- 2026SciFigQual-Bench: A Benchmark for Scientific Figure Quality Assessment with Full-Manuscript Context29 Jul 2026
- 2026AnnoBench: A Benchmark for Visualization Annotation Generation28 Jul 2026
12 newest of 121 All 121 (JSON)