LEAF-QA: Locate, Encode & Attend for Figure Question Answering
Not on the map. Why?
Abstract (arXiv)
We introduce LEAF-QA, a comprehensive dataset of 250,000 densely annotated figures/charts, constructed from real-world open data sources, along with ~2 million question-answer (QA) pairs querying the structure and semantics of these charts. LEAF-QA highlights the problem of multimodal QA, which is notably different from conventional visual QA (VQA), and has recently gained interest in the community. Furthermore, LEAF-QA is significantly more complex than previous attempts at chart QA, viz. FigureQA and DVQA, which present only limited variations in chart data. LEAF-QA being constructed from real-world sources, requires a novel architecture to enable question answering. To this end, LEAF-Net, a deep architecture involving chart element localization, question and answer encoding in terms of chart elements, and an attention network is proposed. Different experiments are conducted to demonstrate the challenges of QA on LEAF-QA. The proposed architecture, LEAF-Net also considerably advances the current state-of-the-art on FigureQA and DVQA.
Key facts. Cited by 54 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 7; 2023: 10; 2024: 12; 2025: 10; 2026: 9.
54 papers.
Sort:
By area:
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
- 2021InfographicVQAcited by 437
- 2021TextOCR: Towards large-scale end-to-end reasoning for arbitrary-shaped scene textcited by 171
- 2023MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuningcited by 150
- 2025ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answeringcited by 108
- 2022MapQA: A Dataset for Question Answering on Choropleth Mapscited by 85
- 2024SPIQA: A Dataset for Multimodal Question Answering on Scientific Paperscited by 75
- 2023SciGraphQA: A Large-Scale Synthetic Multi-Turn Question-Answering Dataset for Scientific Graphscited by 68
- 2022ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshotscited by 66
- 2022OpenCQA: Open-ended Question Answering with Chartscited by 61
- 2024From Pixels to Insights: A Survey on Automatic Chart Understanding in the Era of Large Foundation Modelscited by 53
- 20213D Question Answeringcited by 41
38 more
- 2023Reading and Reasoning over Chart Images for Evidence-based Automated Fact-Checkingcited by 35
- 2023PDFVQA: A New Dataset for Real-World VQA on PDF Documentscited by 28
- 2022Chart Question Answering: State of the Art and Future Directionscited by 26
- 2023From Image to Language: A Critical Analysis of Visual Question Answering (VQA) Approaches, Challenges, and Opportunitiescited by 25
- 2021ICDAR 2021 Competition on Document VisualQuestion Answeringcited by 19
- 2024Synthesize Step-by-Step: Tools, Templates and LLMs as Data Generators for Reasoning-Based Chart VQAcited by 19
- 2024Unraveling the Truth: Do VLMs really Understand Charts? A Deep Dive into Consistency and Robustnesscited by 17
- 2023Enhanced Chart Understanding in Vision and Language Task via Cross-modal Pre-training on Plot Table Pairscited by 15
- 2022FETA: Towards Specializing Foundation Models for Expert Task Applicationscited by 13
- 2025BigCharts-R1: Enhanced Chart Reasoning with Visual Reinforcement Finetuningcited by 13
- 2023DOMINO: A Dual-System for Multi-step Visual Language Reasoningcited by 12
- 2021A survey on VQA_Datasets and Approachescited by 11
- 2021Classification-Regression for Chart Comprehensioncited by 11
- 2022Business Document Information Extraction: Towards Practical Benchmarkscited by 11
- 2025ChartQA-X: Generating Explanations for Visual Chart Reasoningcited by 10
- 2024mChartQA: A universal benchmark for multimodal Chart Question Answer based on Vision-Language Alignment and Reasoningcited by 9
- 2023RealCQA: Scientific Chart Question Answering as a Test-bed for First-Order Logiccited by 8
- 2025WikiMixQA: A Multimodal Benchmark for Question Answering over Tables and Chartscited by 8
- 2023FigCaps-HF: A Figure-to-Caption Generative Framework and Benchmark with Human Feedbackcited by 7
- 2024Understanding Graphical Perception in Data Visualization through Zero-shot Prompting of Vision-Language Modelscited by 6
- 2024SBS Figures: Pre-training Figure QA from Stage-by-Stage Synthesized Imagescited by 5
- 2025PRISMM-Bench: A Benchmark of Peer-Review Grounded Multimodal Inconsistenciescited by 4
- 2025START: Spatial and Textual Learning for Chart Understandingcited by 4
- 2026Beyond Human Annotation: Recent Advances in Data Generation Methods for Document Intelligencecited by 4
- 2023DCQA: Document-Level Chart Question Answering towards Complex Reasoning and Common-Sense Understandingcited by 3
- 2024GRAB: A Challenging GRaph Analysis Benchmark for Large Multimodal Modelscited by 3
- 2025Chart Question Answering from Real-World Analytical Narrativescited by 3
- 2024GoT-CQA: Graph-of-Thought Guided Compositional Reasoning for Chart Question Answeringcited by 2
- 2024ChartKG: A Knowledge-Graph-Based Representation for Chart Imagescited by 2
- 2025ChartGaze: Enhancing Chart Understanding in LVLMs with Eye-Tracking Guided Attention Refinementcited by 2
- 2024SimpsonsVQA: Enhancing Inquiry-Based Learning with a Tailored Datasetcited by 1
- 2026Multimodal Information Fusion for Chart Understanding: A Survey of MLLMs -- Evolution, Limitations, and Cognitive Enhancementcited by 1
- 2026Navigating the Mirage: A Dual-Path Agentic Framework for Robust Misleading Chart Question Answeringcited by 1
- 2026ChartAct: A Benchmark for Dynamic Chart Understandingcited by 1
- 2024MAPWise: Evaluating Vision-Language Models for Advanced Map Queriescited by 0
- 2025Patent Figure Classification using Large Vision-language Modelscited by 0
- 2025Benchmark It Yourself (BIY): Preparing a Dataset and Benchmarking AI Models for Scatterplot-Related Taskscited by 0
- 2026When Visuals Aren't the Problem: Evaluating Vision-Language Models on Misleading Data Visualizationscited by 0
50 most cited of 54 All 54 (JSON)
- 2026Do you "see" what I "see"? A Multi-panel Visual Question Answer Dataset for Large Language Model Chart Analysis9 Oct 2026
- 2026LegendBench: A Diagnostic Benchmark for Legend Understanding with Counterfactual Interventions21 Sep 2026
- 2026ChartAct: A Benchmark for Dynamic Chart Understanding26 May 2026
- 2026Assessing Y-Axis Influence: Bias in Multimodal Language Models on Chart-to-Table Translation27 Apr 2026
- 2026Beyond Single Plots: A Benchmark for Question Answering on Multi-Charts23 Apr 2026
- 2026Navigating the Mirage: A Dual-Path Agentic Framework for Robust Misleading Chart Question Answering30 Mar 2026
- 2026When Visuals Aren't the Problem: Evaluating Vision-Language Models on Misleading Data Visualizations23 Mar 2026
- 2026Multimodal Information Fusion for Chart Understanding: A Survey of MLLMs -- Evolution, Limitations, and Cognitive Enhancement8 Feb 2026
- 2026Beyond Human Annotation: Recent Advances in Data Generation Methods for Document Intelligence18 Jan 2026
- 2025START: Spatial and Textual Learning for Chart Understanding8 Dec 2025
- 2025PRISMM-Bench: A Benchmark of Peer-Review Grounded Multimodal Inconsistencies18 Oct 2025
- 2025Benchmark It Yourself (BIY): Preparing a Dataset and Benchmarking AI Models for Scatterplot-Related Tasks7 Oct 2025
38 more
- 2025ChartGaze: Enhancing Chart Understanding in LVLMs with Eye-Tracking Guided Attention Refinement16 Sep 2025
- 2025BigCharts-R1: Enhanced Chart Reasoning with Visual Reinforcement Finetuning13 Aug 2025
- 2025Chart Question Answering from Real-World Analytical Narratives2 Jul 2025
- 2025WikiMixQA: A Multimodal Benchmark for Question Answering over Tables and Charts18 Jun 2025
- 2025ChartQA-X: Generating Explanations for Visual Chart Reasoning17 Apr 2025
- 2025ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answering7 Apr 2025
- 2025Patent Figure Classification using Large Vision-language Models22 Jan 2025
- 2024SBS Figures: Pre-training Figure QA from Stage-by-Stage Synthesized Images23 Dec 2024
- 2024Understanding Graphical Perception in Data Visualization through Zero-shot Prompting of Vision-Language Models31 Oct 2024
- 2024SimpsonsVQA: Enhancing Inquiry-Based Learning with a Tailored Dataset30 Oct 2024
- 2024ChartKG: A Knowledge-Graph-Based Representation for Chart Images13 Oct 2024
- 2024GoT-CQA: Graph-of-Thought Guided Compositional Reasoning for Chart Question Answering4 Sep 2024
- 2024MAPWise: Evaluating Vision-Language Models for Advanced Map Queries30 Aug 2024
- 2024GRAB: A Challenging GRaph Analysis Benchmark for Large Multimodal Models21 Aug 2024
- 2024Unraveling the Truth: Do VLMs really Understand Charts? A Deep Dive into Consistency and Robustness15 Jul 2024
- 2024SPIQA: A Dataset for Multimodal Question Answering on Scientific Papers12 Jul 2024
- 2024mChartQA: A universal benchmark for multimodal Chart Question Answer based on Vision-Language Alignment and Reasoning2 Apr 2024
- 2024Synthesize Step-by-Step: Tools, Templates and LLMs as Data Generators for Reasoning-Based Chart VQA25 Mar 2024
- 2024From Pixels to Insights: A Survey on Automatic Chart Understanding in the Era of Large Foundation Models18 Mar 2024
- 2023MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuning15 Nov 2023
- 2023From Image to Language: A Critical Analysis of Visual Question Answering (VQA) Approaches, Challenges, and Opportunities1 Nov 2023
- 2023DCQA: Document-Level Chart Question Answering towards Complex Reasoning and Common-Sense Understanding29 Oct 2023
- 2023DOMINO: A Dual-System for Multi-step Visual Language Reasoning4 Oct 2023
- 2023SciGraphQA: A Large-Scale Synthetic Multi-Turn Question-Answering Dataset for Scientific Graphs7 Aug 2023
- 2023RealCQA: Scientific Chart Question Answering as a Test-bed for First-Order Logic3 Aug 2023
- 2023FigCaps-HF: A Figure-to-Caption Generative Framework and Benchmark with Human Feedback20 Jul 2023
- 2023Enhanced Chart Understanding in Vision and Language Task via Cross-modal Pre-training on Plot Table Pairs29 May 2023
- 2023PDFVQA: A New Dataset for Real-World VQA on PDF Documents13 Apr 2023
- 2023Reading and Reasoning over Chart Images for Evidence-based Automated Fact-Checking27 Jan 2023
- 2022MapQA: A Dataset for Question Answering on Choropleth Maps15 Nov 2022
- 2022OpenCQA: Open-ended Question Answering with Charts12 Oct 2022
- 2022ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshots16 Sep 2022
- 2022FETA: Towards Specializing Foundation Models for Expert Task Applications8 Sep 2022
- 2022Business Document Information Extraction: Towards Practical Benchmarks20 Jun 2022
- 2022Chart Question Answering: State of the Art and Future Directions8 May 2022
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning19 Mar 2022
- 20213D Question Answering15 Dec 2021
- 2021Classification-Regression for Chart Comprehension29 Nov 2021
50 newest of 54 All 54 (JSON)
- 2023MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuningcited by 150
- 2024Understanding Graphical Perception in Data Visualization through Zero-shot Prompting of Vision-Language Modelscited by 6
- 2025PRISMM-Bench: A Benchmark of Peer-Review Grounded Multimodal Inconsistenciescited by 4
- 2025START: Spatial and Textual Learning for Chart Understandingcited by 4
- 2024GRAB: A Challenging GRaph Analysis Benchmark for Large Multimodal Modelscited by 3
- 2026Navigating the Mirage: A Dual-Path Agentic Framework for Robust Misleading Chart Question Answeringcited by 1
- 2024MAPWise: Evaluating Vision-Language Models for Advanced Map Queriescited by 0
- 2025Patent Figure Classification using Large Vision-language Modelscited by 0
- 2026When Visuals Aren't the Problem: Evaluating Vision-Language Models on Misleading Data Visualizationscited by 0
- 2026Navigating the Mirage: A Dual-Path Agentic Framework for Robust Misleading Chart Question Answering30 Mar 2026
- 2026When Visuals Aren't the Problem: Evaluating Vision-Language Models on Misleading Data Visualizations23 Mar 2026
- 2025START: Spatial and Textual Learning for Chart Understanding8 Dec 2025
- 2025PRISMM-Bench: A Benchmark of Peer-Review Grounded Multimodal Inconsistencies18 Oct 2025
- 2025Patent Figure Classification using Large Vision-language Models22 Jan 2025
- 2024Understanding Graphical Perception in Data Visualization through Zero-shot Prompting of Vision-Language Models31 Oct 2024
- 2024MAPWise: Evaluating Vision-Language Models for Advanced Map Queries30 Aug 2024
- 2024GRAB: A Challenging GRaph Analysis Benchmark for Large Multimodal Models21 Aug 2024
- 2023MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuning15 Nov 2023
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
- 2024Synthesize Step-by-Step: Tools, Templates and LLMs as Data Generators for Reasoning-Based Chart VQAcited by 19
- 2025BigCharts-R1: Enhanced Chart Reasoning with Visual Reinforcement Finetuningcited by 13
- 2023DOMINO: A Dual-System for Multi-step Visual Language Reasoningcited by 12
- 2024mChartQA: A universal benchmark for multimodal Chart Question Answer based on Vision-Language Alignment and Reasoningcited by 9
- 2024GoT-CQA: Graph-of-Thought Guided Compositional Reasoning for Chart Question Answeringcited by 2
- 2025BigCharts-R1: Enhanced Chart Reasoning with Visual Reinforcement Finetuning13 Aug 2025
- 2024GoT-CQA: Graph-of-Thought Guided Compositional Reasoning for Chart Question Answering4 Sep 2024
- 2024mChartQA: A universal benchmark for multimodal Chart Question Answer based on Vision-Language Alignment and Reasoning2 Apr 2024
- 2024Synthesize Step-by-Step: Tools, Templates and LLMs as Data Generators for Reasoning-Based Chart VQA25 Mar 2024
- 2023DOMINO: A Dual-System for Multi-step Visual Language Reasoning4 Oct 2023
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning19 Mar 2022
- 2021InfographicVQAcited by 437
- 2021TextOCR: Towards large-scale end-to-end reasoning for arbitrary-shaped scene textcited by 171
- 2025ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answeringcited by 108
- 2022MapQA: A Dataset for Question Answering on Choropleth Mapscited by 85
- 2024SPIQA: A Dataset for Multimodal Question Answering on Scientific Paperscited by 75
- 2023SciGraphQA: A Large-Scale Synthetic Multi-Turn Question-Answering Dataset for Scientific Graphscited by 68
- 2022ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshotscited by 66
- 2022OpenCQA: Open-ended Question Answering with Chartscited by 61
- 2024From Pixels to Insights: A Survey on Automatic Chart Understanding in the Era of Large Foundation Modelscited by 53
- 20213D Question Answeringcited by 41
- 2023Reading and Reasoning over Chart Images for Evidence-based Automated Fact-Checkingcited by 35
- 2023PDFVQA: A New Dataset for Real-World VQA on PDF Documentscited by 28
12 most cited of 38 All 38 (JSON)
- 2026Do you "see" what I "see"? A Multi-panel Visual Question Answer Dataset for Large Language Model Chart Analysis9 Oct 2026
- 2026LegendBench: A Diagnostic Benchmark for Legend Understanding with Counterfactual Interventions21 Sep 2026
- 2026ChartAct: A Benchmark for Dynamic Chart Understanding26 May 2026
- 2026Assessing Y-Axis Influence: Bias in Multimodal Language Models on Chart-to-Table Translation27 Apr 2026
- 2026Beyond Single Plots: A Benchmark for Question Answering on Multi-Charts23 Apr 2026
- 2026Multimodal Information Fusion for Chart Understanding: A Survey of MLLMs -- Evolution, Limitations, and Cognitive Enhancement8 Feb 2026
- 2026Beyond Human Annotation: Recent Advances in Data Generation Methods for Document Intelligence18 Jan 2026
- 2025Benchmark It Yourself (BIY): Preparing a Dataset and Benchmarking AI Models for Scatterplot-Related Tasks7 Oct 2025
- 2025ChartGaze: Enhancing Chart Understanding in LVLMs with Eye-Tracking Guided Attention Refinement16 Sep 2025
- 2025Chart Question Answering from Real-World Analytical Narratives2 Jul 2025
- 2025WikiMixQA: A Multimodal Benchmark for Question Answering over Tables and Charts18 Jun 2025
- 2025ChartQA-X: Generating Explanations for Visual Chart Reasoning17 Apr 2025
12 newest of 38 All 38 (JSON)