mlsanityData to 7 Oct 2026

ChartDensity-Bench: Benchmarking MLLMs for Numerical Data Reconstruction under Visual Density

arXiv 2609.38781 ↗First posted 30 Sep 2026cs.LG cs.AIcited by 0

On the map: Multimodal LLMs / vision-language models → Chart understanding and anomaly detection

Abstract (arXiv)

Multimodal large language models (MLLMs) offer a promising approach for recovering numerical data from scientific charts, but their ability to reconstruct chart data from visually dense figures remains poorly understood. Existing chart understanding benchmarks primarily evaluate question answering or chart-level reasoning and provide limited support for evaluating structured numerical reconstruction from scientific figures. We introduce ChartDensity-Bench, a benchmark for evaluating MLLMs on structured numerical data reconstruction from compound chart figures under controlled visual density. Built from charts paired with source-level ground-truth data, ChartDensity-Bench systematically varies the number of simultaneously presented charts (k∈1,3,6,9), enabling controlled evaluation of density-induced degradation. We further propose a multi-dimensional evaluation framework covering structural reliability, reconstruction completeness, parseability, and numerical fidelity. Experiments on five recent MLLMs show that numerical reconstruction generally degrades as visual density increases, while the magnitude of degradation varies substantially across models. Chart-level paired comparisons further show that the same source chart can incur higher reconstruction error when embedded in denser visual contexts. These findings highlight visual density as an important and previously underexplored factor in MLLM chart data reconstruction and provide a systematic benchmark for evaluating model robustness in this setting.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Chart understanding and anomaly detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 11 of its 20 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

11 of 20 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026Making Multimodal LLMs Reliable Chart Data Extractors: A Benchmark and Training Framework29 Jun
  2. 2025START: Spatial and Textual Learning for Chart Understanding8 Dec

Other references · 9

  1. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  2. 2025Qwen3-VL Technical Reportcited by 2,534
  3. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
  4. 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Modelscited by 629
  5. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 466
  6. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 439
  7. 2025ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answeringcited by 105
  8. 2024LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Inferencecited by 93
  9. 2026RAVE: Re-Allocating Visual Attention in Large Multimodal Modelscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025ChartAnchor: Chart Grounding with Structural-Semantic Fidelity
  2. 2023ChartBench: A Benchmark for Complex Visual Reasoning in Charts
  3. 2026ChartRevive: Reconstructing Data Visualizations from Chart Images Using MLLM ↗
  4. 2025Effective Training Data Synthesis for Improving MLLM Chart Understanding
  5. 2026ChartFI: Benchmarking Faithfulness and Insightfulness of Chart Descriptions from Multimodal Large Language Models
  6. 2025EncQA: Benchmarking Vision-Language Models on Visual Encodings for Charts
  7. 2026ChartNet: A Million-Scale, High-Quality Multimodal Dataset for Robust Chart Understanding
  8. 2025InterChart: Benchmarking Visual Reasoning Across Decomposed and Distributed Chart Information