# ChartGalaxy: A Dataset for Infographic Chart Understanding and Generation

arXiv: https://arxiv.org/abs/2505.18668 · HTML: https://mlsanity.com/paper/2505.18668/

## Key facts

- Cited by 18 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 24 May 2025.

## Built on by (most cited first, 18 of 18)

- [LongCat-Next: Lexicalizing Modalities as Discrete Tokens](https://mlsanity.com/paper/2603.27538/) (2026)
- [InfoChartQA: A Benchmark for Multimodal Question Answering on Infographic Charts](https://mlsanity.com/paper/2505.19028/) (2025)
- [Penguin-VL: Exploring the Efficiency Limits of VLM with LLM-based Vision Encoders](https://mlsanity.com/paper/2603.06569/) (2026)
- [Beyond NL2Code: A Structured Survey of Multimodal Code Intelligence](https://mlsanity.com/paper/2606.15932/) (2026)
- [Towards Efficient Multimodal Unified Reasoning Model via Model Merging](https://mlsanity.com/paper/2510.08987/) (2025)
- [TextRich: A Multi-Domain Benchmark for Detecting AI-Generated Text-Rich Images from GPT-Image-2](https://mlsanity.com/paper/2606.19259/) (2026)
- [Multimodal Information Fusion for Chart Understanding: A Survey of MLLMs -- Evolution, Limitations, and Cognitive Enhancement](https://mlsanity.com/paper/2602.10138/) (2026)
- [Detect Anything in Graphic Design: Element-Level Rewards for Autoregressive Detection](https://mlsanity.com/paper/2609.07072/) (2026)
- [Show Me the Infographic I Imagine: Intent-Aware Infographic Retrieval for Authoring Support](https://mlsanity.com/paper/2604.07989/) (2026)
- [Semantic-Structural Alignment for Generative Pictorial Charts](https://mlsanity.com/paper/2606.06498/) (2026)
- [SynthDocBench: Controlled Benchmark for Long-Context Visual Document Understanding](https://mlsanity.com/paper/2607.10400/) (2026)
- [V-Rubrics: Visual Faithfulness via Rubric-Based Reinforcement Learning](https://mlsanity.com/paper/2608.25580/) (2026)
- [FigMirror: Ground It, Code It, Plot It](https://mlsanity.com/paper/2608.28814/) (2026)
- [Charts Are Beyond Pixels: Probing for Layer-Wise Chart Understanding and Editing](https://mlsanity.com/paper/2609.08657/) (2026)
- [PixelART: Image-to-Layer Decomposition without Latents or Text-to-Image Pretraining](https://mlsanity.com/paper/2609.22789/) (2026)
- [InfoAgent: Traceable Generation and Repair of Evidence-Grounded Infographics](https://mlsanity.com/paper/2609.39380/) (2026)
- [Stride: Scale-Aware Multi-Agent Evolutionary Refinement for Infographic Generation](https://mlsanity.com/paper/2610.13502/) (2026)
- [Do you "see" what I "see"? A Multi-panel Visual Question Answer Dataset for Large Language Model Chart Analysis](https://mlsanity.com/paper/2610.14173/) (2026)

## Abstract (arXiv)

Infographic charts are a powerful medium for communicating abstract data by combining visual elements (e.g., charts, images) with textual information. However, their visual and structural richness poses challenges for large vision-language models (LVLMs), which are typically trained on plain charts. To bridge this gap, we introduce ChartGalaxy, a million-scale dataset designed to advance the understanding and generation of infographic charts. The dataset is constructed through an inductive process that identifies 75 chart types, 440 chart variations, and 68 layout templates from real infographic charts and uses them to create synthetic ones programmatically. We showcase the utility of this dataset through: 1) improving infographic chart understanding via fine-tuning, 2) benchmarking code generation for infographic charts, and 3) enabling example-based infographic chart generation. By capturing the visual and structural complexity of real design, ChartGalaxy provides a useful resource for enhancing multimodal reasoning and generation in LVLMs.
