CycleChart: A Unified Consistency-Based Learning Framework for Bidirectional Chart Understanding and Generation
Not on the map. Why?
Abstract (arXiv)
Current chart-related tasks, such as chart generation (NL2Chart), chart schema parsing, chart data parsing, and chart question answering (ChartQA), are typically studied in isolation, preventing models from learning the shared semantics that link chart creation and interpretation. We introduce CycleChart, a consistency-based learning framework for bidirectional chart understanding and generation. Unlike conventional multi-task approaches that draw training samples independently across tasks, CycleChart organizes all tasks around each single data instance. From a source table and natural-language query, the model generates a chart specification, renders and executes it, then learns to recover the schema and underlying data from the resulting chart image. This per-instance lifecycle design lets the model capture the full chain of transformations, from raw data through visual encoding to structured recovery, and a generate--parse consistency objective enforces semantic alignment between the forward generation and reverse parsing directions. To support this framework, we construct CycleChart-Bench, a lifecycle-aligned benchmark where every chart sample carries aligned annotations for generation, schema parsing, data parsing, and question answering. CycleChart achieves strong results across all four tasks and transfers effectively to unseen external benchmarks, demonstrating improved cross-task generalization and marking a step toward more general chart understanding models.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 49 references that are in the map. First posted on arXiv 22 Dec 2025.
Builds on
36 of 49 references.
References · 36
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
- 2018DVQA: Understanding Data Visualizations via Question Answeringcited by 340
- 2019PlotQA: Reasoning over Scientific Plotscited by 321
- 2017DualGAN: Unsupervised Dual Learning for Image-to-Image Translationcited by 310
- 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 234
- 2023ChartLlama: A Multimodal LLM for Chart Understanding and Generationcited by 163
- 2023UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoningcited by 160
- 2016Dual Learning for Machine Translationcited by 148
- 2024ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoningcited by 128
- 2023ChartBench: A Benchmark for Complex Visual Reasoning in Chartscited by 120
24 more
- 2023VisText: A Benchmark for Semantically Rich Chart Captioningcited by 112
- 2025ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answeringcited by 108
- 2018Recycle-GAN: Unsupervised Video Retargetingcited by 89
- 2024ChartAssisstant: A Universal Chart Multimodal Language Model via Chart-to-Table Pre-training and Multitask Instruction Tuningcited by 79
- 2021SciCap: Generating Captions for Scientific Figurescited by 77
- 2020NL4DV: A Toolkit for Generating Analytic Specifications for Data Visualization from Natural Language Queriescited by 74
- 2023ChartGPT: Leveraging LLMs to Generate Charts from Abstract Natural Languagecited by 73
- 2024ChartInstruct: Instruction Tuning for Chart Comprehension and Reasoningcited by 68
- 2024From Pixels to Insights: A Survey on Automatic Chart Understanding in the Era of Large Foundation Modelscited by 53
- 2024ChartInsights: Evaluating Multimodal Large Language Models for Low-Level Chart Question Answeringcited by 50
- 2023Do LVLMs Understand Charts? Analyzing and Correcting Factual Errors in Chart Captioningcited by 49
- 2024ChartMoE: Mixture of Diversely Aligned Expert Connector for Chart Understandingcited by 46
- 2024OneChart: Purify the Chart Structural Extraction via One Auxiliary Tokencited by 39
- 2021nvBench: A Large-Scale Synthesized Dataset for Cross-Domain Natural Language to Visualization Taskcited by 28
- 2024Generative AI for Visualization: State of the Art and Future Directionscited by 23
- 2025Effective Training Data Synthesis for Improving MLLM Chart Understandingcited by 20
- 2025RefChartQA: Grounding Visual Answer on Chart Images through Instruction Tuningcited by 11
- 2022DashBot: Insight-Driven Dashboard Generation Based on Deep Reinforcement Learningcited by 10
- 2025DeepVIS: Bridging Natural Language and Data Visualization Through Step-wise Reasoningcited by 8
- 2025ChartMind: A Comprehensive Benchmark for Complex Real-world Multimodal Chart Question Answeringcited by 7
- 2023Cycle-Consistency Learning for Captioning and Groundingcited by 6
- 2024Natural Language Generation for Visualizations: State of the Art, Challenges and Future Directionscited by 6
- 2025ChartPoint: Guiding MLLMs with Grounding Reflection for Chart Reasoningcited by 6
- 2024Advancing Chart Question Answering with Robust Chart Component Recognitioncited by 5
Built on by
Not cited yet.