ChartSync: A Benchmark for Visuo-Logical Cascading Chart Editing
Not on the map. Why?
Abstract (arXiv)
Generative image editing models struggle with structured statistical charts when data modifications require geometric synchronization. We formalize this task as Visuo-Logical Cascading Editing (VLCE). However, existing methods remain confined to localized text substitutions and struggle with dependency-aware cascading updates. To systematically evaluate this capability, we introduce ChartSync, an expert-validated benchmark constructed via a programmatic rendering pipeline that guarantees deterministic visuo-logical coupling for the ground truth. ChartSync comprises 870 triplets across 9 chart categories and 4 task types, including 235 geometry-coupled VLCE instances that specifically test cascading text-to-geometry synchronization. We further evaluate these instances via a two-tier framework combining objective visual metrics with a vision-language model judge paradigm to assess low-level fidelity alongside multimodal comprehension and reasoning. Evaluating 14 image editing models and one code-mediated pipeline reveals a nuanced capability gap: most open-source models suffer severe drops in geometric synchronization, while only two frontier proprietary models show emerging VLCE capability, with their residual errors mainly involving semantic isolation and background corruption. Our detailed error analysis deconstructs these failure paradigms to identify core meta-abilities for guiding future multimodal architectures. The ChartSync dataset and code are publicly released at https://github.com/kaka-yjk/ChartSyncCodebase.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 17 of its 31 references that are in the map. First posted on arXiv 11 Jul 2026.
Builds on
17 of 31 references.
References · 17
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 249
- 2024I2EBench: A Comprehensive Benchmark for Instruction-based Image Editingcited by 63
- 2026Qwen-Image-2.0 Technical Reportcited by 36
- 2025ChartEdit: How Far Are MLLMs From Automating Chart Analysis? Evaluating MLLMs' Capability via Chart Editingcited by 32
- 2025ICE-Bench: A Unified and Comprehensive Benchmark for Image Creating and Editingcited by 24
- 2025DiffThinker: Towards Generative Multimodal Reasoning with Diffusion Modelscited by 19
- 2026Wan-Image: Pushing the Boundaries of Generative Visual Intelligencecited by 16
- 2025ChartEditor: A Reinforcement Learning Framework for Robust Chart Editingcited by 11
5 more
- 2025Charts Are Not Images: On the Challenges of Scientific Chart Editingcited by 11
- 2025RefEdit: A Benchmark and Method for Improving Instruction-based Image Editing Model on Referring Expressionscited by 10
- 2025TextEditBench: Evaluating Reasoning-aware Text Editing Beyond Renderingcited by 8
- 2026EndoCoT: Scaling Endogenous Chain-of-Thought Reasoning in Diffusion Modelscited by 6
- 2025OmniText: A Training-Free Generalist for Controllable Text-Image Manipulationcited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Charts Are Beyond Pixels: Probing for Layer-Wise Chart Understanding and Editingcited by 0
- 2026ChartRevise: A Dataset and Evaluation Protocol for Exact Chart Editing via Codecited by 0
- 2026Beyond Plausibility: Verifiable Fine-Grained Image Editing on Structured Assetscited by 0
- 2026Pixels or Code? Benchmarking Instruction-Guided Visual Artifact Operationcited by 0
- 2026Pixels or Code? Benchmarking Instruction-Guided Visual Artifact Operation12 Oct 2026
- 2026Beyond Plausibility: Verifiable Fine-Grained Image Editing on Structured Assets3 Oct 2026
- 2026ChartRevise: A Dataset and Evaluation Protocol for Exact Chart Editing via Code29 Sep 2026
- 2026Charts Are Beyond Pixels: Probing for Layer-Wise Chart Understanding and Editing8 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026ChartEditBench: Evaluating Grounded Multi-Turn Chart Editing in Multimodal Language Models
- 2025ChartM3: Benchmarking Chart Editing with Multimodal Instructions
- 2026ChartE3: A Comprehensive Benchmark for End-to-End Chart Editing
- 2026Semantic-Structural Alignment for Generative Pictorial Charts
- 2026Chart2SVG: Editable SVG Generation from Raster Chart Images
- 2025ChartAnchor: Chart Grounding with Structural-Semantic Fidelity
- 2026Chart Specification: Structural Representations for Incentivizing VLM Reasoning in Chart-to-Code Generation
- 2026InfoEdit: Probing Global Layout Reasoning in Infographic Editing