OmniDiagram: Advancing Unified Diagram Code Generation via Visual Interrogation Reward
Not on the map. Why?
Abstract (arXiv)
The paradigm of programmable diagram generation is evolving rapidly, playing a crucial role in structured visualization. However, most existing studies are confined to a narrow range of task formulations and language support, constraining their applicability to diverse diagram types. In this work, we propose OmniDiagram, a unified framework that incorporates diverse diagram code languages and task definitions. To address the challenge of aligning code logic with visual fidelity in Reinforcement Learning (RL), we introduce a novel visual feedback strategy named Visual Interrogation Verifies All (textscViva). Unlike brittle syntax-based rules or pixel-level matching, textscViva rewards the visual structure of rendered diagrams through a generative approach. Specifically, textscViva actively generates targeted visual inquiries to scrutinize diagram visual fidelity and provides fine-grained feedback for optimization. This mechanism facilitates a self-evolving training process, effectively obviating the need for manually annotated ground truth code. Furthermore, we construct M32Diagram, the first large-scale diagram code generation dataset, containing over 196k high-quality instances. Experimental results confirm that the combination of SFT and our textscViva-based RL allows OmniDiagram to establish a new state-of-the-art (SOTA) across diagram code generation benchmarks.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 21 of its 31 references that are in the map. First posted on arXiv 7 Apr 2026.
Builds on
21 of 31 references.
References · 21
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
- 2024Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMscited by 273
- 2025ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generationcited by 92
- 2025OmniSVG: A Unified Scalable Vector Graphics Generation Modelcited by 74
- 2025Scaling Text-Rich Image Understanding via Code-Guided Synthetic Multimodal Data Generationcited by 58
- 2025Rendering-Aware Reinforcement Learning for Vector Graphics Generationcited by 39
- 2025ChartEdit: How Far Are MLLMs From Automating Chart Analysis? Evaluating MLLMs' Capability via Chart Editingcited by 32
- 2024FlowVQA: Mapping Multimodal Logic in Visual Question Answering with Flowchartscited by 28
- 2025VinciCoder: Unifying Multimodal Code Generation via Coarse-to-fine Visual Reinforcement Learningcited by 21
- 2025nvBench 2.0: Resolving Ambiguity in Text-to-Visualization through Stepwise Reasoningcited by 19
9 more
- 2025Breaking the SFT Plateau: Multimodal Structured Reinforcement Learning for Chart-to-Code Generationcited by 19
- 2025ChartMaster: Advancing Chart-to-Code Generation with Real-World Charts and Chart Similarity Reinforcement Learningcited by 16
- 2025Text2Vis: A Challenging and Diverse Benchmark for Generating Multimodal Visualizations from Textcited by 12
- 2025ChartEditor: A Reinforcement Learning Framework for Robust Chart Editingcited by 11
- 2025JanusCoder: Towards a Foundational Visual-Programmatic Interface for Code Intelligencecited by 9
- 2025Flow2Code: Evaluating Large Language Models for Flowchart-based Code Generation Capabilitycited by 8
- 2025StarFlow: Generating Structured Workflow Outputs From Sketch Imagescited by 3
- 2025Multilingual Multimodal Software Developer for Code Generationcited by 3
- 2025Doc2Chart: Intent-Driven Zero-Shot Chart Generation from Documentscited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Crafter: A Multi-Agent Harness for Editable Scientific Figure Generation from Diverse Inputscited by 9
- 2026Beyond NL2Code: A Structured Survey of Multimodal Code Intelligencecited by 6
- 2026EdiTikZ: Scientific Figure Editing from Revision Trajectoriescited by 1
- 2026FigAct: Turning Scientific Figures into Active Canvases for Explanationcited by 0
- 2026FigAct: Turning Scientific Figures into Active Canvases for Explanation28 Sep 2026
- 2026EdiTikZ: Scientific Figure Editing from Revision Trajectories1 Sep 2026
- 2026Beyond NL2Code: A Structured Survey of Multimodal Code Intelligence14 Jun 2026
- 2026Crafter: A Multi-Agent Harness for Editable Scientific Figure Generation from Diverse Inputs28 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026VCG-Bench: Towards A Unified Visual-Centric Benchmark for Structured Generation and Editing
- 2026Omni-I2C: A Holistic Benchmark for High-Fidelity Image-to-Code Generation
- 2026AesCode: Aesthetic Code Generation with Decoupled Cross-Modal Rewards
- 2026Self-Distillation Policy Optimization via Visual Feedback: Bridging Code and Visual Artifacts
- 2026Feynman: Knowledge-Infused Diagramming Agent for Scalable Visual Designs
- 2026GenAI-DrawIO-Creator: A Framework for Automated Diagram Generation
- 2026Scientific Graphics Program Synthesis via Dual Self-Consistency Reinforcement Learning
- 2025Boosting Chart-to-Code Generation in MLLM via Dual Preference-Guided Refinement