Factuality Matters: When Image Generation and Editing Meet Structured Visuals
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
While modern visual generation models excel at creating aesthetically pleasing natural images, they struggle with producing or editing structured visuals like charts, diagrams, and mathematical figures, which demand composition planning, text rendering, and multimodal reasoning for factual fidelity. To address this, we present the first comprehensive, systematic investigation of this domain, encompassing data construction, model training, and an evaluation benchmark. First, we construct a large-scale dataset of 1.3 million high-quality structured image pairs derived from executable drawing programs and augmented with chain-of-thought reasoning annotations. Building on it, we train a unified model that integrates a VLM with FLUX.1 Kontext via a lightweight connector for enhanced multimodal understanding. A three-stage training curriculum enables progressive feature alignment, knowledge infusion, and reasoning-augmented generation, further boosted by an external reasoner at inference time. Finally, we introduce StructBench, a novel benchmark for generation and editing with over 1,700 challenging instances, and an accompanying evaluation metric, StructScore, which employs a multi-round Q&A protocol to assess fine-grained factual accuracy. Evaluations of 15 models reveal that even leading closed-source systems remain far from satisfactory. Our model attains strong editing performance, and inference-time reasoning yields consistent gains across diverse architectures. By releasing the dataset, model, and benchmark, we aim to advance unified multimodal foundations for structured visuals.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 67 of its 71 references that are in the map. First posted on arXiv 6 Oct 2025.
Builds on
67 of 71 references.
Closest ancestors · 7
Same direction, newest first
- 2025FLUX-Reason-6M & PRISM-Bench: A Million-Scale Text-to-Image Reasoning Dataset and Comprehensive Benchmark11 Sep
- 2025T2I-ReasonBench: Benchmarking Reasoning-Informed Text-to-Image Generation24 Aug
- 2025MathCoder-VL: Bridging Vision and Code for Enhanced Multimodal Mathematical Reasoning15 May
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing13 Mar
- 2025ReFocus: Visual Editing as a Chain of Thought for Structured Image Understanding9 Jan
- 2024VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection22 Nov
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning19 Mar
Other references · 60
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
38 more
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 760
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 573
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 331
- 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 321
- 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 297
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2025Transfer between Modalities with MetaQueriescited by 231
- 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 229
- 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 229
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2023JourneyDB: A Benchmark for Generative Image Understandingcited by 203
- 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 196
- 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 174
- 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformercited by 165
- 2024Lumina-mGPT: Illuminate Flexible Photorealistic Text-to-Image Generation with Multimodal Generative Pretrainingcited by 148
- 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
- 2024AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmarkcited by 137
- 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 131
- 2024Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiTcited by 130
- 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 100
- 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 97
- 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 95
- 2025ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generationcited by 94
- 2025Lumina-Image 2.0: A Unified and Efficient Image Generative Frameworkcited by 93
- 2025ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generationcited by 88
- 2023Effective Real Image Editing with Accelerated Iterative Diffusion Inversioncited by 79
- 2023AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZcited by 74
- 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 69
- 2025GPT-IMAGE-EDIT-1.5M: A Million-Scale, GPT-Generated Image Datasetcited by 68
50 most cited of 60 All 60 (JSON)
Built on by
Citing papers per year: 2025: 3; 2026: 13.
16 papers.
Sort:
By area:
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
- 2026IGenBench: Benchmarking the Reliability of Text-to-Infographic Generationcited by 14
- 2025PICABench: How Far Are We from Physically Realistic Image Editing?cited by 13
- 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Modelcited by 12
- 2026Scientific Image Synthesis: Benchmarking, Methodologies, and Downstream Utilitycited by 8
- 2026CoCo: Code as CoT for Text-to-Image Preview and Rare Concept Generationcited by 6
- 2026VCG-Bench: Towards A Unified Visual-Centric Benchmark for Structured Generation and Editingcited by 6
- 2026Visual Generation in the New Era: An Evolution from Atomic Mapping to Agentic World Modelingcited by 5
- 2026Uni-Edit: Intelligent Editing Is A General Task For Unified Model Tuningcited by 4
- 2026Video-MME-Logical: A Controlled Diagnostic Benchmark for Video Temporal-Logical Reasoningcited by 4
- 2026From Statics to Dynamics: Physics-Aware Image Editing with Latent Transition Priorscited by 3
- 2025Omni-Weather: A Unified Multimodal Model for Weather Radar Understanding and Generationcited by 2
4 more
- 2026Speech-Synchronized Whiteboard Generation via VLM-Driven Structured Drawing Representationscited by 0
- 2026Edit Where You Mean: Region-Aware Adapter Injection for Mask-Free Local Image Editingcited by 0
- 2026Are Text-to-Image Models Inductivist Turkeys? A Counterfactual Benchmark for Causal Reasoningcited by 0
- 2026DisciplineGen-1M: A Large-Scale Dataset for Multidisciplinary Visual Generation and Editingcited by 0
- 2026DisciplineGen-1M: A Large-Scale Dataset for Multidisciplinary Visual Generation and Editing2 Jul 2026
- 2026Video-MME-Logical: A Controlled Diagnostic Benchmark for Video Temporal-Logical Reasoning26 Jun 2026
- 2026Are Text-to-Image Models Inductivist Turkeys? A Counterfactual Benchmark for Causal Reasoning23 Jun 2026
- 2026Uni-Edit: Intelligent Editing Is A General Task For Unified Model Tuning20 May 2026
- 2026VCG-Bench: Towards A Unified Visual-Centric Benchmark for Structured Generation and Editing15 May 2026
- 2026Visual Generation in the New Era: An Evolution from Atomic Mapping to Agentic World Modeling30 Apr 2026
- 2026Edit Where You Mean: Region-Aware Adapter Injection for Mask-Free Local Image Editing26 Apr 2026
- 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Model22 Apr 2026
- 2026Speech-Synchronized Whiteboard Generation via VLM-Driven Structured Drawing Representations26 Mar 2026
- 2026CoCo: Code as CoT for Text-to-Image Preview and Rare Concept Generation9 Mar 2026
- 2026From Statics to Dynamics: Physics-Aware Image Editing with Latent Transition Priors25 Feb 2026
- 2026Scientific Image Synthesis: Benchmarking, Methodologies, and Downstream Utility17 Jan 2026
4 more
- 2026IGenBench: Benchmarking the Reliability of Text-to-Infographic Generation8 Jan 2026
- 2025Omni-Weather: A Unified Multimodal Model for Weather Radar Understanding and Generation25 Dec 2025
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformer27 Nov 2025
- 2025PICABench: How Far Are We from Physically Realistic Image Editing?20 Oct 2025
- 2026Scientific Image Synthesis: Benchmarking, Methodologies, and Downstream Utilitycited by 8
- 2026CoCo: Code as CoT for Text-to-Image Preview and Rare Concept Generationcited by 6
- 2026Video-MME-Logical: A Controlled Diagnostic Benchmark for Video Temporal-Logical Reasoningcited by 4
- 2026Are Text-to-Image Models Inductivist Turkeys? A Counterfactual Benchmark for Causal Reasoningcited by 0
- 2026Video-MME-Logical: A Controlled Diagnostic Benchmark for Video Temporal-Logical Reasoning26 Jun 2026
- 2026Are Text-to-Image Models Inductivist Turkeys? A Counterfactual Benchmark for Causal Reasoning23 Jun 2026
- 2026CoCo: Code as CoT for Text-to-Image Preview and Rare Concept Generation9 Mar 2026
- 2026Scientific Image Synthesis: Benchmarking, Methodologies, and Downstream Utility17 Jan 2026
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
- 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Modelcited by 12
- 2026Edit Where You Mean: Region-Aware Adapter Injection for Mask-Free Local Image Editingcited by 0
- 2026Edit Where You Mean: Region-Aware Adapter Injection for Mask-Free Local Image Editing26 Apr 2026
- 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Model22 Apr 2026
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformer27 Nov 2025
- 2026IGenBench: Benchmarking the Reliability of Text-to-Infographic Generationcited by 14
- 2025PICABench: How Far Are We from Physically Realistic Image Editing?cited by 13
- 2026Uni-Edit: Intelligent Editing Is A General Task For Unified Model Tuningcited by 4
- 2026From Statics to Dynamics: Physics-Aware Image Editing with Latent Transition Priorscited by 3
- 2025Omni-Weather: A Unified Multimodal Model for Weather Radar Understanding and Generationcited by 2
- 2026Speech-Synchronized Whiteboard Generation via VLM-Driven Structured Drawing Representationscited by 0
- 2026DisciplineGen-1M: A Large-Scale Dataset for Multidisciplinary Visual Generation and Editingcited by 0
- 2026DisciplineGen-1M: A Large-Scale Dataset for Multidisciplinary Visual Generation and Editing2 Jul 2026
- 2026Uni-Edit: Intelligent Editing Is A General Task For Unified Model Tuning20 May 2026
- 2026Speech-Synchronized Whiteboard Generation via VLM-Driven Structured Drawing Representations26 Mar 2026
- 2026From Statics to Dynamics: Physics-Aware Image Editing with Latent Transition Priors25 Feb 2026
- 2026IGenBench: Benchmarking the Reliability of Text-to-Infographic Generation8 Jan 2026
- 2025Omni-Weather: A Unified Multimodal Model for Weather Radar Understanding and Generation25 Dec 2025
- 2025PICABench: How Far Are We from Physically Realistic Image Editing?20 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026ExpertVerse: A General-Purpose Benchmark for Expert-Level Reasoning in Knowledge-Intensive Visual Synthesis
- 2026UniReason 1.0: A Unified Reasoning Framework for World Knowledge Aligned Image Generation and Editing
- 2026GenPuzzle: Benchmarking Visual Reasoning in Image Generation Models
- 2025MMMG: A Massive, Multidisciplinary, Multi-Tier Generation Benchmark for Text-to-Image Reasoning
- 2025Draw-In-Mind: Rebalancing Designer-Painter Roles in Unified Multimodal Models Benefits Image Editing
- 2026Semantic-Structural Alignment for Generative Pictorial Charts
- 2026SciGen-Verifier: A Multimodal Reasoner for Explainable Verification in Scientific Image Generation
- 2026InfoEdit: Probing Global Layout Reasoning in Infographic Editing