mlsanityData to 7 Oct 2026

Factuality Matters: When Image Generation and Editing Meet Structured Visuals

arXiv 2510.05091 ↗First posted 6 Oct 2025cs.CVcited by 16

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

While modern visual generation models excel at creating aesthetically pleasing natural images, they struggle with producing or editing structured visuals like charts, diagrams, and mathematical figures, which demand composition planning, text rendering, and multimodal reasoning for factual fidelity. To address this, we present the first comprehensive, systematic investigation of this domain, encompassing data construction, model training, and an evaluation benchmark. First, we construct a large-scale dataset of 1.3 million high-quality structured image pairs derived from executable drawing programs and augmented with chain-of-thought reasoning annotations. Building on it, we train a unified model that integrates a VLM with FLUX.1 Kontext via a lightweight connector for enhanced multimodal understanding. A three-stage training curriculum enables progressive feature alignment, knowledge infusion, and reasoning-augmented generation, further boosted by an external reasoner at inference time. Finally, we introduce StructBench, a novel benchmark for generation and editing with over 1,700 challenging instances, and an accompanying evaluation metric, StructScore, which employs a multi-round Q&A protocol to assess fine-grained factual accuracy. Evaluations of 15 models reveal that even leading closed-source systems remain far from satisfactory. Our model attains strong editing performance, and inference-time reasoning yields consistent gains across diverse architectures. By releasing the dataset, model, and benchmark, we aim to advance unified multimodal foundations for structured visuals.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 67 of its 71 references that are in the map. First posted on arXiv 6 Oct 2025.

Builds on

67 of 71 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025FLUX-Reason-6M & PRISM-Bench: A Million-Scale Text-to-Image Reasoning Dataset and Comprehensive Benchmark11 Sep
  2. 2025T2I-ReasonBench: Benchmarking Reasoning-Informed Text-to-Image Generation24 Aug
  3. 2025MathCoder-VL: Bridging Vision and Code for Enhanced Multimodal Mathematical Reasoning15 May
  4. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing13 Mar
  5. 2025ReFocus: Visual Editing as a Chain of Thought for Structured Image Understanding9 Jan
  6. 2024VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection22 Nov
  7. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning19 Mar

Other references · 60

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  5. 2022Scalable Diffusion Models with Transformerscited by 5,931
  6. 2025Qwen2.5-VL Technical Reportcited by 5,418
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  8. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  9. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  10. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  11. 2025Qwen-Image Technical Reportcited by 973
  12. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
38 more
  1. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  2. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  3. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
  4. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
  5. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 760
  6. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
  7. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 573
  8. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
  9. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
  10. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  11. 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 331
  12. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 321
  13. 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 297
  14. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
  15. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
  16. 2025Transfer between Modalities with MetaQueriescited by 231
  17. 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 229
  18. 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 229
  19. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
  20. 2023JourneyDB: A Benchmark for Generative Image Understandingcited by 203
  21. 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 196
  22. 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 174
  23. 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformercited by 165
  24. 2024Lumina-mGPT: Illuminate Flexible Photorealistic Text-to-Image Generation with Multimodal Generative Pretrainingcited by 148
  25. 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
  26. 2024AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmarkcited by 137
  27. 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 131
  28. 2024Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiTcited by 130
  29. 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 100
  30. 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 97
  31. 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 95
  32. 2025ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generationcited by 94
  33. 2025Lumina-Image 2.0: A Unified and Efficient Image Generative Frameworkcited by 93
  34. 2025ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generationcited by 88
  35. 2023Effective Real Image Editing with Accelerated Iterative Diffusion Inversioncited by 79
  36. 2023AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZcited by 74
  37. 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 69
  38. 2025GPT-IMAGE-EDIT-1.5M: A Million-Scale, GPT-Generated Image Datasetcited by 68

50 most cited of 60 All 60 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 13.

16 papers.

Sort:

By area:

  1. 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
  2. 2026IGenBench: Benchmarking the Reliability of Text-to-Infographic Generationcited by 14
  3. 2025PICABench: How Far Are We from Physically Realistic Image Editing?cited by 13
  4. 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Modelcited by 12
  5. 2026Scientific Image Synthesis: Benchmarking, Methodologies, and Downstream Utilitycited by 8
  6. 2026CoCo: Code as CoT for Text-to-Image Preview and Rare Concept Generationcited by 6
  7. 2026VCG-Bench: Towards A Unified Visual-Centric Benchmark for Structured Generation and Editingcited by 6
  8. 2026Visual Generation in the New Era: An Evolution from Atomic Mapping to Agentic World Modelingcited by 5
  9. 2026Uni-Edit: Intelligent Editing Is A General Task For Unified Model Tuningcited by 4
  10. 2026Video-MME-Logical: A Controlled Diagnostic Benchmark for Video Temporal-Logical Reasoningcited by 4
  11. 2026From Statics to Dynamics: Physics-Aware Image Editing with Latent Transition Priorscited by 3
  12. 2025Omni-Weather: A Unified Multimodal Model for Weather Radar Understanding and Generationcited by 2
4 more
  1. 2026Speech-Synchronized Whiteboard Generation via VLM-Driven Structured Drawing Representationscited by 0
  2. 2026Edit Where You Mean: Region-Aware Adapter Injection for Mask-Free Local Image Editingcited by 0
  3. 2026Are Text-to-Image Models Inductivist Turkeys? A Counterfactual Benchmark for Causal Reasoningcited by 0
  4. 2026DisciplineGen-1M: A Large-Scale Dataset for Multidisciplinary Visual Generation and Editingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026ExpertVerse: A General-Purpose Benchmark for Expert-Level Reasoning in Knowledge-Intensive Visual Synthesis
  2. 2026UniReason 1.0: A Unified Reasoning Framework for World Knowledge Aligned Image Generation and Editing
  3. 2026GenPuzzle: Benchmarking Visual Reasoning in Image Generation Models
  4. 2025MMMG: A Massive, Multidisciplinary, Multi-Tier Generation Benchmark for Text-to-Image Reasoning
  5. 2025Draw-In-Mind: Rebalancing Designer-Painter Roles in Unified Multimodal Models Benefits Image Editing
  6. 2026Semantic-Structural Alignment for Generative Pictorial Charts
  7. 2026SciGen-Verifier: A Multimodal Reasoner for Explainable Verification in Scientific Image Generation
  8. 2026InfoEdit: Probing Global Layout Reasoning in Infographic Editing