mlsanityData to 14 Oct 2026

SciForma: Structure-Faithful Generation of Scientific Diagrams

arXiv 2607.18091 ↗First posted 20 Jul 2026cs.CV cs.GR cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Structural fidelity is essential to scientific methodology diagrams. To communicate research logic, these diagrams must faithfully render components, directional relations, and textual annotations. Since a single error, such as a reversed arrow or an unreadable equation, can invalidate the entire figure, structural fidelity is inherently conjunctive: correctness on one axis cannot compensate for failure on another. Current open-source models fail to satisfy this criterion. Supervised fine-tuning (SFT) learns plausible layouts but cannot reliably ensure structural correctness, while scalar reward-based post-training obscures which structural dimension has failed. To address this, we introduce SciForma, a framework for the structure faithful generation of scientific methodology diagrams. Specifically, SciForma decomposes diagram quality into three structural axes: Component, Arrow, and Text, guided by a structural inventory. Built on this foundation, we curate SciFormaData-700K for structured training and SciFormaBench-2K for logic-verified evaluation. To close the gap left by SFT, we develop Multi-Dimensional Conjunctive Preference Optimization (M-DPO), which enforces simultaneous correctness across all axes and adaptively routes gradients to the most deficient dimension in post-training. The same structural inventory also enables iterative editing at inference time to correct residual errors. This combination allows SciForma-9B to exceed all open-source baselines and GPT-Image-1.5 on both SciFormaBench-2K and AIBench, bringing open scientific diagram generation close to proprietary-level structural fidelity. Our code and data will be available at: https://github.com/microsoft/SciForma.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 32 of its 66 references that are in the map. First posted on arXiv 20 Jul 2026.

Builds on

32 of 66 references.

References · 32

  1. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  2. 2023Training Diffusion Models with Reinforcement Learningcited by 982
  3. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
  4. 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 413
  5. 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 277
  6. 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 230
  7. 2024VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generationcited by 156
  8. 2023AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZcited by 79
  9. 2025GRPO-Guard: Mitigating Implicit Over-Optimization in Flow Matching via Regulated Clippingcited by 49
  10. 2025Rendering-Aware Reinforcement Learning for Vector Graphics Generationcited by 39
  11. 2024From Words to Structured Visuals: A Benchmark and Framework for Text-to-Diagram Generation and Editingcited by 31
  12. 2023DiagrammerGPT: Generating Open-Domain, Open-Platform Diagrams via LLM Planningcited by 29
20 more
  1. 2026PaperBanana: Automating Academic Illustration for AI Scientistscited by 26
  2. 2025TikZero: Zero-Shot Text-Guided Graphics Program Synthesiscited by 24
  3. 2026AutoFigure: Generating and Refining Publication-Ready Scientific Illustrationscited by 23
  4. 2023FigGen: Text to Scientific Figure Generationcited by 17
  5. 2025MMMG: A Massive, Multidisciplinary, Multi-Tier Generation Benchmark for Text-to-Image Reasoningcited by 16
  6. 2025Neighbor GRPO: Contrastive ODE Policy Optimization Aligns Flow Modelscited by 16
  7. 2024SciDoc2Diagrammer-MAF: Towards Generation of Scientific Diagrams from Documents guided by Multi-Aspect Feedback Refinementcited by 15
  8. 2025PhysCorr: Dual-Reward DPO for Physics-Constrained Text-to-Video Generation with Automated Preference Selectioncited by 15
  9. 2026AutoFigure-Edit: Generating Editable Scientific Illustrationcited by 14
  10. 2025Smart-GRPO: Smartly Sampling Noise for Efficient RL of Flow-Matching Modelscited by 12
  11. 2026AeSlides: Incentivizing Aesthetic Layout in LLM-Based Slide Generation via Verifiable Rewardscited by 11
  12. 2026GDRO: Group-level Reward Post-training Suitable for Diffusion Modelscited by 8
  13. 2025Paper2SysArch: Structure-Constrained System Architecture Generation from Scientific Paperscited by 7
  14. 2026Scientific Graphics Program Synthesis via Dual Self-Consistency Reinforcement Learningcited by 6
  15. 2026SciFlow-Bench: Evaluating Structure-Aware Scientific Diagram Generation via Inverse Parsingcited by 5
  16. 2026Visual Preference Optimization with Rubric Rewardscited by 5
  17. 2026AIBench: Evaluating Visual-Logical Consistency in Academic Illustration Generationcited by 4
  18. 2026GENFIG1: Visual Summaries of Scholarly Work as a Challenge for Vision-Language Modelscited by 2
  19. 2026Beyond Binary Preference: Aligning Diffusion Models to Fine-grained Criteria by Decoupling Attributescited by 1
  20. 2026Correlation-Weighted Multi-Reward Optimization for Compositional Generationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Draw with Thought: Unleashing Multimodal Reasoning for Scientific Diagram Generation
  2. 2026Though Language Models Err While They Strive: Conformal Prediction for Self-Correcting Scientific Generation
  3. 2026Towards Physics-Faithful Generation of Scientific Diagrams
  4. 2026When Looks Do Not Lie: Discourse Structure Guided In-Context Learning for Faithful Diagram Generation
  5. 2025Robust Diagram Reasoning: A Framework for Enhancing LVLM Performance on Visually Perturbed Scientific Diagrams
  6. 2026SciCoQA: Quality Assurance for Scientific Paper--Code Alignment
  7. 2026Faithful, Enriched, and Precise: Benchmarking Natural-Science Illustration Generation by T2I models
  8. 2026SciFig: Towards Automating Editable Figure Generation for Scientific Papers