SciFig: Towards Automating Editable Figure Generation for Scientific Papers
Not on the map. Why?
Abstract (arXiv)
High-quality methodology figures are central to scientific communication, yet they remain difficult and time-consuming to create. Such figures must distill a method's components and information flow into a clear, revisable diagram as the paper evolves. Existing methodology diagram automation systems typically face a trade-off between editability and visual quality: TikZ- or SVG-based methods produce editable structured outputs but often lack the richness of human-designed figures, while image-generation models produce polished raster outputs that are difficult to revise. We introduce SciFig, an end-to-end multi-agent framework for generating visually rich and fully editable methodology figures from scientific text. SciFig decomposes figure generation into planning, layout synthesis, component rendering, and iterative refinement, producing XML figures that can be edited in standard diagramming tools and refined through human or VLM feedback. We also introduce SciFig-Bench, a human-verified benchmark of 435 author-drawn methodology figures from 37 arXiv domains and 15 top-tier AI/ML venues, and SciFig-Eval, a four-axis evaluation protocol for measuring figure quality. Across seven single-agent and agentic baselines, SciFig achieves the best performance on all four SciFig-Eval axes and generates editable figures in about 10 minutes on average. Qualitative examples further show that SciFig can generalize beyond methodology figures to teaser diagrams and statistical plots. Dataset and code are available at: https://shramanpramanick.github.io/SciFig/.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 29 of its 56 references that are in the map. First posted on arXiv 7 Jan 2026.
Builds on
29 of 56 references.
References · 29
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,838
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2023Large Language Models are not Fair Evaluatorscited by 1,085
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2022Galactica: A Large Language Model for Sciencecited by 744
- 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 422
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 366
- 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 321
- 2017FigureQA: An Annotated Figure Dataset for Visual Reasoningcited by 319
17 more
- 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 179
- 2023PaperQA: Retrieval-Augmented Generative Agent for Scientific Researchcited by 149
- 2024CycleResearcher: Improving Automated Research via Automated Reviewcited by 148
- 2023StarVector: Generating Scalable Vector Graphics Code from Images and Textcited by 102
- 2024MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualizationcited by 102
- 2024SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoningcited by 94
- 2025PPTAgent: Generating and Evaluating Presentations Beyond Text-to-Slidescited by 86
- 2023AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZcited by 79
- 2025AutoPresent: Designing Structured Visuals from Scratchcited by 68
- 2025Paper2Poster: Towards Multimodal Poster Automation from Scientific Paperscited by 63
- 2023DiagrammerGPT: Generating Open-Domain, Open-Platform Diagrams via LLM Planningcited by 29
- 2025SlideGen: Collaborative Multimodal Agents for Scientific Slide Generationcited by 25
- 2024SciDoc2Diagrammer-MAF: Towards Generation of Scientific Diagrams from Documents guided by Multi-Aspect Feedback Refinementcited by 15
- 2025SlideTailor: Personalized Presentation Slide Generation for Scientific Paperscited by 13
- 2025ScholarCopilot: Training Large Language Models for Academic Writing with Accurate Citationscited by 10
- 2025AutoSurvey2: Empowering Researchers with Next Level Automated Literature Surveyscited by 8
- 2025Paper2SysArch: Structure-Constrained System Architecture Generation from Scientific Paperscited by 7
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026PaperBanana: Automating Academic Illustration for AI Scientistscited by 26
- 2026AutoFigure-Edit: Generating Editable Scientific Illustrationcited by 14
- 2026AI for Auto-Research: Roadmap & User Guidecited by 11
- 2026SciFigDetect: A Benchmark for AI-Generated Scientific Figure Detectioncited by 4
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 1
- 2026PPTBench: Can Coding Agents Reconstruct the Visual World through Structured, Editable Slidescited by 1
- 2026DiagramRAG: A Lightweight Framework to Retrieve Scientific Diagram for Figure Generationcited by 0
- 2026One Figure, Every Canvas: Editable Flowchart Relayout via Agentic Pipelinecited by 0
- 2026One Figure, Every Canvas: Editable Flowchart Relayout via Agentic Pipeline5 Oct 2026
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026PPTBench: Can Coding Agents Reconstruct the Visual World through Structured, Editable Slides31 Aug 2026
- 2026DiagramRAG: A Lightweight Framework to Retrieve Scientific Diagram for Figure Generation27 May 2026
- 2026AI for Auto-Research: Roadmap & User Guide18 May 2026
- 2026SciFigDetect: A Benchmark for AI-Generated Scientific Figure Detection9 Apr 2026
- 2026AutoFigure-Edit: Generating Editable Scientific Illustration3 Mar 2026
- 2026PaperBanana: Automating Academic Illustration for AI Scientists30 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026Crafter: A Multi-Agent Harness for Editable Scientific Figure Generation from Diverse Inputs
- 2026AutoFigure: Generating and Refining Publication-Ready Scientific Illustrations
- 2026SciDiagramEdit: Learning to Edit Scientific Diagrams from Paper Revisions
- 2025From Pixels to Paths: A Multi-Agent Framework for Editable Scientific Illustration
- 2026GenGA: Editable and Data-Grounded Graphical Abstract Generation for Academic Papers
- 2026EdiTikZ: Scientific Figure Editing from Revision Trajectories
- 2026GENFIG1: Visual Summaries of Scholarly Work as a Challenge for Vision-Language Models
- 2026SciFigAlign: Scoring Scientific Figures by Fine-tuned Alignment of Visuals with Manuscript Evidence