FigGen: Text to Scientific Figure Generation
Not on the map. Why?
Abstract (arXiv)
The generative modeling landscape has experienced tremendous growth in recent years, particularly in generating natural images and art. Recent techniques have shown impressive potential in creating complex visual compositions while delivering impressive realism and quality. However, state-of-the-art methods have been focusing on the narrow domain of natural images, while other distributions remain unexplored. In this paper, we introduce the problem of text-to-figure generation, that is creating scientific figures of papers from text descriptions. We present FigGen, a diffusion-based approach for text-to-figure as well as the main challenges of the proposed task. Code and models are available at https://github.com/joanrod/figure-diffusion
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 19 of its 21 references that are in the map. First posted on arXiv 1 Jun 2023.
Builds on
19 of 21 references.
References · 19
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022Classifier-Free Diffusion Guidancecited by 5,847
7 more
- 2022Generative Adversarial Networkscited by 5,627
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2021Alias-Free Generative Adversarial Networkscited by 1,184
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 931
- 2022OCR-VQGAN: Taming Text-within-Image Generationcited by 31
- 2023Beyond Statistical Similarity: Rethinking Metrics for Deep Generative Models in Engineering Designcited by 23
Built on by
Citing papers per year: 2023: 3; 2024: 0; 2025: 4; 2026: 10.
17 papers.
Sort:
By area:
- 2023StarVector: Generating Scalable Vector Graphics Code from Images and Textcited by 102
- 2023AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZcited by 79
- 2023Advancements in Generative AI: A Comprehensive Review of GANs, GPT, Autoencoders, Diffusion Model, and Transformerscited by 36
- 2026PaperBanana: Automating Academic Illustration for AI Scientistscited by 26
- 2025TikZero: Zero-Shot Text-Guided Graphics Program Synthesiscited by 24
- 2025SVGen: Interpretable Vector Graphics Generation with Large Language Modelscited by 14
- 2026TikZilla: Scaling Text-to-TikZ with High-Quality Data and Reinforcement Learningcited by 7
- 2026Automatic Method Illustration Generation for AI Scientific Papers via Drawing Middleware Creation, Evolution, and Orchestrationcited by 5
- 2026VectorGym: A Multi-Task Benchmark for SVG Code Generation, Sketching and Editingcited by 5
- 2025SciGA: A Comprehensive Dataset for Designing Graphical Abstracts in Academic Paperscited by 2
- 2025TechImage-Bench: Rubric-Based Evaluation for Technical Image Generationcited by 2
- 2026GENFIG1: Visual Summaries of Scholarly Work as a Challenge for Vision-Language Modelscited by 2
5 more
- 2026Text2Arch: A Dataset for Generating Scientific Architecture Diagrams from Natural Language Descriptionscited by 1
- 2026SciForma: Structure-Faithful Generation of Scientific Diagramscited by 1
- 2026GenGA: Editable and Data-Grounded Graphical Abstract Generation for Academic Paperscited by 0
- 2026Back2Struct: Making Structured Images Editable Againcited by 0
- 2026One Figure, Every Canvas: Editable Flowchart Relayout via Agentic Pipelinecited by 0
- 2026One Figure, Every Canvas: Editable Flowchart Relayout via Agentic Pipeline5 Oct 2026
- 2026Back2Struct: Making Structured Images Editable Again29 Sep 2026
- 2026GenGA: Editable and Data-Grounded Graphical Abstract Generation for Academic Papers5 Aug 2026
- 2026SciForma: Structure-Faithful Generation of Scientific Diagrams20 Jul 2026
- 2026Text2Arch: A Dataset for Generating Scientific Architecture Diagrams from Natural Language Descriptions16 Apr 2026
- 2026GENFIG1: Visual Summaries of Scholarly Work as a Challenge for Vision-Language Models5 Apr 2026
- 2026TikZilla: Scaling Text-to-TikZ with High-Quality Data and Reinforcement Learning3 Mar 2026
- 2026VectorGym: A Multi-Task Benchmark for SVG Code Generation, Sketching and Editing22 Feb 2026
- 2026Automatic Method Illustration Generation for AI Scientific Papers via Drawing Middleware Creation, Evolution, and Orchestration6 Feb 2026
- 2026PaperBanana: Automating Academic Illustration for AI Scientists30 Jan 2026
- 2025TechImage-Bench: Rubric-Based Evaluation for Technical Image Generation13 Dec 2025
- 2025SVGen: Interpretable Vector Graphics Generation with Large Language Models6 Aug 2025
5 more
- 2025SciGA: A Comprehensive Dataset for Designing Graphical Abstracts in Academic Papers3 Jul 2025
- 2025TikZero: Zero-Shot Text-Guided Graphics Program Synthesis14 Mar 2025
- 2023StarVector: Generating Scalable Vector Graphics Code from Images and Text17 Dec 2023
- 2023Advancements in Generative AI: A Comprehensive Review of GANs, GPT, Autoencoders, Diffusion Model, and Transformers17 Nov 2023
- 2023AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZ30 Sep 2023
- 2023StarVector: Generating Scalable Vector Graphics Code from Images and Textcited by 102
- 2023AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZcited by 79
- 2026PaperBanana: Automating Academic Illustration for AI Scientistscited by 26
- 2025TikZero: Zero-Shot Text-Guided Graphics Program Synthesiscited by 24
- 2025SVGen: Interpretable Vector Graphics Generation with Large Language Modelscited by 14
- 2026Automatic Method Illustration Generation for AI Scientific Papers via Drawing Middleware Creation, Evolution, and Orchestrationcited by 5
- 2026VectorGym: A Multi-Task Benchmark for SVG Code Generation, Sketching and Editingcited by 5
- 2025SciGA: A Comprehensive Dataset for Designing Graphical Abstracts in Academic Paperscited by 2
- 2025TechImage-Bench: Rubric-Based Evaluation for Technical Image Generationcited by 2
- 2026Text2Arch: A Dataset for Generating Scientific Architecture Diagrams from Natural Language Descriptionscited by 1
- 2026SciForma: Structure-Faithful Generation of Scientific Diagramscited by 1
- 2026GenGA: Editable and Data-Grounded Graphical Abstract Generation for Academic Paperscited by 0
12 most cited of 13 All 13 (JSON)
- 2026Back2Struct: Making Structured Images Editable Again29 Sep 2026
- 2026GenGA: Editable and Data-Grounded Graphical Abstract Generation for Academic Papers5 Aug 2026
- 2026SciForma: Structure-Faithful Generation of Scientific Diagrams20 Jul 2026
- 2026Text2Arch: A Dataset for Generating Scientific Architecture Diagrams from Natural Language Descriptions16 Apr 2026
- 2026VectorGym: A Multi-Task Benchmark for SVG Code Generation, Sketching and Editing22 Feb 2026
- 2026Automatic Method Illustration Generation for AI Scientific Papers via Drawing Middleware Creation, Evolution, and Orchestration6 Feb 2026
- 2026PaperBanana: Automating Academic Illustration for AI Scientists30 Jan 2026
- 2025TechImage-Bench: Rubric-Based Evaluation for Technical Image Generation13 Dec 2025
- 2025SVGen: Interpretable Vector Graphics Generation with Large Language Models6 Aug 2025
- 2025SciGA: A Comprehensive Dataset for Designing Graphical Abstracts in Academic Papers3 Jul 2025
- 2025TikZero: Zero-Shot Text-Guided Graphics Program Synthesis14 Mar 2025
- 2023StarVector: Generating Scalable Vector Graphics Code from Images and Text17 Dec 2023
12 newest of 13 All 13 (JSON)