SVGEditBench: A Benchmark Dataset for Quantitative Assessment of LLM's SVG Editing Capabilities
Not on the map. Why?
Abstract (arXiv)
Text-to-image models have shown progress in recent years. Along with this progress, generating vector graphics from text has also advanced. SVG is a popular format for vector graphics, and SVG represents a scene with XML text. Therefore, Large Language Models can directly process SVG code. Taking this into account, we focused on editing SVG with LLMs. For quantitative evaluation of LLMs' ability to edit SVG, we propose SVGEditBench. SVGEditBench is a benchmark for assessing the LLMs' ability to edit SVG code. We also show the GPT-4 and GPT-3.5 results when evaluated on the proposed benchmark. In the experiments, GPT-4 showed superior performance to GPT-3.5 both quantitatively and qualitatively. The dataset is available at https://github.com/mti-lab/SVGEditBench.
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Builds on 17 of its 30 references that are in the map. First posted on arXiv 21 Apr 2024.
Builds on
17 of 30 references.
References · 17
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2023StarCoder: may the source be with you!cited by 799
- 2021Im2Vec: Synthesizing Vector Graphics without Vector Supervisioncited by 116
- 2022VectorFusion: Text-to-SVG by Abstracting Pixel-Based Diffusion Modelscited by 112
- 2022Towards Layer-wise Image Vectorizationcited by 79
5 more
- 2023SVGDreamer: Text Guided SVG Generation with Diffusion Modelcited by 76
- 2023IconShop: Text-Guided Vector Icon Synthesis with Autoregressive Transformerscited by 75
- 2024StrokeNUWA: Tokenizing Strokes for Vector Graphic Synthesiscited by 26
- 2023Beyond Pixels: Exploring Human-Readable SVG Generation for Simple Images with Vision Language Modelscited by 8
- 2023Text-Guided Vector Graphics Customizationcited by 5
Built on by
Citing papers per year: 2024: 2; 2025: 11; 2026: 13.
26 papers.
Sort:
By area:
- 2024SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?cited by 203
- 2025SlideCoder: Layout-aware RAG-enhanced Hierarchical Slide Generation from Designcited by 24
- 2024Plot2Code: A Comprehensive Benchmark for Evaluating Multi-modal Large Language Models in Code Generation from Scientific Plotscited by 21
- 2025SVGenius: Benchmarking LLMs in SVG Understanding, Editing and Generationcited by 16
- 2025UniSVG: A Unified Dataset for Vector Graphic Understanding and Generation with Multimodal Large Language Modelscited by 15
- 2025InternSVG: Towards Unified SVG Tasks with Multimodal Large Language Modelscited by 14
- 2025JanusCoder: Towards a Foundational Visual-Programmatic Interface for Code Intelligencecited by 9
- 2026EfficientPosterGen: Semantic-aware Efficient Poster Generation via Token Compression and Accurate Violation Detectioncited by 9
- 2026LLMs Corrupt Your Documents When You Delegatecited by 9
- 2026VCG-Bench: Towards A Unified Visual-Centric Benchmark for Structured Generation and Editingcited by 9
- 2025Symbolic Graphics Programming with Large Language Modelscited by 7
- 2025From Text to Visuals: Using LLMs to Generate Math Diagrams with Vector Graphicscited by 6
14 more
- 2025VectorEdits: A Dataset and Benchmark for Instruction-Based Editing of Vector Graphicscited by 5
- 2026VectorGym: A Multi-Task Benchmark for SVG Code Generation, Sketching and Editingcited by 5
- 2026LottieGPT: Tokenizing Vector Animation for Autoregressive Generationcited by 5
- 2025From Pixels to Paths: A Multi-Agent Framework for Editable Scientific Illustrationcited by 4
- 2026IntroSVG: Learning from Rendering Feedback for Text-to-SVG Generation via an Introspective Generator-Critic Frameworkcited by 4
- 2026VisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback?cited by 4
- 2025Leveraging Large Language Models For Scalable Vector Graphics Processing: A Reviewcited by 3
- 2025AutoSketch: VLM-assisted Style-Aware Vector Sketch Completioncited by 2
- 2026GeoSVG-RL: Geometry-Aware Reinforcement Learning for Layout-Constrained Text-to-SVG Diagram Generationcited by 2
- 2026Vector-Bench: Can Models Surgically Edit SVG Code?cited by 1
- 2026DrawAI: Agentic Benchmark and Workflow for Making Raster Images Editablecited by 1
- 2026VecFontLLM: Anchor-Guided Direct Synthesis of Chinese Vector Fontscited by 0
- 2026SVG-Score: Human-Aligned Evaluation of Text-to-SVG Generationcited by 0
- 2026PrismaCoder: Pushing the Boundaries of Open Multimodal Code Intelligence through Decomposed Rubric Synthesiscited by 0
- 2026PrismaCoder: Pushing the Boundaries of Open Multimodal Code Intelligence through Decomposed Rubric Synthesis14 Oct 2026
- 2026SVG-Score: Human-Aligned Evaluation of Text-to-SVG Generation3 Sep 2026
- 2026VisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback?11 Aug 2026
- 2026DrawAI: Agentic Benchmark and Workflow for Making Raster Images Editable1 Aug 2026
- 2026Vector-Bench: Can Models Surgically Edit SVG Code?21 Jul 2026
- 2026VecFontLLM: Anchor-Guided Direct Synthesis of Chinese Vector Fonts19 Jul 2026
- 2026GeoSVG-RL: Geometry-Aware Reinforcement Learning for Layout-Constrained Text-to-SVG Diagram Generation25 May 2026
- 2026VCG-Bench: Towards A Unified Visual-Centric Benchmark for Structured Generation and Editing15 May 2026
- 2026LLMs Corrupt Your Documents When You Delegate17 Apr 2026
- 2026LottieGPT: Tokenizing Vector Animation for Autoregressive Generation13 Apr 2026
- 2026IntroSVG: Learning from Rendering Feedback for Text-to-SVG Generation via an Introspective Generator-Critic Framework10 Mar 2026
- 2026EfficientPosterGen: Semantic-aware Efficient Poster Generation via Token Compression and Accurate Violation Detection25 Feb 2026
14 more
- 2026VectorGym: A Multi-Task Benchmark for SVG Code Generation, Sketching and Editing22 Feb 2026
- 2025From Pixels to Paths: A Multi-Agent Framework for Editable Scientific Illustration31 Oct 2025
- 2025JanusCoder: Towards a Foundational Visual-Programmatic Interface for Code Intelligence27 Oct 2025
- 2025InternSVG: Towards Unified SVG Tasks with Multimodal Large Language Models13 Oct 2025
- 2025Symbolic Graphics Programming with Large Language Models5 Sep 2025
- 2025UniSVG: A Unified Dataset for Vector Graphic Understanding and Generation with Multimodal Large Language Models11 Aug 2025
- 2025VectorEdits: A Dataset and Benchmark for Instruction-Based Editing of Vector Graphics18 Jun 2025
- 2025SlideCoder: Layout-aware RAG-enhanced Hierarchical Slide Generation from Design9 Jun 2025
- 2025SVGenius: Benchmarking LLMs in SVG Understanding, Editing and Generation3 Jun 2025
- 2025From Text to Visuals: Using LLMs to Generate Math Diagrams with Vector Graphics10 Mar 2025
- 2025Leveraging Large Language Models For Scalable Vector Graphics Processing: A Review6 Mar 2025
- 2025AutoSketch: VLM-assisted Style-Aware Vector Sketch Completion7 Feb 2025
- 2024SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?4 Oct 2024
- 2024Plot2Code: A Comprehensive Benchmark for Evaluating Multi-modal Large Language Models in Code Generation from Scientific Plots13 May 2024
- 2024Plot2Code: A Comprehensive Benchmark for Evaluating Multi-modal Large Language Models in Code Generation from Scientific Plotscited by 21
- 2025SVGenius: Benchmarking LLMs in SVG Understanding, Editing and Generationcited by 16
- 2025UniSVG: A Unified Dataset for Vector Graphic Understanding and Generation with Multimodal Large Language Modelscited by 15
- 2025InternSVG: Towards Unified SVG Tasks with Multimodal Large Language Modelscited by 14
- 2026VCG-Bench: Towards A Unified Visual-Centric Benchmark for Structured Generation and Editingcited by 9
- 2026VisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback?cited by 4
- 2026VisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback?11 Aug 2026
- 2026VCG-Bench: Towards A Unified Visual-Centric Benchmark for Structured Generation and Editing15 May 2026
- 2025InternSVG: Towards Unified SVG Tasks with Multimodal Large Language Models13 Oct 2025
- 2025UniSVG: A Unified Dataset for Vector Graphic Understanding and Generation with Multimodal Large Language Models11 Aug 2025
- 2025SVGenius: Benchmarking LLMs in SVG Understanding, Editing and Generation3 Jun 2025
- 2024Plot2Code: A Comprehensive Benchmark for Evaluating Multi-modal Large Language Models in Code Generation from Scientific Plots13 May 2024
- 2024SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?cited by 203
- 2025SlideCoder: Layout-aware RAG-enhanced Hierarchical Slide Generation from Designcited by 24
- 2025JanusCoder: Towards a Foundational Visual-Programmatic Interface for Code Intelligencecited by 9
- 2026LLMs Corrupt Your Documents When You Delegatecited by 9
- 2025Symbolic Graphics Programming with Large Language Modelscited by 7
- 2025From Text to Visuals: Using LLMs to Generate Math Diagrams with Vector Graphicscited by 6
- 2025VectorEdits: A Dataset and Benchmark for Instruction-Based Editing of Vector Graphicscited by 5
- 2026VectorGym: A Multi-Task Benchmark for SVG Code Generation, Sketching and Editingcited by 5
- 2026LottieGPT: Tokenizing Vector Animation for Autoregressive Generationcited by 5
- 2025Leveraging Large Language Models For Scalable Vector Graphics Processing: A Reviewcited by 3
- 2025AutoSketch: VLM-assisted Style-Aware Vector Sketch Completioncited by 2
- 2026Vector-Bench: Can Models Surgically Edit SVG Code?cited by 1
12 most cited of 14 All 14 (JSON)
- 2026PrismaCoder: Pushing the Boundaries of Open Multimodal Code Intelligence through Decomposed Rubric Synthesis14 Oct 2026
- 2026Vector-Bench: Can Models Surgically Edit SVG Code?21 Jul 2026
- 2026VecFontLLM: Anchor-Guided Direct Synthesis of Chinese Vector Fonts19 Jul 2026
- 2026LLMs Corrupt Your Documents When You Delegate17 Apr 2026
- 2026LottieGPT: Tokenizing Vector Animation for Autoregressive Generation13 Apr 2026
- 2026VectorGym: A Multi-Task Benchmark for SVG Code Generation, Sketching and Editing22 Feb 2026
- 2025JanusCoder: Towards a Foundational Visual-Programmatic Interface for Code Intelligence27 Oct 2025
- 2025Symbolic Graphics Programming with Large Language Models5 Sep 2025
- 2025VectorEdits: A Dataset and Benchmark for Instruction-Based Editing of Vector Graphics18 Jun 2025
- 2025SlideCoder: Layout-aware RAG-enhanced Hierarchical Slide Generation from Design9 Jun 2025
- 2025From Text to Visuals: Using LLMs to Generate Math Diagrams with Vector Graphics10 Mar 2025
- 2025Leveraging Large Language Models For Scalable Vector Graphics Processing: A Review6 Mar 2025
12 newest of 14 All 14 (JSON)