Leveraging Large Language Models For Scalable Vector Graphics Processing: A Review
Not on the map. Why?
Abstract (arXiv)
In recent years, rapid advances in computer vision have significantly improved the processing and generation of raster images. However, vector graphics, which is essential in digital design, due to its scalability and ease of editing, have been relatively understudied. Traditional vectorization techniques, which are often used in vector generation, suffer from long processing times and excessive output complexity, limiting their usability in practical applications. The advent of large language models (LLMs) has opened new possibilities for the generation, editing, and analysis of vector graphics, particularly in the SVG format, which is inherently text-based and well-suited for integration with LLMs. This paper provides a systematic review of existing LLM-based approaches for SVG processing, categorizing them into three main tasks: generation, editing, and understanding. We observe notable models such as IconShop, StrokeNUWA, and StarVector, highlighting their strengths and limitations. Furthermore, we analyze benchmark datasets designed for assessing SVG-related tasks, including SVGEditBench, VGBench, and SGP-Bench, and conduct a series of experiments to evaluate various LLMs in these domains. Our results demonstrate that for vector graphics reasoning-enhanced models outperform standard LLMs, particularly in generation and understanding tasks. Furthermore, our findings underscore the need to develop more diverse and richly annotated datasets to further improve LLM capabilities in vector graphics tasks.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 31 of its 45 references that are in the map. First posted on arXiv 6 Mar 2025.
Builds on
31 of 45 references.
References · 31
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2017Neural Discrete Representation Learningcited by 4,712
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
- 2024Long-CLIP: Unlocking the Long-Text Capability of CLIPcited by 300
- 2022Versatile Diffusion: Text, Images and Variations All in One Diffusion Modelcited by 199
- 2021CLIPDraw: Exploring Text-to-Drawing Synthesis through Language-Image Encoderscited by 187
19 more
- 2020DeepSVG: A Hierarchical Generative Network for Vector Graphics Animationcited by 159
- 2023GPT-4V(ision) as a Generalist Evaluator for Vision-Language Taskscited by 119
- 2021Im2Vec: Synthesizing Vector Graphics without Vector Supervisioncited by 116
- 2022VectorFusion: Text-to-SVG by Abstracting Pixel-Based Diffusion Modelscited by 112
- 2019A Learned Representation for Scalable Vector Graphicscited by 91
- 2022Towards Layer-wise Image Vectorizationcited by 79
- 2023SVGDreamer: Text Guided SVG Generation with Diffusion Modelcited by 76
- 2023IconShop: Text-Guided Vector Icon Synthesis with Autoregressive Transformerscited by 75
- 2024Empowering LLMs to Understand and Generate Complex Vector Graphicscited by 66
- 2024FLUX: Fast Software-based Communication Overlap On GPUs Through Kernel Fusioncited by 57
- 2019FIGR: Few-shot Image Generation with Reptilecited by 56
- 2024Can Large Language Models Understand Symbolic Graphics Programs?cited by 35
- 2022StyleCLIPDraw: Coupling Content and Style in Text-to-Drawing Translationcited by 28
- 2024StrokeNUWA: Tokenizing Strokes for Vector Graphic Synthesiscited by 26
- 2024SVGEditBench: A Benchmark Dataset for Quantitative Assessment of LLM's SVG Editing Capabilitiescited by 26
- 2024Exploring the Capability of LLMs in Performing Low-Level Visual Analytic Tasks on SVG Data Visualizationscited by 18
- 2023Image Vectorization: a Reviewcited by 7
- 2022Conditional Vector Graphics Generation for Music Cover Imagescited by 5
- 2023Neural Style Transfer for Vector Graphicscited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.