Chat2SVG: Vector Graphics Generation with Large Language Models and Image Diffusion Models
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Scalable Vector Graphics (SVG) has become the de facto standard for vector graphics in digital design, offering resolution independence and precise control over individual elements. Despite their advantages, creating high-quality SVG content remains challenging, as it demands technical expertise with professional editing software and a considerable time investment to craft complex shapes. Recent text-to-SVG generation methods aim to make vector graphics creation more accessible, but they still encounter limitations in shape regularity, generalization ability, and expressiveness. To address these challenges, we introduce Chat2SVG, a hybrid framework that combines the strengths of Large Language Models (LLMs) and image diffusion models for text-to-SVG generation. Our approach first uses an LLM to generate semantically meaningful SVG templates from basic geometric primitives. Guided by image diffusion models, a dual-stage optimization pipeline refines paths in latent space and adjusts point coordinates to enhance geometric complexity. Extensive experiments show that Chat2SVG outperforms existing methods in visual fidelity, path regularity, and semantic alignment. Additionally, our system enables intuitive editing through natural language instructions, making professional vector graphics creation accessible to all users.
Key facts. Cited by 38 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 40 of its 65 references that are in the map. First posted on arXiv 25 Nov 2024.
Builds on
40 of 65 references.
Closest ancestors · 4
Same direction, newest first
- 2023SVGDreamer: Text Guided SVG Generation with Diffusion Model27 Dec
- 2023DiffSketcher: Text Guided Vector Sketch Synthesis through Latent Diffusion Models26 Jun
- 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
- 2022VectorFusion: Text-to-SVG by Abstracting Pixel-Based Diffusion Models21 Nov
Other references · 36
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023GPT-4 Technical Reportcited by 18,396
- 2023Segment Anythingcited by 8,234
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
- 2017A Neural Representation of Sketch Drawingscited by 313
- 2018PU-Net: Point Cloud Upsampling Networkcited by 209
- 2021CLIPDraw: Exploring Text-to-Drawing Synthesis through Language-Image Encoderscited by 187
24 more
- 2023Semantic-SAM: Segment and Recognize Anything at Any Granularitycited by 185
- 2020DeepSVG: A Hierarchical Generative Network for Vector Graphics Animationcited by 159
- 2024GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generationcited by 153
- 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Codecited by 134
- 20233D-GPT: Procedural 3D Modeling with Large Language Modelscited by 95
- 2019A Learned Representation for Scalable Vector Graphicscited by 91
- 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homescited by 82
- 2023AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZcited by 79
- 2020Sketchformer: Transformer-based Representation for Sketched Structurecited by 78
- 2023IconShop: Text-Guided Vector Icon Synthesis with Autoregressive Transformerscited by 75
- 2019FIGR: Few-shot Image Generation with Reptilecited by 56
- 2024Open-Universe Indoor Scene Generation using LLM Program Synthesis and Uncurated Object Databasescited by 45
- 2024PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLMcited by 41
- 2024Graphic Design with Large Multimodal Modelcited by 40
- 2024A Vision Check-up for Language Modelscited by 36
- 2024Text-to-Vector Generation with Neural Path Representationcited by 33
- 2024L3GO: Language Agents with Chain-of-3D-Thoughts for Generating Unconventional Objectscited by 28
- 2023DeepVecFont-v2: Exploiting Transformers to Synthesize Vector Fonts with Higher Qualitycited by 27
- 2024StrokeNUWA: Tokenizing Strokes for Vector Graphic Synthesiscited by 26
- 2024Re-Thinking Inverse Graphics With Large Language Modelscited by 23
- 2024Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLMcited by 21
- 2024SceneMotifCoder: Example-driven Visual Program Learning for Generating 3D Object Arrangementscited by 17
- 2023DualVector: Unsupervised Vector Font Synthesis with Dual-Part Representationcited by 16
- 2024Keyframer: Empowering Animation Design using Large Language Modelscited by 9
Built on by
Citing papers per year: 2025: 13; 2026: 25.
38 papers.
Sort:
By area:
- 2025OmniSVG: A Unified Scalable Vector Graphics Generation Modelcited by 74
- 2025MeshLLM: Empowering Large Language Models to Progressively Understand and Generate 3D Meshcited by 20
- 2025SVGenius: Benchmarking LLMs in SVG Understanding, Editing and Generationcited by 16
- 2025GeoGramBench: Benchmarking the Geometric Program Reasoning in Modern LLMscited by 13
- 2026Render-in-the-Loop: Vector Graphics Generation via Visual Self-Feedbackcited by 12
- 2026EfficientPosterGen: Semantic-aware Efficient Poster Generation via Token Compression and Accurate Violation Detectioncited by 9
- 2025SVGThinker: Instruction-Aligned and Reasoning-Driven Text-to-SVG Generationcited by 8
- 2025DuetSVG: Unified Multimodal SVG Generation with Internal Visual Guidancecited by 8
- 2025Symbolic Graphics Programming with Large Language Modelscited by 7
- 2026VAnim: Rendering-Aware Sparse State Modeling for Structure-Preserving Vector Animationcited by 6
- 2025ViewCraft3D: High-Fidelity and View-Consistent 3D Vector Graphics Synthesiscited by 5
- 2026Automatic Method Illustration Generation for AI Scientific Papers via Drawing Middleware Creation, Evolution, and Orchestrationcited by 5
26 more
- 2026LottieGPT: Tokenizing Vector Animation for Autoregressive Generationcited by 5
- 2025From Pixels to Paths: A Multi-Agent Framework for Editable Scientific Illustrationcited by 4
- 2026IntroSVG: Learning from Rendering Feedback for Text-to-SVG Generation via an Introspective Generator-Critic Frameworkcited by 4
- 2026Stroke of Surprise: Progressive Semantic Illusions in Vector Sketchingcited by 3
- 2026VecGlypher: Unified Vector Glyph Generation with Language Modelscited by 3
- 2026AmodalSVG: Amodal Image Vectorization via Semantic Layer Peelingcited by 3
- 2026Deltaynamics: Language-Based Representation for Inferring Rigid-Body Dynamics From Videoscited by 3
- 2025GeoLoom: High-quality Geometric Diagram Generation from Textual Inputcited by 2
- 2026Unlocking the Latent Canvas: Eliciting and Benchmarking Symbolic Visual Expression in LLMscited by 2
- 2026Figures as Programs: Recursive Generation of Editable Scientific Figurescited by 2
- 2025SVGauge: Towards Human-Aligned Evaluation for SVG Generationcited by 1
- 2026Hierarchical SVG Tokenization: Learning Compact Visual Programs for Scalable Vector Graphics Modelingcited by 1
- 2026mEOL: Training-Free Instruction-Guided Multimodal Embedder for Vector Graphics and Image Retrievalcited by 1
- 2026AnchorFlow: Learning Anchor Placement for Faithful and Editable SVG Reconstructioncited by 1
- 2026Math-Vision Diagrams: A Comprehensive Benchmark for Evaluating LLM Mathematical Diagram Generation Capabilitiescited by 1
- 2026EdiTikZ: Scientific Figure Editing from Revision Trajectoriescited by 1
- 2026PPTBench: Can Coding Agents Reconstruct the Visual World through Structured, Editable Slidescited by 1
- 2025See it. Say it. Sorted: Agentic System for Compositional Diagram Generationcited by 0
- 2025Bridging Vision, Language, and Mathematics: Pictographic Character Reconstruction with B'ezier Curvescited by 0
- 2026CANVAS: Consistency-Aware Navigation via Visual Adaptive Sampling for Long-Context Text-to-SVG Generationcited by 0
- 2026SVG-Score: Human-Aligned Evaluation of Text-to-SVG Generationcited by 0
- 2026VectorHarness: Recovering Editable, Relation-Preserving Structure from Scientific Graphicscited by 0
- 2026Math2Visual-X: A Modular Framework for Pedagogically Aligned Lower-Primary Math Visuals Generationcited by 0
- 2026MatLoom: Layered Text-to-Material Generation in a Compact Program Spacecited by 0
- 2026Beyond Plausibility: Verifiable Fine-Grained Image Editing on Structured Assetscited by 0
- 2026LayerCanvas: Infographic Generation in AI Learning Assistants via Hybrid Layer-Set Diffusioncited by 0
- 2026LayerCanvas: Infographic Generation in AI Learning Assistants via Hybrid Layer-Set Diffusion13 Oct 2026
- 2026Beyond Plausibility: Verifiable Fine-Grained Image Editing on Structured Assets3 Oct 2026
- 2026MatLoom: Layered Text-to-Material Generation in a Compact Program Space30 Sep 2026
- 2026Math2Visual-X: A Modular Framework for Pedagogically Aligned Lower-Primary Math Visuals Generation18 Sep 2026
- 2026VectorHarness: Recovering Editable, Relation-Preserving Structure from Scientific Graphics9 Sep 2026
- 2026SVG-Score: Human-Aligned Evaluation of Text-to-SVG Generation3 Sep 2026
- 2026EdiTikZ: Scientific Figure Editing from Revision Trajectories1 Sep 2026
- 2026Figures as Programs: Recursive Generation of Editable Scientific Figures1 Sep 2026
- 2026PPTBench: Can Coding Agents Reconstruct the Visual World through Structured, Editable Slides31 Aug 2026
- 2026CANVAS: Consistency-Aware Navigation via Visual Adaptive Sampling for Long-Context Text-to-SVG Generation31 Aug 2026
- 2026Math-Vision Diagrams: A Comprehensive Benchmark for Evaluating LLM Mathematical Diagram Generation Capabilities9 Aug 2026
- 2026Deltaynamics: Language-Based Representation for Inferring Rigid-Body Dynamics From Videos20 May 2026
26 more
- 2026AnchorFlow: Learning Anchor Placement for Faithful and Editable SVG Reconstruction19 May 2026
- 2026VAnim: Rendering-Aware Sparse State Modeling for Structure-Preserving Vector Animation2 May 2026
- 2026Render-in-the-Loop: Vector Graphics Generation via Visual Self-Feedback22 Apr 2026
- 2026mEOL: Training-Free Instruction-Guided Multimodal Embedder for Vector Graphics and Image Retrieval18 Apr 2026
- 2026LottieGPT: Tokenizing Vector Animation for Autoregressive Generation13 Apr 2026
- 2026AmodalSVG: Amodal Image Vectorization via Semantic Layer Peeling13 Apr 2026
- 2026Hierarchical SVG Tokenization: Learning Compact Visual Programs for Scalable Vector Graphics Modeling6 Apr 2026
- 2026Unlocking the Latent Canvas: Eliciting and Benchmarking Symbolic Visual Expression in LLMs15 Mar 2026
- 2026IntroSVG: Learning from Rendering Feedback for Text-to-SVG Generation via an Introspective Generator-Critic Framework10 Mar 2026
- 2026EfficientPosterGen: Semantic-aware Efficient Poster Generation via Token Compression and Accurate Violation Detection25 Feb 2026
- 2026VecGlypher: Unified Vector Glyph Generation with Language Models25 Feb 2026
- 2026Stroke of Surprise: Progressive Semantic Illusions in Vector Sketching12 Feb 2026
- 2026Automatic Method Illustration Generation for AI Scientific Papers via Drawing Middleware Creation, Evolution, and Orchestration6 Feb 2026
- 2025DuetSVG: Unified Multimodal SVG Generation with Internal Visual Guidance11 Dec 2025
- 2025GeoLoom: High-quality Geometric Diagram Generation from Textual Input9 Dec 2025
- 2025From Pixels to Paths: A Multi-Agent Framework for Editable Scientific Illustration31 Oct 2025
- 2025Bridging Vision, Language, and Mathematics: Pictographic Character Reconstruction with B'ezier Curves29 Oct 2025
- 2025SVGThinker: Instruction-Aligned and Reasoning-Driven Text-to-SVG Generation29 Sep 2025
- 2025SVGauge: Towards Human-Aligned Evaluation for SVG Generation8 Sep 2025
- 2025Symbolic Graphics Programming with Large Language Models5 Sep 2025
- 2025See it. Say it. Sorted: Agentic System for Compositional Diagram Generation21 Aug 2025
- 2025MeshLLM: Empowering Large Language Models to Progressively Understand and Generate 3D Mesh2 Aug 2025
- 2025SVGenius: Benchmarking LLMs in SVG Understanding, Editing and Generation3 Jun 2025
- 2025ViewCraft3D: High-Fidelity and View-Consistent 3D Vector Graphics Synthesis26 May 2025
- 2025GeoGramBench: Benchmarking the Geometric Program Reasoning in Modern LLMs23 May 2025
- 2025OmniSVG: A Unified Scalable Vector Graphics Generation Model8 Apr 2025
- 2025SVGenius: Benchmarking LLMs in SVG Understanding, Editing and Generationcited by 16
- 2026Render-in-the-Loop: Vector Graphics Generation via Visual Self-Feedbackcited by 12
- 2025DuetSVG: Unified Multimodal SVG Generation with Internal Visual Guidancecited by 8
- 2026EdiTikZ: Scientific Figure Editing from Revision Trajectoriescited by 1
- 2025Bridging Vision, Language, and Mathematics: Pictographic Character Reconstruction with B'ezier Curvescited by 0
- 2026EdiTikZ: Scientific Figure Editing from Revision Trajectories1 Sep 2026
- 2026Render-in-the-Loop: Vector Graphics Generation via Visual Self-Feedback22 Apr 2026
- 2025DuetSVG: Unified Multimodal SVG Generation with Internal Visual Guidance11 Dec 2025
- 2025Bridging Vision, Language, and Mathematics: Pictographic Character Reconstruction with B'ezier Curves29 Oct 2025
- 2025SVGenius: Benchmarking LLMs in SVG Understanding, Editing and Generation3 Jun 2025
- 2025OmniSVG: A Unified Scalable Vector Graphics Generation Modelcited by 74
- 2025MeshLLM: Empowering Large Language Models to Progressively Understand and Generate 3D Meshcited by 20
- 2025Symbolic Graphics Programming with Large Language Modelscited by 7
- 2026VAnim: Rendering-Aware Sparse State Modeling for Structure-Preserving Vector Animationcited by 6
- 2025ViewCraft3D: High-Fidelity and View-Consistent 3D Vector Graphics Synthesiscited by 5
- 2026Automatic Method Illustration Generation for AI Scientific Papers via Drawing Middleware Creation, Evolution, and Orchestrationcited by 5
- 2026LottieGPT: Tokenizing Vector Animation for Autoregressive Generationcited by 5
- 2026Stroke of Surprise: Progressive Semantic Illusions in Vector Sketchingcited by 3
- 2026VecGlypher: Unified Vector Glyph Generation with Language Modelscited by 3
- 2026AmodalSVG: Amodal Image Vectorization via Semantic Layer Peelingcited by 3
- 2026Deltaynamics: Language-Based Representation for Inferring Rigid-Body Dynamics From Videoscited by 3
- 2025GeoLoom: High-quality Geometric Diagram Generation from Textual Inputcited by 2
12 most cited of 24 All 24 (JSON)
- 2026Beyond Plausibility: Verifiable Fine-Grained Image Editing on Structured Assets3 Oct 2026
- 2026MatLoom: Layered Text-to-Material Generation in a Compact Program Space30 Sep 2026
- 2026Math2Visual-X: A Modular Framework for Pedagogically Aligned Lower-Primary Math Visuals Generation18 Sep 2026
- 2026VectorHarness: Recovering Editable, Relation-Preserving Structure from Scientific Graphics9 Sep 2026
- 2026Figures as Programs: Recursive Generation of Editable Scientific Figures1 Sep 2026
- 2026CANVAS: Consistency-Aware Navigation via Visual Adaptive Sampling for Long-Context Text-to-SVG Generation31 Aug 2026
- 2026Math-Vision Diagrams: A Comprehensive Benchmark for Evaluating LLM Mathematical Diagram Generation Capabilities9 Aug 2026
- 2026Deltaynamics: Language-Based Representation for Inferring Rigid-Body Dynamics From Videos20 May 2026
- 2026AnchorFlow: Learning Anchor Placement for Faithful and Editable SVG Reconstruction19 May 2026
- 2026VAnim: Rendering-Aware Sparse State Modeling for Structure-Preserving Vector Animation2 May 2026
- 2026mEOL: Training-Free Instruction-Guided Multimodal Embedder for Vector Graphics and Image Retrieval18 Apr 2026
- 2026LottieGPT: Tokenizing Vector Animation for Autoregressive Generation13 Apr 2026
12 newest of 24 All 24 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025SVGen: Interpretable Vector Graphics Generation with Large Language Models
- 2025Style Customization of Text-to-Vector Generation with Image Diffusion Priors
- 2026VectorGym: A Multi-Task Benchmark for SVG Code Generation, Sketching and Editing
- 2024CraftSVG: Multi-Object Text-to-SVG Synthesis via Layout Guided Diffusion
- 2024SVGFusion: A VAE-Diffusion Transformer for Vector Graphic Generation
- 2023StarVector: Generating Scalable Vector Graphics Code from Images and Text
- 2023Beyond Pixels: Exploring Human-Readable SVG Generation for Simple Images with Vision Language Models
- 2025UniSVG: A Unified Dataset for Vector Graphic Understanding and Generation with Multimodal Large Language Models