mlsanityData to 14 Oct 2026

Chat2SVG: Vector Graphics Generation with Large Language Models and Image Diffusion Models

arXiv 2411.16602 ↗First posted 25 Nov 2024cs.CV cs.GRcited by 38

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Scalable Vector Graphics (SVG) has become the de facto standard for vector graphics in digital design, offering resolution independence and precise control over individual elements. Despite their advantages, creating high-quality SVG content remains challenging, as it demands technical expertise with professional editing software and a considerable time investment to craft complex shapes. Recent text-to-SVG generation methods aim to make vector graphics creation more accessible, but they still encounter limitations in shape regularity, generalization ability, and expressiveness. To address these challenges, we introduce Chat2SVG, a hybrid framework that combines the strengths of Large Language Models (LLMs) and image diffusion models for text-to-SVG generation. Our approach first uses an LLM to generate semantically meaningful SVG templates from basic geometric primitives. Guided by image diffusion models, a dual-stage optimization pipeline refines paths in latent space and adjusts point coordinates to enhance geometric complexity. Extensive experiments show that Chat2SVG outperforms existing methods in visual fidelity, path regularity, and semantic alignment. Additionally, our system enables intuitive editing through natural language instructions, making professional vector graphics creation accessible to all users.

Key facts. Cited by 38 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 40 of its 65 references that are in the map. First posted on arXiv 25 Nov 2024.

Builds on

40 of 65 references.

Closest ancestors · 4

Same direction, newest first

  1. 2023SVGDreamer: Text Guided SVG Generation with Diffusion Model27 Dec
  2. 2023DiffSketcher: Text Guided Vector Sketch Synthesis through Latent Diffusion Models26 Jun
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
  4. 2022VectorFusion: Text-to-SVG by Abstracting Pixel-Based Diffusion Models21 Nov

Other references · 36

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2023Segment Anythingcited by 8,234
  5. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  6. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  7. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
  8. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
  9. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
  10. 2017A Neural Representation of Sketch Drawingscited by 313
  11. 2018PU-Net: Point Cloud Upsampling Networkcited by 209
  12. 2021CLIPDraw: Exploring Text-to-Drawing Synthesis through Language-Image Encoderscited by 187
24 more
  1. 2023Semantic-SAM: Segment and Recognize Anything at Any Granularitycited by 185
  2. 2020DeepSVG: A Hierarchical Generative Network for Vector Graphics Animationcited by 159
  3. 2024GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generationcited by 153
  4. 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Codecited by 134
  5. 20233D-GPT: Procedural 3D Modeling with Large Language Modelscited by 95
  6. 2019A Learned Representation for Scalable Vector Graphicscited by 91
  7. 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homescited by 82
  8. 2023AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZcited by 79
  9. 2020Sketchformer: Transformer-based Representation for Sketched Structurecited by 78
  10. 2023IconShop: Text-Guided Vector Icon Synthesis with Autoregressive Transformerscited by 75
  11. 2019FIGR: Few-shot Image Generation with Reptilecited by 56
  12. 2024Open-Universe Indoor Scene Generation using LLM Program Synthesis and Uncurated Object Databasescited by 45
  13. 2024PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLMcited by 41
  14. 2024Graphic Design with Large Multimodal Modelcited by 40
  15. 2024A Vision Check-up for Language Modelscited by 36
  16. 2024Text-to-Vector Generation with Neural Path Representationcited by 33
  17. 2024L3GO: Language Agents with Chain-of-3D-Thoughts for Generating Unconventional Objectscited by 28
  18. 2023DeepVecFont-v2: Exploiting Transformers to Synthesize Vector Fonts with Higher Qualitycited by 27
  19. 2024StrokeNUWA: Tokenizing Strokes for Vector Graphic Synthesiscited by 26
  20. 2024Re-Thinking Inverse Graphics With Large Language Modelscited by 23
  21. 2024Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLMcited by 21
  22. 2024SceneMotifCoder: Example-driven Visual Program Learning for Generating 3D Object Arrangementscited by 17
  23. 2023DualVector: Unsupervised Vector Font Synthesis with Dual-Part Representationcited by 16
  24. 2024Keyframer: Empowering Animation Design using Large Language Modelscited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 13; 2026: 25.

38 papers.

Sort:

By area:

  1. 2025OmniSVG: A Unified Scalable Vector Graphics Generation Modelcited by 74
  2. 2025MeshLLM: Empowering Large Language Models to Progressively Understand and Generate 3D Meshcited by 20
  3. 2025SVGenius: Benchmarking LLMs in SVG Understanding, Editing and Generationcited by 16
  4. 2025GeoGramBench: Benchmarking the Geometric Program Reasoning in Modern LLMscited by 13
  5. 2026Render-in-the-Loop: Vector Graphics Generation via Visual Self-Feedbackcited by 12
  6. 2026EfficientPosterGen: Semantic-aware Efficient Poster Generation via Token Compression and Accurate Violation Detectioncited by 9
  7. 2025SVGThinker: Instruction-Aligned and Reasoning-Driven Text-to-SVG Generationcited by 8
  8. 2025DuetSVG: Unified Multimodal SVG Generation with Internal Visual Guidancecited by 8
  9. 2025Symbolic Graphics Programming with Large Language Modelscited by 7
  10. 2026VAnim: Rendering-Aware Sparse State Modeling for Structure-Preserving Vector Animationcited by 6
  11. 2025ViewCraft3D: High-Fidelity and View-Consistent 3D Vector Graphics Synthesiscited by 5
  12. 2026Automatic Method Illustration Generation for AI Scientific Papers via Drawing Middleware Creation, Evolution, and Orchestrationcited by 5
26 more
  1. 2026LottieGPT: Tokenizing Vector Animation for Autoregressive Generationcited by 5
  2. 2025From Pixels to Paths: A Multi-Agent Framework for Editable Scientific Illustrationcited by 4
  3. 2026IntroSVG: Learning from Rendering Feedback for Text-to-SVG Generation via an Introspective Generator-Critic Frameworkcited by 4
  4. 2026Stroke of Surprise: Progressive Semantic Illusions in Vector Sketchingcited by 3
  5. 2026VecGlypher: Unified Vector Glyph Generation with Language Modelscited by 3
  6. 2026AmodalSVG: Amodal Image Vectorization via Semantic Layer Peelingcited by 3
  7. 2026Deltaynamics: Language-Based Representation for Inferring Rigid-Body Dynamics From Videoscited by 3
  8. 2025GeoLoom: High-quality Geometric Diagram Generation from Textual Inputcited by 2
  9. 2026Unlocking the Latent Canvas: Eliciting and Benchmarking Symbolic Visual Expression in LLMscited by 2
  10. 2026Figures as Programs: Recursive Generation of Editable Scientific Figurescited by 2
  11. 2025SVGauge: Towards Human-Aligned Evaluation for SVG Generationcited by 1
  12. 2026Hierarchical SVG Tokenization: Learning Compact Visual Programs for Scalable Vector Graphics Modelingcited by 1
  13. 2026mEOL: Training-Free Instruction-Guided Multimodal Embedder for Vector Graphics and Image Retrievalcited by 1
  14. 2026AnchorFlow: Learning Anchor Placement for Faithful and Editable SVG Reconstructioncited by 1
  15. 2026Math-Vision Diagrams: A Comprehensive Benchmark for Evaluating LLM Mathematical Diagram Generation Capabilitiescited by 1
  16. 2026EdiTikZ: Scientific Figure Editing from Revision Trajectoriescited by 1
  17. 2026PPTBench: Can Coding Agents Reconstruct the Visual World through Structured, Editable Slidescited by 1
  18. 2025See it. Say it. Sorted: Agentic System for Compositional Diagram Generationcited by 0
  19. 2025Bridging Vision, Language, and Mathematics: Pictographic Character Reconstruction with B'ezier Curvescited by 0
  20. 2026CANVAS: Consistency-Aware Navigation via Visual Adaptive Sampling for Long-Context Text-to-SVG Generationcited by 0
  21. 2026SVG-Score: Human-Aligned Evaluation of Text-to-SVG Generationcited by 0
  22. 2026VectorHarness: Recovering Editable, Relation-Preserving Structure from Scientific Graphicscited by 0
  23. 2026Math2Visual-X: A Modular Framework for Pedagogically Aligned Lower-Primary Math Visuals Generationcited by 0
  24. 2026MatLoom: Layered Text-to-Material Generation in a Compact Program Spacecited by 0
  25. 2026Beyond Plausibility: Verifiable Fine-Grained Image Editing on Structured Assetscited by 0
  26. 2026LayerCanvas: Infographic Generation in AI Learning Assistants via Hybrid Layer-Set Diffusioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025SVGen: Interpretable Vector Graphics Generation with Large Language Models
  2. 2025Style Customization of Text-to-Vector Generation with Image Diffusion Priors
  3. 2026VectorGym: A Multi-Task Benchmark for SVG Code Generation, Sketching and Editing
  4. 2024CraftSVG: Multi-Object Text-to-SVG Synthesis via Layout Guided Diffusion
  5. 2024SVGFusion: A VAE-Diffusion Transformer for Vector Graphic Generation
  6. 2023StarVector: Generating Scalable Vector Graphics Code from Images and Text
  7. 2023Beyond Pixels: Exploring Human-Readable SVG Generation for Simple Images with Vision Language Models
  8. 2025UniSVG: A Unified Dataset for Vector Graphic Understanding and Generation with Multimodal Large Language Models