mlsanityData to 7 Oct 2026

IntroSVG: Learning from Rendering Feedback for Text-to-SVG Generation via an Introspective Generator-Critic Framework

arXiv 2603.09312 ↗First posted 10 Mar 2026cs.CVcited by 3

On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment

Abstract (arXiv)

Scalable Vector Graphics (SVG) are central to digital design due to their inherent scalability and editability. Despite significant advancements in content generation enabled by Visual Language Models (VLMs), existing text-to-SVG generation methods are limited by a core challenge: the autoregressive training process does not incorporate visual perception of the final rendered image, which fundamentally constrains generation quality. To address this limitation, we propose an Introspective SVG Generation Framework (IntroSVG). At its core, the framework instantiates a unified VLM that operates in a closed loop, assuming dual roles of both generator and critic. Specifically, through Supervised Fine-Tuning (SFT), the model learns to draft SVGs and to provide feedback on their rendered outputs; moreover, we systematically convert early-stage failures into high-quality error-correction training data, thereby enhancing model robustness. Subsequently, we leverage a high-capacity teacher VLM to construct a preference dataset and further align the generator's policy through Direct Preference Optimization (DPO). During inference, the optimized generator and critic operate collaboratively in an iterative "generate-review-refine" cycle, starting from imperfect intermediate drafts to autonomously improve output quality. Experimental results demonstrate that our method achieves state-of-the-art performance across several key evaluation metrics, generating SVGs with more complex structures, stronger semantic alignment, and greater editability. These results corroborate the effectiveness of incorporating explicit visual feedback into the generation loop.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 36 of its 51 references that are in the map. First posted on arXiv 10 Mar 2026.

Builds on

36 of 51 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preference25 Mar

Other references · 35

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2017Proximal Policy Optimization Algorithmscited by 14,441
  6. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  7. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  8. 2025Qwen3 Technical Reportcited by 8,195
  9. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  10. 2025Qwen2.5-VL Technical Reportcited by 5,418
  11. 2024Qwen2.5 Technical Reportcited by 4,713
  12. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
23 more
  1. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  2. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  3. 2022Solving Quantitative Reasoning Problems with Language Modelscited by 1,359
  4. 2021CLIPDraw: Exploring Text-to-Drawing Synthesis through Language-Image Encoderscited by 186
  5. 2020DeepSVG: A Hierarchical Generative Network for Vector Graphics Animationcited by 158
  6. 2021Im2Vec: Synthesizing Vector Graphics without Vector Supervisioncited by 114
  7. 2019A Learned Representation for Scalable Vector Graphicscited by 91
  8. 2023SVGDreamer: Text Guided SVG Generation with Diffusion Modelcited by 75
  9. 2023IconShop: Text-Guided Vector Icon Synthesis with Autoregressive Transformerscited by 73
  10. 2025OmniSVG: A Unified Scalable Vector Graphics Generation Modelcited by 71
  11. 2024Empowering LLMs to Understand and Generate Complex Vector Graphicscited by 63
  12. 2019FIGR: Few-shot Image Generation with Reptilecited by 54
  13. 2023DiffSketcher: Text Guided Vector Sketch Synthesis through Latent Diffusion Modelscited by 54
  14. 2024Chat2SVG: Vector Graphics Generation with Large Language Models and Image Diffusion Modelscited by 36
  15. 2025Rendering-Aware Reinforcement Learning for Vector Graphics Generationcited by 36
  16. 2025ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluationcited by 35
  17. 2024Text-to-Vector Generation with Neural Path Representationcited by 32
  18. 2024SVGEditBench: A Benchmark Dataset for Quantitative Assessment of LLM's SVG Editing Capabilitiescited by 25
  19. 2025SVGenius: Benchmarking LLMs in SVG Understanding, Editing and Generationcited by 16
  20. 2024SVGBuilder: Component-Based Colored SVG Generation with Text-Guided Autoregressive Transformerscited by 14
  21. 2025UniSVG: A Unified Dataset for Vector Graphic Understanding and Generation with Multimodal Large Language Modelscited by 14
  22. 2025SVGEditBench V2: A Benchmark for Instruction-based SVG Editingcited by 9
  23. 2025SVGThinker: Instruction-Aligned and Reasoning-Driven Text-to-SVG Generationcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025SVGen: Interpretable Vector Graphics Generation with Large Language Models
  2. 2026Evaluating Constrained Iterative Refinement for Scalable Vector Graphics Generation with Off-the-Shelf VLMs
  3. 2026VectorGym: A Multi-Task Benchmark for SVG Code Generation, Sketching and Editing
  4. 2026Render-in-the-Loop: Vector Graphics Generation via Visual Self-Feedback
  5. 2026RefineSVG: Visual Feedback-Driven Reinforcement Learning for Image-to-SVG Generation
  6. 2025NeuralSVG: An Implicit Representation for Text-to-Vector Generation
  7. 2025SVG-T2I: Scaling Up Text-to-Image Latent Diffusion Model Without Variational Autoencoder
  8. 2024SVGFusion: A VAE-Diffusion Transformer for Vector Graphic Generation