Reliable Reasoning in SVG-LLMs via Multi-Task Multi-Reward Reinforcement Learning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
With the rapid advancement of vision-language models, an increasing number of studies have explored their potential for SVG generation tasks. Although existing approaches improve performance by constructing large-scale SVG datasets and introducing SVG-specific tokens, they still suffer from limited generalization, redundant paths in code outputs, and a lack of explicit reasoning. In this work, we present CTRL-S (Chain-of-Thought Reinforcement Learning for SVG), a unified framework that introduces a chain-of-thought mechanism to explicitly expose the model's reasoning process during SVG generation. To support this structured reasoning, we construct SVG-Sophia, a high-quality dataset containing 145K samples across SVG code refinement, Text-to-SVG, and Image-to-SVG tasks. By training the model to generate group-level structured SVG code, CTRL-S significantly improves structural coherence and visual fidelity. Furthermore, we adopt the GRPO algorithm and design a multi-reward optimization framework, incorporating DINO, image-text similarity, format, and code efficiency rewards. Through joint multi-reward optimization and multi-task training, our approach systematically enhances overall generation capabilities. Extensive experiments show that CTRL-S outperforms existing methods, achieving higher task success rates, superior SVG code quality, and exceptional visual fidelity.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 10 of its 45 references that are in the map. First posted on arXiv 17 Mar 2026.
Builds on
10 of 45 references.
Closest ancestors · 2
Same direction, newest first
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
- 2025Reason-SVG: Enhancing Structured Reasoning for Vector Graphics Generation with Reinforcement Learning30 May
Other references · 8
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2024GPT-4o System Cardcited by 4,588
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2017A Neural Representation of Sketch Drawingscited by 313
- 2022StyleCLIPDraw: Coupling Content and Style in Text-to-Drawing Translationcited by 28
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Render-in-the-Loop: Vector Graphics Generation via Visual Self-Feedbackcited by 12
- 2026GeoSVG-RL: Geometry-Aware Reinforcement Learning for Layout-Constrained Text-to-SVG Diagram Generationcited by 2
- 2026Structural Evaluation Metrics for SVG Generation via Leave-One-Out Analysiscited by 1
- 2026GVR-Coder: A Visual-Feedback Framework for Structured SVG Generation in Complex Document and Meeting Scenarioscited by 1
- 2026Not All Prompts Are Equal: Exploration-Guided Prompt Scaffolding for Multimodal Reinforcement Post-Trainingcited by 0
- 2026Reinforcement Learning from Intermediate Renders for Image-to-Code Generationcited by 0
- 2026Reinforcement Learning from Intermediate Renders for Image-to-Code Generation28 Sep 2026
- 2026Not All Prompts Are Equal: Exploration-Guided Prompt Scaffolding for Multimodal Reinforcement Post-Training14 Sep 2026
- 2026GVR-Coder: A Visual-Feedback Framework for Structured SVG Generation in Complex Document and Meeting Scenarios30 Jul 2026
- 2026GeoSVG-RL: Geometry-Aware Reinforcement Learning for Layout-Constrained Text-to-SVG Diagram Generation25 May 2026
- 2026Render-in-the-Loop: Vector Graphics Generation via Visual Self-Feedback22 Apr 2026
- 2026Structural Evaluation Metrics for SVG Generation via Leave-One-Out Analysis9 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026VectorGym: A Multi-Task Benchmark for SVG Code Generation, Sketching and Editing
- 2025SVGThinker: Instruction-Aligned and Reasoning-Driven Text-to-SVG Generation
- 2026RefineSVG: Visual Feedback-Driven Reinforcement Learning for Image-to-SVG Generation
- 2025Rendering-Aware Reinforcement Learning for Vector Graphics Generation
- 2026RULER: Instance-aware Rubric Rewards for SVG Generation
- 2025SVGen: Interpretable Vector Graphics Generation with Large Language Models
- 2025UniSVG: A Unified Dataset for Vector Graphic Understanding and Generation with Multimodal Large Language Models
- 2025SVGenius: Benchmarking LLMs in SVG Understanding, Editing and Generation