RoboSVG: A Unified Framework for Interactive SVG Generation with Multi-modal Guidance
Not on the map. Why?
Abstract (arXiv)
Scalable Vector Graphics (SVGs) are fundamental to digital design and robot control, encoding not only visual structure but also motion paths in interactive drawings. In this work, we introduce RoboSVG, a unified multimodal framework for generating interactive SVGs guided by textual, visual, and numerical signals. Given an input query, the RoboSVG model first produces multimodal guidance, then synthesizes candidate SVGs through dedicated generation modules, and finally refines them under numerical guidance to yield high-quality outputs. To support this framework, we construct RoboDraw, a large-scale dataset of one million examples, each pairing an SVG generation condition (e.g., text, image, and partial SVG) with its corresponding ground-truth SVG code. RoboDraw dataset enables systematic study of four tasks, including basic generation (Text-to-SVG, Image-to-SVG) and interactive generation (PartialSVG-to-SVG, PartialImage-to-SVG). Extensive experiments demonstrate that RoboSVG achieves superior query compliance and visual fidelity across tasks, establishing a new state of the art in versatile SVG generation. The dataset and source code of this project will be publicly available soon.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 34 of its 52 references that are in the map. First posted on arXiv 26 Oct 2025.
Builds on
34 of 52 references.
References · 34
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Visual Instruction Tuningcited by 7,792
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
22 more
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 515
- 2021CLIPDraw: Exploring Text-to-Drawing Synthesis through Language-Image Encoderscited by 186
- 2020DeepSVG: A Hierarchical Generative Network for Vector Graphics Animationcited by 158
- 2022VectorFusion: Text-to-SVG by Abstracting Pixel-Based Diffusion Modelscited by 112
- 2023StarVector: Generating Scalable Vector Graphics Code from Images and Textcited by 96
- 2022Towards Layer-wise Image Vectorizationcited by 77
- 2023SVGDreamer: Text Guided SVG Generation with Diffusion Modelcited by 75
- 2023IconShop: Text-Guided Vector Icon Synthesis with Autoregressive Transformerscited by 73
- 2025OmniSVG: A Unified Scalable Vector Graphics Generation Modelcited by 71
- 2019Learning to Paint With Model-based Deep Reinforcement Learningcited by 70
- 2024Empowering LLMs to Understand and Generate Complex Vector Graphicscited by 63
- 2022FRIDA: A Collaborative Robot Painter with a Differentiable, Real2Sim2Real Planning Environmentcited by 18
- 2024Altogether: Image Captioning via Re-aligning Alt-textcited by 17
- 2025SVGenius: Benchmarking LLMs in SVG Understanding, Editing and Generationcited by 16
- 2024SVGBuilder: Component-Based Colored SVG Generation with Text-Guided Autoregressive Transformerscited by 14
- 2024CoFRIDA: Self-Supervised Fine-Tuning for Human-Robot Co-Paintingcited by 8
- 2024Image-Caption Encoding for Improving Zero-Shot Generalizationcited by 5
- 2024Spline-FRIDA: Towards Diverse, Humanlike Robot Painting Styles with a Sample-Efficient, Differentiable Brush Stroke Modelcited by 5
- 2019RoboCoDraw: Robotic Avatar Drawing with GAN-based Style Transfer and Time-efficient Path Optimizationcited by 4
- 2024SketcherX: AI-Driven Interactive Robotic drawing with Diffusion model and Vectorization Techniquescited by 2
- 2020Multi-Pen Robust Robotic 3D Drawing Using Closed-Loop Planningcited by 1
- 2024Vector Field-Guided Learning Predictive Control for Motion Planning of Mobile Robots with Uncertain Dynamicscited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.