RULER: Instance-aware Rubric Rewards for SVG Generation
On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment also fits: Reward hacking and misspecification
Abstract (arXiv)
Generating Scalable Vector Graphics (SVG) code from natural-language instructions is an open-ended task without absolute visual ground truth, leaving both evaluation and policy optimization without a faithful signal. Scalar metrics (CLIP, Aesthetic) calibrated on natural images transfer poorly to stylized vector content, and reusing them as RL rewards triggers reward hacking. We address both limitations with rubric-based scoring. We first establish empirically that prompting a vision-language judge with a multi-axis rubric correlates with human judgments far better than scalar metrics, both across samples and within instructions. Building on this finding, we introduce RULER (Instance-aware Rubric Rewards for Reinforcement Learning), which converts each instruction into an instance-aware rubric of six items spanning semantic, visual, and stylistic axes; a judge VLM scores rendered rollouts item-by-item, and the weighted satisfactions form a fine-grained reward optimized via Group Relative Policy Optimization. Because the rubric is derived from text alone, RULER requires neither paired SVG ground truth nor human preference labels. On MMSVG-Illustration and MMSVG-Icon, RULER lifts the rubric score from 0.432/0.395 to 0.693/0.683, surpassing dedicated SVG specialists and matching the substantially larger DeepSeek-V3, with ablations identifying rubric design as the active lever for RL on open-ended SVG generation. The project page is available at https://hangyuran.github.io/RULER/.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 20 of its 33 references that are in the map. First posted on arXiv 21 Sep 2026.
Builds on
20 of 33 references.
References · 20
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2022Scaling Laws for Reward Model Overoptimizationcited by 1,095
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domainscited by 366
- 2022The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Modelscited by 328
- 2020DeepSVG: A Hierarchical Generative Network for Vector Graphics Animationcited by 159
- 2023StarVector: Generating Scalable Vector Graphics Code from Images and Textcited by 102
- 2023SVGDreamer: Text Guided SVG Generation with Diffusion Modelcited by 76
8 more
- 2023IconShop: Text-Guided Vector Icon Synthesis with Autoregressive Transformerscited by 75
- 2025OmniSVG: A Unified Scalable Vector Graphics Generation Modelcited by 74
- 2025Code2Video: A Code-centric Paradigm for Educational Video Generationcited by 27
- 2025Reward and Guidance through Rubrics: Promoting Exploration to Improve Multi-Domain Reasoningcited by 21
- 2025VCode: a Multimodal Coding Benchmark with SVG as Symbolic Visual Representationcited by 16
- 2025JanusCoder: Towards a Foundational Visual-Programmatic Interface for Code Intelligencecited by 9
- 2026VectorGym: A Multi-Task Benchmark for SVG Code Generation, Sketching and Editingcited by 5
- 2026UI-Mate: Advancing Open-Weight Foundation GUI Agents with In-Context Demonstrationscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Rendering-Aware Reinforcement Learning for Vector Graphics Generation
- 2025SVGThinker: Instruction-Aligned and Reasoning-Driven Text-to-SVG Generation
- 2026Reliable Reasoning in SVG-LLMs via Multi-Task Multi-Reward Reinforcement Learning
- 2025Reason-SVG: Enhancing Structured Reasoning for Vector Graphics Generation with Reinforcement Learning
- 2025SVGen: Interpretable Vector Graphics Generation with Large Language Models
- 2026GeoSVG-RL: Geometry-Aware Reinforcement Learning for Layout-Constrained Text-to-SVG Diagram Generation
- 2025RubricRL: Simple Generalizable Rewards for Text-to-Image Generation
- 2026Visual-ERM: Reward Modeling for Visual Equivalence