PrismaCoder: Pushing the Boundaries of Open Multimodal Code Intelligence through Decomposed Rubric Synthesis
Not on the map. Why?
Abstract (arXiv)
Multimodal code intelligence connects the symbolic world of programs with the visual world their execution creates. Interest in this capability is burgeoning, as models are increasingly asked to produce charts, webpages, animations, and semi-structured documents. Recently, proprietary models have pushed far ahead, producing interactive artifacts even from a text description or a screenshot alone. Yet their data and training remain closed, and open progress is held back by the quantity and quality of available data and by the pipelines and methods for producing it. Quality is the harder of the two, since a sample must be correct as a program, well built, and above all visually right once rendered. No existing signal covers all three. Execution often returns just a pass or fail, code similarity does not map to the visual output, and task-specific verifiers do not generalize. To push open progress further, we start from the data side with PrismaForge, a hierarchical data pipeline centered on a synthesized rubric that decomposes these factors into checkable criteria. The same rubric serves as both filter and reward: it curates the supervised corpus, then drives reinforcement learning on visual-coding tasks. Leveraging PrismaForge for data synthesis and filtering, we build PrismaCoder-2M, the most diverse open dataset for multimodal code intelligence and the largest to date. On the model side, we train PrismaCoder-9B and PrismaCoder-35B on this data and release both. They lead the open state of the art by a wide margin and rival leading proprietary systems. Our analyses further show that the proposed rubric-based pipeline improves multimodal coding performance across model backbones. We release our code and data at https://qiushisun.github.io/PrismaCoder-Home/.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 54 of its 68 references that are in the map. First posted on arXiv 14 Oct 2026.
Builds on
54 of 68 references.
References · 54
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
- 2025Group Sequence Policy Optimizationcited by 835
- 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 733
- 2023RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generationcited by 367
- 2026Gemma 4 Technical Reportcited by 259
- 2023Magicoder: Empowering Code Generation with OSS-Instructcited by 256
- 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 234
- 2023FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Setscited by 201
- 2024OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesiscited by 163
- 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 152
38 more
- 2022Large Language Models Meet NL2Code: A Surveycited by 138
- 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Datasetcited by 129
- 2024ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generationcited by 129
- 2024ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoningcited by 128
- 2024MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scalecited by 127
- 2025KodCode: A Diverse, Challenging, and Verifiable Synthetic Dataset for Codingcited by 119
- 2024MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualizationcited by 102
- 2025ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generationcited by 92
- 2024Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMscited by 74
- 2025OmniSVG: A Unified Scalable Vector Graphics Generation Modelcited by 74
- 2025Stabilizing MoE Reinforcement Learning by Aligning Training and Inference Routerscited by 72
- 2024TinyChart: Efficient Chart Understanding with Visual Token Merging and Program-of-Thoughts Learningcited by 52
- 2025DesignBench: A Comprehensive Benchmark for MLLM-based Front-end Code Generationcited by 45
- 2024WebCode2M: A Real-World Dataset for Code Generation from Webpage Designscited by 44
- 2024MMCode: Benchmarking Multimodal Large Language Models for Code Generation with Visually Rich Programming Problemscited by 40
- 2023Symbol-LLM: Towards Foundational Symbol-centric Interface For Large Language Modelscited by 39
- 2024Can Large Language Models Understand Symbolic Graphics Programs?cited by 35
- 2025ChartEdit: How Far Are MLLMs From Automating Chart Analysis? Evaluating MLLMs' Capability via Chart Editingcited by 32
- 2026Code2World: A GUI World Model via Renderable Code Generationcited by 29
- 2025FullFront: Benchmarking MLLMs Across the Full Front-End Engineering Workflowcited by 28
- 2024SVGEditBench: A Benchmark Dataset for Quantitative Assessment of LLM's SVG Editing Capabilitiescited by 26
- 2025ScreenCoder: Advancing Visual-to-Code Generation for Front-End Automation via Modular Multimodal Agentscited by 26
- 2025TheoremExplainAgent: Towards Video-based Multimodal Explanations for LLM Theorem Understandingcited by 24
- 2024Drawing Pandas: A Benchmark for LLMs in Generating Plotting Codecited by 23
- 2025VinciCoder: Unifying Multimodal Code Generation via Coarse-to-fine Visual Reinforcement Learningcited by 21
- 2024HumanEval-V: Benchmarking High-Level Visual Reasoning with Complex Diagrams in Coding Taskscited by 20
- 2025FrontendBench: A Benchmark for Evaluating LLMs on Front-End Development via Automatic Evaluationcited by 20
- 2025VisCoder: Fine-Tuning LLMs for Executable Python Visualization Code Generationcited by 17
- 2025MMMG: A Massive, Multidisciplinary, Multi-Tier Generation Benchmark for Text-to-Image Reasoningcited by 16
- 2025VisCodex: Unified Multimodal Code Generation via Merging Vision and Coding Modelscited by 16
- 2025UniSVG: A Unified Dataset for Vector Graphic Understanding and Generation with Multimodal Large Language Modelscited by 15
- 2024Interactive Evolution: A Neural-Symbolic Self-Training Framework For Large Language Modelscited by 14
- 2025Code-Vision: Evaluating Multimodal LLMs Logic Understanding and Code Generation Capabilitiescited by 13
- 2025On the Perception Bottleneck of VLMs for Chart Understandingcited by 10
- 2025JanusCoder: Towards a Foundational Visual-Programmatic Interface for Code Intelligencecited by 9
- 2025Symbolic Graphics Programming with Large Language Modelscited by 7
- 2025BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Executioncited by 6
- 2025VisCoder2: Building Multi-Language Visualization Coding Agentscited by 6
50 most cited of 54 All 54 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluation
- 2026Omni-I2C: A Holistic Benchmark for High-Fidelity Image-to-Code Generation
- 2025VCode: a Multimodal Coding Benchmark with SVG as Symbolic Visual Representation
- 2025Thinking with Programming Vision: Towards a Unified View for Thinking with Images
- 2026PRISM: Priority-aware Rubric Internalization via Structured Multimodal Data Synthesis
- 2025From Charts to Code: A Hierarchical Benchmark for Multimodal Models
- 2026Seeing is Coding: On the Effectiveness of Vision Language Models in Code Understanding
- 2026From Pixel to Coding: Evaluating the Figure Reproduction Capabilities of MLLMs