mlsanityData to 14 Oct 2026

AesCode: Aesthetic Code Generation with Decoupled Cross-Modal Rewards

arXiv 2610.18860 ↗First posted 13 Oct 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Generating information-rich visual artifacts such as slides, posters, and dashboards as code is appealing because the outputs are structured, editable, and verifiable. Yet code models cannot see how their choices of layout and color come together on the canvas, often limiting spatial planning and aesthetic quality. Image generators excel at visual design but can misrender requested content, making their outputs unreliable targets for direct reproduction. We therefore introduce AesCode, which generates code grounded in the content prompt while using an image generated from the same prompt as an aesthetic guidance. To do so, AesCode represents the target as a design graph that describes the whole canvas and makes each property attributable. From this graph, we derive complementary cross-modal rewards: deterministic verifiers score properties parsable from code and rendering, while a VLM judge assesses the non-parsable ones with a sample-specific Visual Graph Rubric (VGR) tied to graph elements and relations. We optimize these decoupled rewards through reinforcement learning with per-channel normalization to jointly improve spatial planning, aesthetic quality, and verifiable correctness. To evaluate this setting, we build a benchmark that scores verifiable correctness and visual quality separately, with visual scores highly consistent with human judgments. We find that reference images substantially improve the visual quality of code generated by existing models, and ablations show that AesCode benefits from references both as model input and as a source of visual rewards. Relative to same-scale Qwen3-VL baselines given the same references, AesCode-8B and AesCode-32B improve visual quality by 31.1 and 22.4 percentage points, reaching scores comparable to those of closed-source frontier models such as GPT-5.5 and Claude Opus 4.8.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 43 of its 50 references that are in the map. First posted on arXiv 13 Oct 2026.

Builds on

43 of 50 references.

References · 43

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  6. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  7. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  8. 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 513
  9. 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 428
  10. 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 372
  11. 2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domainscited by 366
  12. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
31 more
  1. 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 193
  2. 2023Davidsonian Scene Graph: Improving Reliability in Fine-grained Evaluation for Text-to-Image Generationcited by 171
  3. 2023ChartLlama: A Multimodal LLM for Chart Understanding and Generationcited by 163
  4. 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 152
  5. 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Datasetcited by 129
  6. 2024ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generationcited by 129
  7. 2025Checklists Are Better Than Reward Models For Aligning Language Modelscited by 128
  8. 2017pix2code: Generating Code from a Graphical User Interface Screenshotcited by 114
  9. 2023StarVector: Generating Scalable Vector Graphics Code from Images and Textcited by 102
  10. 2022Character-Aware Models Improve Visual Text Renderingcited by 92
  11. 2025PPTAgent: Generating and Evaluating Presentations Beyond Text-to-Slidescited by 86
  12. 2023LIDA: A Tool for Automatic Generation of Grammar-Agnostic Visualizations and Infographics using Large Language Modelscited by 82
  13. 2025AutoPresent: Designing Structured Visuals from Scratchcited by 68
  14. 2025Paper2Poster: Towards Multimodal Poster Automation from Scientific Paperscited by 63
  15. 2025PosterMaker: Towards High-Quality Product Poster Generation with Accurate Text Renderingcited by 46
  16. 2023COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Designcited by 43
  17. 2025ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluationcited by 42
  18. 2025Rendering-Aware Reinforcement Learning for Vector Graphics Generationcited by 39
  19. 2025Learning Only with Images: Visual Reinforcement Learning with Reasoning, Rendering, and Visual Feedbackcited by 32
  20. 2025MO-GRPO: Mitigating Reward Hacking of Group Relative Policy Optimization on Multi-Objective Problemscited by 23
  21. 2025BizGen: Advancing Article-level Visual Text Rendering for Infographics Generationcited by 20
  22. 2026IGenBench: Benchmarking the Reliability of Text-to-Infographic Generationcited by 17
  23. 2025UI2Code^N: UI-to-Code Generation as Interactive Visual Optimizationcited by 15
  24. 2025ReLook: Vision-Grounded RL with a Multimodal LLM Critic for Agentic Web Codingcited by 14
  25. 2026AeSlides: Incentivizing Aesthetic Layout in LLM-Based Slide Generation via Verifiable Rewardscited by 11
  26. 2026PosterVerse: A Full-Workflow Framework for Commercial-Grade Poster Generation with HTML-Based Scalable Typographycited by 10
  27. 2026VisRefiner: Learning from Visual Differences for Screenshot-to-Code Generationcited by 9
  28. 2026Graphic-Design-Bench: A Comprehensive Benchmark for Evaluating AI on Graphic Design Taskscited by 8
  29. 2026DesignAsCode: Bridging Structural Editability and Visual Fidelity in Graphic Design Generationcited by 5
  30. 2026WebGen-R1: Incentivizing Large Language Models to Generate Functional and Aesthetic Websites with Reinforcement Learningcited by 2
  31. 2026RULER: Instance-aware Rubric Rewards for SVG Generationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026GDB-Reward: From Evaluation Metrics to Training Rewards for Graphic Design
  2. 2025Code Aesthetics with Agentic Reward Feedback
  3. 2026ArtChart: Faithful Artistic Chart Generation with Integrated Text Rendering
  4. 2026OmniDiagram: Advancing Unified Diagram Code Generation via Visual Interrogation Reward
  5. 2026CommerceVibe: Learning to Design E-Commerce Creatives as Executable Visual Code via Dual-Feedback Reinforcement Learning
  6. 2025PosterCraft: Rethinking High-Quality Aesthetic Poster Generation in a Unified Framework
  7. 2026GenClaw: Code-Driven Agentic Image Generation
  8. 2025VinciCoder: Unifying Multimodal Code Generation via Coarse-to-fine Visual Reinforcement Learning