mlsanityData to 7 Oct 2026

VSA:Visual-Structural Alignment for UI-to-Code

arXiv 2512.20034 ↗First posted 23 Dec 2025cs.IRcited by 1

Not on the map. Why?

Abstract (arXiv)

The automation of user interface development has the potential to accelerate software delivery by mitigating intensive manual implementation. Despite the advancements in Large Multimodal Models for design-to-code translation, existing methodologies predominantly yield unstructured, flat codebases that lack compatibility with component-oriented libraries such as React or Angular. Such outputs typically exhibit low cohesion and high coupling, complicating long-term maintenance. In this paper, we propose VSA (VSA), a multi-stage paradigm designed to synthesize organized frontend assets through visual-structural alignment. Our approach first employs a spatial-aware transformer to reconstruct the visual input into a hierarchical tree representation. Moving beyond basic layout extraction, we integrate an algorithmic pattern-matching layer to identify recurring UI motifs and encapsulate them into modular templates. These templates are then processed via a schema-driven synthesis engine, ensuring the Large Language Model generates type-safe, prop-drilled components suitable for production environments. Experimental results indicate that our framework yields a substantial improvement in code modularity and architectural consistency over state-of-the-art benchmarks, effectively bridging the gap between raw pixels and scalable software engineering.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). First posted on arXiv 23 Dec 2025.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026DOne: Decoupling Structure and Rendering for High-Fidelity Design-to-Code Generation
  2. 2025ScreenCoder: Advancing Visual-to-Code Generation for Front-End Automation via Modular Multimodal Agents
  3. 2026Beyond Atomic Layouts: Compositional Design Understanding with Vision-Language Models
  4. 2025Portal UX Agent -- A Plug-and-Play Engine for Rendering UIs from Natural Language Specifications
  5. 2025Advancing vision-language models in front-end development via data synthesis
  6. 2025DesignBench: A Comprehensive Benchmark for MLLM-based Front-end Code Generation
  7. 2026TaoD2C-Bench: Benchmarking MLLMs for Industrial UI Code Generation Beyond Visual Fidelity
  8. 2026Rubrics as Visual-Repair Context for Self-Evolving UI-to-Code Generation